-- Logs begin at Tue 2021-11-02 22:28:11 UTC, end at Tue 2021-11-02 23:58:34 UTC. -- Nov 02 22:58:33.349700 dv-cinder-815848-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 22:58:33.358572 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 22:58:33.360493 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 2 22:58:33 2021] *** Nov 02 22:58:33.360493 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 22:58:33.360493 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 22:58:33.360493 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: nodename: dv-cinder-815848-3-iscsi Nov 02 22:58:33.360493 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: machine: x86_64 Nov 02 22:58:33.360493 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: clock source: unix Nov 02 22:58:33.360493 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: pcre jit disabled Nov 02 22:58:33.360493 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: detected number of CPU cores: 4 Nov 02 22:58:33.360493 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: current working directory: / Nov 02 22:58:33.360493 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: detected binary path: /usr/bin/uwsgi-core Nov 02 22:58:33.361170 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: your processes number limit is 47680 Nov 02 22:58:33.361170 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: your memory page size is 4096 bytes Nov 02 22:58:33.361170 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: detected max file descriptor number: 2048 Nov 02 22:58:33.361170 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: lock engine: pthread robust mutexes Nov 02 22:58:33.361170 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: thunder lock: enabled Nov 02 22:58:33.361170 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 22:58:33.361170 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 02 22:58:33.405589 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: Python main interpreter initialized at 0x5584d8e919c0 Nov 02 22:58:33.405589 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: python threads support enabled Nov 02 22:58:33.405589 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: your server socket listen backlog is limited to 100 connections Nov 02 22:58:33.405589 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: your mercy for graceful operations on workers is 90 seconds Nov 02 22:58:33.405905 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 22:58:33.405989 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: *** Operational MODE: preforking *** Nov 02 22:58:33.406251 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: *** uWSGI is running in multiple interpreter mode *** Nov 02 22:58:33.406251 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: spawned uWSGI master process (pid: 100820) Nov 02 22:58:33.406435 dv-cinder-815848-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 02 22:58:33.407896 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: spawned uWSGI worker 1 (pid: 100821, cores: 1) Nov 02 22:58:33.407896 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: spawned uWSGI worker 2 (pid: 100822, cores: 1) Nov 02 22:58:33.407896 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 22:58:35.051480 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 22:58:35.051480 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: from cryptography.utils import int_from_bytes Nov 02 22:58:35.052146 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 22:58:35.052146 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: from cryptography.utils import int_from_bytes Nov 02 22:58:35.052285 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 22:58:35.052285 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: from cryptography.utils import int_from_bytes Nov 02 22:58:35.052757 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 22:58:35.052757 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: from cryptography.utils import int_from_bytes Nov 02 22:58:37.693236 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 22:58:37.693787 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 22:58:37.693873 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 22:58:37.693873 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 22:58:37.694276 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 22:58:37.694276 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 22:58:37.694407 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 22:58:37.694533 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 22:58:37.694654 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 22:58:37.694909 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.695013 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 22:58:37.695267 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.695354 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.695590 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.695682 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.695912 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.695997 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.696241 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.696334 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.696548 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.696637 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.696867 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.696958 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.697185 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.697277 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.697504 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.697588 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.697761 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.697845 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.698077 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.698170 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.698393 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.698521 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815848-3-iscsi {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.698713 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.698807 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815848-3-iscsi {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.699044 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.699175 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.699362 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.699496 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.699670 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.699801 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.699977 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.700108 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.700290 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.700421 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.700600 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.700722 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.700908 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.701102 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.701428 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.701565 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.701741 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.701857 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.702050 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.702167 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.702364 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.702485 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.702702 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.702837 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.703040 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.703178 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.703352 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.703476 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.703673 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.703790 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.703982 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.704117 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.704306 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.704441 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.704621 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.704767 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815848-3-iscsi {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.705012 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.705140 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815848-3-iscsi {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.705326 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.705459 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.705640 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.705763 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.705954 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.706076 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.706380 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.706508 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.706691 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.706809 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.707021 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.707151 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.707345 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.707469 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.707670 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.707799 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.707978 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.708101 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.708304 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.708486 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.708610 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.708741 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.708926 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.709050 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.709230 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.709353 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.709534 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.709655 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.709851 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.709973 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.710143 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.710265 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.710451 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.710585 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.710754 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.710878 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.711018 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.711137 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.711317 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.711457 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.711623 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.711748 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.711943 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.712066 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.712262 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.712392 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.712517 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.712644 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.712784 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.712979 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.713114 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.713236 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.713363 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.713484 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.713921 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.714059 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.714237 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.714356 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.714521 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.714643 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.714826 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.714985 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.715158 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.715288 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.715464 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.715586 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.715766 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.715901 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.716069 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.716192 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.716375 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.716498 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.716687 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.716818 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.717002 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.717125 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.717309 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.717431 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.717619 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.717750 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.717937 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.718072 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.718249 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.718380 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.718556 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.718681 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.718862 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.719012 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.719229 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.719352 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.719541 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.719665 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.719853 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.719975 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.720172 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.720295 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.720480 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.720602 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.720786 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.720909 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.721090 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.721219 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.721396 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.721521 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.721715 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.722337 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.722553 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.722684 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.722814 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.722966 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.723154 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.723278 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.723398 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.723531 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.723702 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.723825 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.724010 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.724133 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.724312 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.724443 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.724616 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.724738 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.724917 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.725039 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.725215 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.725347 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.725521 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.725650 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.725825 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.725959 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.726131 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.726261 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.726435 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.726557 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.726741 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.726869 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.727057 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.727193 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.727362 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.727485 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.727665 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.727805 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.727969 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.728096 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.728289 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.728419 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.728596 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.728724 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.728902 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.729030 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.729203 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.729325 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.729508 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.729630 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.729816 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.729948 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.730121 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.730249 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.730429 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.730552 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.730731 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.730854 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.731074 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.731200 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.731378 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.731500 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.731684 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.731815 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.731990 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.732119 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.732297 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.732420 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.732601 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.732732 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.732907 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.733029 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.733228 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.733367 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.733518 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.733645 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.733817 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.733947 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.734123 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.734254 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.734427 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.734550 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.734731 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.734853 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.735058 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.735195 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.735363 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.735487 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.735664 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.735793 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.735967 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.736099 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.736264 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.736386 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.736563 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.736686 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.736882 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.737077 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.737201 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.737319 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.737528 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.738195 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.738358 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.738484 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.738682 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.738814 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.739044 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.739171 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 22:58:37.739380 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.739505 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.739711 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.739834 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.740034 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.740163 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.740362 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.740485 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.740702 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.740824 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.741025 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.741160 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.741341 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.741471 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.741654 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.741776 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.741968 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.742104 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.742283 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.742407 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.742598 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.742720 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.742910 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.743068 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.743245 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.743448 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.743581 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.743707 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.743873 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.743996 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.744193 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.744329 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.744511 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.744633 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.744829 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.744967 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.745143 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.745272 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.745453 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.745576 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.745774 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.745908 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.746097 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.746234 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.746410 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.746535 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.746722 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.746845 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.747089 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.747226 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.747414 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.747536 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.747734 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.747864 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.748046 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.748168 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.748360 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.748482 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.748673 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.748796 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.748986 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.749108 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.749297 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.749419 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.749607 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.749731 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.749924 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.750046 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.750236 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.750382 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.750554 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.750676 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.750876 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.751022 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.751216 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.751353 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.751523 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.751645 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.751827 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.751956 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.752130 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.752265 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.752435 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.752557 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.752738 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.752867 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.753041 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.753210 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.753389 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.753589 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.753713 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.753839 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.754010 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.754135 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.754316 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.754468 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.754629 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.754754 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.754962 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.755091 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.755273 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.755429 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.755562 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.755684 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.755879 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.756006 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.756180 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.756302 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.756485 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.756607 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.756801 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.756924 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.757107 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.757234 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.757411 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.757541 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.757804 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.757928 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.758055 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.758177 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.758318 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.758450 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.758613 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.758735 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.758971 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.759099 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.759262 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.759400 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.759565 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.759697 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.759877 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.759999 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.760188 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.760389 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.760519 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.760639 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.760823 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.760954 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.761140 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.761272 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.761445 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.761568 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.761770 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.761901 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.762085 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.762207 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.762390 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.762520 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.762691 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.762814 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.763017 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.763142 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.763322 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.763445 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.763620 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.763748 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.763924 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.764048 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.764224 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.764355 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.764525 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.764656 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.764828 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.764951 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.765133 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.765249 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.765438 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.765579 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.765741 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.765866 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.766064 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.766189 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.766373 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.766538 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.766656 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.766775 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.766985 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.767115 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.767290 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.767423 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.767624 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.767754 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.767955 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.768079 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.768255 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.768388 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.768589 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.768715 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.768934 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.769059 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.769248 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.769371 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.769561 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.769684 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.769872 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.769994 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.770181 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.770304 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.770491 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.770613 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.770801 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.770950 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.771137 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.771271 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.771451 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.771574 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.771764 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.771888 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.772074 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.772198 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.772383 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.772506 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.772699 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.772834 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.773008 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.773138 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.773314 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.773437 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.773621 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.773752 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.773939 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.774070 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.774279 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.774410 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.774598 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.774730 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.774947 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.775073 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.775250 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.775365 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.775560 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.775696 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.775872 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.775995 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.776181 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.776304 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.776491 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.776621 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.776800 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.776923 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.777111 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.777236 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.777420 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.777550 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.777727 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.777850 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.778046 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.778177 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.778346 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.778470 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.778652 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.778781 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.778985 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.779112 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.779298 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.779429 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.779600 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.779722 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.779913 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.780045 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.780241 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.780367 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.780550 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.780672 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.780870 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.781002 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.781180 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.781302 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.781491 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.781621 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.781799 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.781931 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.782107 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.782233 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.782410 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.782532 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.782713 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.782847 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.783042 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.783171 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.783355 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.783479 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.783666 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.783798 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.783976 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.784098 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.784280 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.784895 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.785109 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.785240 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.785421 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.785544 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.785729 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.785852 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.786034 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.786165 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.786339 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.786464 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.786652 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.786776 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.786984 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.787110 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.787298 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.787420 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.787622 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.787781 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.787921 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.788041 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.788326 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.788450 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.788571 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.788699 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.788820 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.788946 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.789129 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.789261 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.789430 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.789629 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.789752 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.789880 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.790030 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.790162 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.790365 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.790496 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.790670 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.790795 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.790998 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.791134 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.791316 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.791450 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.791630 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.791761 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.791941 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.792063 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.792253 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.792384 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.792562 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.792693 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.792874 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.792998 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.793192 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.793315 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.793506 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.793630 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.793819 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.793941 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.794131 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.794261 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.794441 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.794564 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.794753 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.794878 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.795089 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.795215 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.795414 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.795539 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.795726 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.795861 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.796039 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.796170 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.796352 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.796477 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.796656 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.796788 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.796967 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.797092 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.797283 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.797537 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.797842 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.797977 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.798177 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.798436 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.798563 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.798684 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.798812 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.798991 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.799115 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.799237 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.799435 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.799560 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.799766 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.799892 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.800613 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.800740 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.800928 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.801053 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.801235 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.801359 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.801543 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.801667 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.801848 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.801971 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.802151 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.802277 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.802455 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.802584 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.802757 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.802886 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.803088 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.803223 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.803394 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.803525 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.803698 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.803829 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.803999 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.804121 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.804303 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.804427 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.804623 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.804759 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.804938 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.805076 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.805240 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.805365 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.805546 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.805668 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.805850 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.805972 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.806154 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.806278 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.806470 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.806592 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.806772 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.806904 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.807098 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.807221 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.807400 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.807523 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.807700 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.807835 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.808042 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.808165 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.808345 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.808562 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.808688 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.808819 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.808998 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.809136 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.809319 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.809443 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.809625 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.809757 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.809932 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.810056 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.810241 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.810364 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.810545 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.810669 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.810845 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.810985 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.811176 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.811303 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.811488 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.811614 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.811788 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.811910 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.812089 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.812211 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.812398 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.812522 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.812707 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.812837 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.813019 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.813143 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.813322 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.813446 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.813622 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.813745 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.813923 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.814121 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.814252 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.814372 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.814527 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.814660 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.814829 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.814995 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.815154 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.815278 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.815456 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.815600 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.815788 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.815923 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.816091 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.816216 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.816392 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.816515 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.816695 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.816827 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.816995 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.817117 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.817304 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.817434 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.817606 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.817730 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.817907 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.818029 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.818208 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.818331 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.818515 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.818715 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.818840 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.818992 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.819137 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.819260 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.819458 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.819583 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.819759 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.819882 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.820059 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.820182 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.820362 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.820488 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.820754 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.820997 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.821188 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.821359 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.821359 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.821660 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.821809 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.821963 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.822114 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.822274 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.822274 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.822555 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.822555 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.822840 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.822840 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.823158 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.823301 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.823442 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.823591 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.823745 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.823745 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.824033 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.824033 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.824386 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.824386 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.824666 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.824666 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.824945 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.825086 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.825229 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.825370 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.825511 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.825511 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.825824 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.825986 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.826129 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.826269 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.826410 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.826561 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.826703 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.826703 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.827130 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.827130 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.827514 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.827696 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.827850 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.827998 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.828146 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.828292 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.828449 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.828596 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.828756 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.828972 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.829122 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.829283 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.829470 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.829654 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.829851 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.830054 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.830228 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.830398 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.830604 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.830780 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.830964 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.831110 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.831786 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.831949 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.832102 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.832244 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.832386 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.832528 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.832682 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.832824 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.832974 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.833118 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.833260 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.833409 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.833575 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.833810 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.833967 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.834109 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.834251 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.834392 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.834533 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.834690 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.834834 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.835001 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.835148 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.835291 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.835449 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.835647 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.835803 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.835963 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.836128 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.836272 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.836422 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.836581 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.836727 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.836869 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.837012 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.837155 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.837311 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.837454 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.837627 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.837790 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.837944 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.838091 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.838247 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.838394 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.838794 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.839018 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.839176 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.839329 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.839480 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.839622 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.839763 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.839905 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.840046 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.840186 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.840336 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.840477 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.840625 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.840776 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.840927 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.841076 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.841218 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.841358 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.841500 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.841641 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.841785 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.841959 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.842102 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.842243 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.842391 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.842544 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.842686 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.842836 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.843006 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.843154 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.843298 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.843441 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.843585 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.843808 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.843953 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.844105 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.844248 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.844397 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.844557 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.844708 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.844852 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.845000 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.845144 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.845293 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.845445 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.845589 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.845763 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.845909 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.846065 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.846244 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.846398 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.846548 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.846713 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.846967 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.847656 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.847825 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.847984 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.848127 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.848270 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.848412 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.848554 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.848704 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.848846 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.848987 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.849154 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.849318 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.849462 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.849613 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.849757 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.849902 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.850052 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.850193 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.850335 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.850506 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.850671 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.850818 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.850995 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.851146 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.851306 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.851456 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.851608 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.851754 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.851907 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.852054 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.852213 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.852359 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.852506 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.852650 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.852803 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.852961 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.853121 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.853268 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.853420 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.853568 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.853714 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.853861 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.854019 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.854165 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.854312 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.854463 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.854611 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.854757 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.854990 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.855149 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.855294 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.855434 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.855575 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.855726 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.855907 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.856059 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.856218 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.856401 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.856557 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.856701 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.856849 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.857001 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.857143 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.857284 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.857426 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.857567 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.857709 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.857888 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.858053 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.858196 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.858352 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.858495 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.858637 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.858794 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.858968 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.859117 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.859290 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.859457 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.859604 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.859765 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.859914 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.860060 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.860207 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.860354 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.860508 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.860656 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.860813 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.860962 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.861115 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.861268 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.861428 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.861575 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.861721 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.861867 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.862014 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.862159 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.862318 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.862479 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.862639 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.862791 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.862973 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.863120 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.863279 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.863421 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.863564 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.863705 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.863854 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.864006 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.864149 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.864290 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.864432 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.864579 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.864727 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.864878 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.865020 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.865169 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.865310 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.865452 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.865601 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.865760 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.865929 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.866098 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.866277 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.866451 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.866601 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.866755 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.866898 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.867155 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.867300 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.867443 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.867599 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.867751 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.867906 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.868079 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.868235 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.868386 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.868539 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.868689 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.868835 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.868977 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.869122 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.869266 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.869438 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.869610 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.869766 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.869922 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.870071 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.870227 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.870377 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.870525 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.870688 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.870838 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.871009 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.871164 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.871307 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.871451 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.871603 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.871744 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.871894 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.872049 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.872193 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.872334 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.872500 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.872658 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.872801 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.872956 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.873106 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.873254 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.873410 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.873555 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.873708 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.873862 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.874005 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.874147 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.874288 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.874439 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.874592 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.874734 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.874876 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.875045 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.875203 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.875347 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.875500 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.875645 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.875798 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.875950 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.876118 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.876274 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.876442 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.876622 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.876774 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.876918 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.877063 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.877206 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.877362 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.877507 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.877659 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.877843 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.877989 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.878165 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.878327 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.878480 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.878628 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.878782 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.878986 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.879144 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.879310 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.879457 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.879621 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.879775 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.879918 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.880069 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.880213 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.880360 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.880503 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.880645 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.880807 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.880949 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.881097 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.881254 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.881405 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.881549 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.881700 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.881845 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.881986 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.882135 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.882283 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.882426 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.882614 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.882757 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.882901 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.883076 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.883221 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.883377 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.883523 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.883675 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.883820 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.883972 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.884124 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.884279 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.884426 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.884577 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.884722 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.884866 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.885011 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.885165 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.885313 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.885456 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.885456 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.885735 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.885889 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.886034 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.886193 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.886364 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.886510 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.886676 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.886844 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.887011 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.887157 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.887310 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.887453 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.887613 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.887802 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.887947 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.888088 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.888247 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.888411 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.888562 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.888705 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.888848 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.888989 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.889138 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.889282 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.889496 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.889668 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.889836 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.889980 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.890122 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.890273 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.890417 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.890560 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.890704 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.890854 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.891023 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.891185 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.891339 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.891490 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.891645 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.891790 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.891933 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.892085 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.892231 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.892376 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.892526 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.892670 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.892812 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.892963 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.893108 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.893252 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.893404 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.893549 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.894214 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.894389 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.894544 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.894692 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.894838 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.895006 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.895164 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.895309 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.895467 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.895618 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.895762 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.895917 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.896070 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.896215 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.896378 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.896540 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.896703 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.896876 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.897098 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.897244 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.897389 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.897534 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.897677 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.897839 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.897984 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.898128 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.898272 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.898429 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.898608 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.898783 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.898990 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.899138 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.899291 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.899435 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.899577 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.899729 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.899904 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.900059 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.900202 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.900343 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.900494 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.900643 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.900790 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.900931 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.901072 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.901220 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.901373 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.901517 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.901658 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.901806 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.901956 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.902098 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.902251 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.902400 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.902542 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.902683 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.902826 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.902991 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.903151 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.903295 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.903438 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.903587 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.903732 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.903883 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.904027 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.904169 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.904311 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.904453 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.904601 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.904754 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.904899 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.905042 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.905184 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.905326 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.905476 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.905629 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.905773 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.905916 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.906060 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.906202 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.906352 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.906527 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.906686 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.906848 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.907082 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.907227 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.907369 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.907524 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.907667 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.907809 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.907951 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.908119 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.908278 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.908420 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.908589 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.908754 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.908915 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.909058 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.909209 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.909447 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.910101 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.910256 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.910398 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.910538 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.910689 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.910840 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.911012 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.911162 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.911309 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.911456 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.911614 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.911761 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.911908 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.912061 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.912210 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.912367 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.912514 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.912719 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.912870 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.913066 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.913214 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.913373 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.913527 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.913680 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.913827 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.913980 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.914133 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.914289 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.914443 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.914590 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.914735 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.914888 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.915093 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.915237 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.915387 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.915530 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.915671 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.915813 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.915968 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.916119 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.916261 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.916403 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.916549 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.916719 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.916871 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.917032 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.917191 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.917362 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.917515 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.917666 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.917813 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.917956 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.918103 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.918245 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.918387 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.918543 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.918686 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.918854 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.919041 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.919196 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.919340 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.919496 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.919641 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.919791 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.919935 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.920079 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.920253 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.920412 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.920562 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.920712 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.920861 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.921008 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.921163 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.921385 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.921534 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.921688 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.921835 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.922009 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.922166 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.922314 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.922464 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.922611 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.922759 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.923026 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.923189 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.923333 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.923484 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.923632 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.923777 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.923932 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.924075 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.924217 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.924358 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.924500 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.924648 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.924828 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.924993 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.925183 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.925326 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.925508 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.925657 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.925873 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.926017 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.926159 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.926300 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.926442 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.926591 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.926750 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.926955 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.927122 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.927287 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.927432 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.927593 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.927746 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.927897 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.928043 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.928187 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.928339 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.928495 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.928639 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.928781 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.928940 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.929108 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.929252 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.929404 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.929554 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.929699 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.929843 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.929993 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.930146 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.930305 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.930479 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.930626 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.930773 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.930976 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.931141 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.931284 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.931426 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.931571 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.931714 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.931855 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.932004 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.932148 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.932297 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.932454 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.932628 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.932782 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.932926 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.933069 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.933212 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.933358 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.933501 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.933652 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.933804 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.933944 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.934087 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.934229 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.934371 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.934529 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.934739 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.935022 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.935236 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.935390 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.935597 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.935758 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.935946 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.936091 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.936260 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.936412 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.936568 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.936711 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.936870 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.937045 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.937191 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.937366 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.937531 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.937679 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.937825 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.937978 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.938125 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.938278 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.938462 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.938613 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.938763 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.938909 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.939140 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.939308 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.939460 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.939603 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 22:58:37.939751 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 22:58:37.939902 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 22:58:37.962611 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_db.sqlalchemy.engines [None req-639a8933-7854-4829-9de1-51c0962adec9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100822) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 22:58:37.963748 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG oslo_db.sqlalchemy.engines [None req-88dc13fc-8dbd-4687-9914-9e04ab025aba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 22:58:38.135056 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.context [None req-639a8933-7854-4829-9de1-51c0962adec9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cf0116f-06d0-4573-b34b-f5af4d2eb5ed(cell1) {{(pid=100822) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 22:58:38.135776 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.context [None req-88dc13fc-8dbd-4687-9914-9e04ab025aba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cf0116f-06d0-4573-b34b-f5af4d2eb5ed(cell1) {{(pid=100821) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 22:58:38.139462 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_concurrency.lockutils [None req-639a8933-7854-4829-9de1-51c0962adec9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 22:58:38.140148 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG oslo_concurrency.lockutils [None req-88dc13fc-8dbd-4687-9914-9e04ab025aba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 22:58:38.141060 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_concurrency.lockutils [None req-639a8933-7854-4829-9de1-51c0962adec9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 22:58:38.141729 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG oslo_concurrency.lockutils [None req-88dc13fc-8dbd-4687-9914-9e04ab025aba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 22:58:38.141869 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_concurrency.lockutils [None req-639a8933-7854-4829-9de1-51c0962adec9 None None] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 22:58:38.142543 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG oslo_concurrency.lockutils [None req-88dc13fc-8dbd-4687-9914-9e04ab025aba None None] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 22:58:38.144364 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_concurrency.lockutils [None req-639a8933-7854-4829-9de1-51c0962adec9 None None] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 22:58:38.145024 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG oslo_concurrency.lockutils [None req-88dc13fc-8dbd-4687-9914-9e04ab025aba None None] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 22:58:38.154866 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_db.sqlalchemy.engines [None req-639a8933-7854-4829-9de1-51c0962adec9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100822) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 22:58:38.157719 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG oslo_db.sqlalchemy.engines [None req-88dc13fc-8dbd-4687-9914-9e04ab025aba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 22:58:38.160573 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG oslo_db.sqlalchemy.engines [None req-88dc13fc-8dbd-4687-9914-9e04ab025aba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 22:58:38.165233 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_db.sqlalchemy.engines [None req-639a8933-7854-4829-9de1-51c0962adec9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100822) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 22:58:38.419799 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG oslo_db.sqlalchemy.engines [None req-88dc13fc-8dbd-4687-9914-9e04ab025aba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 22:58:38.422496 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_db.sqlalchemy.engines [None req-639a8933-7854-4829-9de1-51c0962adec9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100822) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 22:58:38.760894 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: WARNING keystonemiddleware.auth_token [None req-639a8933-7854-4829-9de1-51c0962adec9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 22:58:38.762431 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: WARNING keystonemiddleware.auth_token [None req-88dc13fc-8dbd-4687-9914-9e04ab025aba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 22:58:38.767462 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: WARNING keystonemiddleware.auth_token [None req-639a8933-7854-4829-9de1-51c0962adec9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 22:58:38.769009 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: WARNING keystonemiddleware.auth_token [None req-88dc13fc-8dbd-4687-9914-9e04ab025aba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 22:58:39.111876 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: WARNING keystonemiddleware.auth_token [None req-639a8933-7854-4829-9de1-51c0962adec9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 22:58:39.115401 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: WARNING keystonemiddleware.auth_token [None req-88dc13fc-8dbd-4687-9914-9e04ab025aba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 22:58:39.117488 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: WARNING keystonemiddleware.auth_token [None req-639a8933-7854-4829-9de1-51c0962adec9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 22:58:39.120552 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: WARNING keystonemiddleware.auth_token [None req-88dc13fc-8dbd-4687-9914-9e04ab025aba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 22:58:39.123598 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584d8e919c0 pid: 100822 (default app) Nov 02 22:58:39.125630 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-639a8933-7854-4829-9de1-51c0962adec9 None None] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:58:39.126652 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584d8e919c0 pid: 100821 (default app) Nov 02 22:58:39.126807 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-639a8933-7854-4829-9de1-51c0962adec9 None None] 10.222.0.41 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001720 Nov 02 22:58:39.127232 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 1/1] 10.222.0.41 () {50 vars in 788 bytes} [Tue Nov 2 22:58:39 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:59:59.829247 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-88dc13fc-8dbd-4687-9914-9e04ab025aba None None] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:59:59.830968 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-88dc13fc-8dbd-4687-9914-9e04ab025aba None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002436 Nov 02 22:59:59.833940 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 1/2] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 2 22:59:59 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:00:00.307089 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-5cd51f09-0095-4847-acf1-1d8d97b4a4db admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:00:00.339443 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-5cd51f09-0095-4847-acf1-1d8d97b4a4db admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.498132 Nov 02 23:00:00.339443 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 2/3] 10.222.0.41 () {60 vars in 1291 bytes} [Tue Nov 2 22:59:59 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:00:02.666121 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-88dc13fc-8dbd-4687-9914-9e04ab025aba None None] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:00:02.667162 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-88dc13fc-8dbd-4687-9914-9e04ab025aba None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Nov 02 23:00:02.668806 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 2/4] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 2 23:00:02 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:00:02.727468 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-e971d53a-221d-442a-9fc1-9675371f77aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "ram": 256, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "c1"}} {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:00:02.745121 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:00:02.745121 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: warnings.warn(msg) Nov 02 23:00:02.774048 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-e971d53a-221d-442a-9fc1-9675371f77aa admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.099830 Nov 02 23:00:02.774602 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 3/5] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 2 23:00:02 2021] POST /compute/v2.1/flavors => generated 407 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:00:02.991300 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-80df0a79-0c94-4001-a6e1-84690c988ff2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:00:02.993622 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:00:02.993622 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: warnings.warn(msg) Nov 02 23:00:03.046028 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-80df0a79-0c94-4001-a6e1-84690c988ff2 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.262058 Nov 02 23:00:03.059001 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 3/6] 10.222.0.41 () {64 vars in 1335 bytes} [Tue Nov 2 23:00:02 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:00:05.391478 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-e971d53a-221d-442a-9fc1-9675371f77aa admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:00:05.393169 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-e971d53a-221d-442a-9fc1-9675371f77aa admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002172 Nov 02 23:00:05.393726 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 4/7] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 2 23:00:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:00:05.512907 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-0163e702-abdf-4235-b58c-c1ee30e97088 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "swap": 0, "name": "ds512M", "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "id": "d1", "os-flavor-access:is_public": true}} {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:00:05.531500 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:00:05.531500 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: warnings.warn(msg) Nov 02 23:00:05.556020 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-0163e702-abdf-4235-b58c-c1ee30e97088 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.154597 Nov 02 23:00:05.557027 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 4/8] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 2 23:00:05 2021] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:00:05.570791 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-70ed5c71-ade2-40f4-a0eb-20b619e7aac4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:00:05.572490 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:00:05.572490 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: warnings.warn(msg) Nov 02 23:00:05.608306 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-70ed5c71-ade2-40f4-a0eb-20b619e7aac4 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041236 Nov 02 23:00:05.609131 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 5/9] 10.222.0.41 () {64 vars in 1335 bytes} [Tue Nov 2 23:00:05 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:00:07.929205 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-0163e702-abdf-4235-b58c-c1ee30e97088 admin admin] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:00:07.930911 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-0163e702-abdf-4235-b58c-c1ee30e97088 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002077 Nov 02 23:00:07.931425 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 5/10] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 2 23:00:07 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:00:07.991044 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-d0ca31d0-ebf4-47e0-825e-59d9c962dc92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "id": "d2", "os-flavor-access:is_public": true, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10}} {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:00:08.010442 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-d0ca31d0-ebf4-47e0-825e-59d9c962dc92 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072517 Nov 02 23:00:08.011438 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 6/11] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 2 23:00:07 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:00:08.026107 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-94dd5b6c-dd44-4e44-a37e-413d42999d22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:00:08.049439 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-94dd5b6c-dd44-4e44-a37e-413d42999d22 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028682 Nov 02 23:00:08.051378 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 6/12] 10.222.0.41 () {64 vars in 1335 bytes} [Tue Nov 2 23:00:08 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:00:10.377130 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-d0ca31d0-ebf4-47e0-825e-59d9c962dc92 admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:00:10.378146 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-d0ca31d0-ebf4-47e0-825e-59d9c962dc92 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002084 Nov 02 23:00:10.378554 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 7/13] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 2 23:00:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:00:10.435927 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-e295f95d-cbe7-4511-9817-dba567399de8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "swap": 0}} {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:00:10.454701 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-e295f95d-cbe7-4511-9817-dba567399de8 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.069706 Nov 02 23:00:10.455292 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 7/14] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 2 23:00:10 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:00:10.468214 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-1d2880b1-1ab2-4919-baf7-850222bdeb1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:00:10.493012 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-1d2880b1-1ab2-4919-baf7-850222bdeb1f admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028532 Nov 02 23:00:10.493845 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 8/15] 10.222.0.41 () {64 vars in 1335 bytes} [Tue Nov 2 23:00:10 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:00:12.844049 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-e295f95d-cbe7-4511-9817-dba567399de8 admin admin] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:00:12.845969 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-e295f95d-cbe7-4511-9817-dba567399de8 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Nov 02 23:00:12.846367 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 8/16] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 2 23:00:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:00:12.921532 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-aa3c25e3-4457-4e38-9865-e392214e8ab1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "d4", "name": "ds4G", "vcpus": 4}} {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:00:12.942967 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-aa3c25e3-4457-4e38-9865-e392214e8ab1 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087679 Nov 02 23:00:12.948254 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 9/17] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 2 23:00:12 2021] POST /compute/v2.1/flavors => generated 404 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:00:12.955273 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-d0a2ba08-7f3d-4e21-ace9-5fd25a3bf956 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:00:12.981000 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-d0a2ba08-7f3d-4e21-ace9-5fd25a3bf956 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030334 Nov 02 23:00:12.982337 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 9/18] 10.222.0.41 () {64 vars in 1335 bytes} [Tue Nov 2 23:00:12 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:00:15.346863 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-aa3c25e3-4457-4e38-9865-e392214e8ab1 admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:00:15.347940 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-aa3c25e3-4457-4e38-9865-e392214e8ab1 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Nov 02 23:00:15.348360 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 10/19] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 2 23:00:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:00:15.413694 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-9907858e-ab05-498d-9d84-5d0d626a7e29 admin admin] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:00:15.436202 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-9907858e-ab05-498d-9d84-5d0d626a7e29 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079943 Nov 02 23:00:15.436757 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 10/20] 10.222.0.41 () {60 vars in 1291 bytes} [Tue Nov 2 23:00:15 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:00:18.186353 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-aa3c25e3-4457-4e38-9865-e392214e8ab1 admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:00:18.187382 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-aa3c25e3-4457-4e38-9865-e392214e8ab1 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Nov 02 23:00:18.187933 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 11/21] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 2 23:00:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:00:18.252651 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-69972de8-cdb3-4c24-877d-938a5dd96465 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:00:18.275346 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-69972de8-cdb3-4c24-877d-938a5dd96465 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079935 Nov 02 23:00:18.275991 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 11/22] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 2 23:00:18 2021] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:00:18.290082 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-846b6f8d-6fa2-4c56-8cfa-107db9481c84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:00:18.313418 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-846b6f8d-6fa2-4c56-8cfa-107db9481c84 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027090 Nov 02 23:00:18.314769 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 12/23] 10.222.0.41 () {64 vars in 1332 bytes} [Tue Nov 2 23:00:18 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:00:21.059532 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-69972de8-cdb3-4c24-877d-938a5dd96465 admin admin] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:00:21.060518 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-69972de8-cdb3-4c24-877d-938a5dd96465 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Nov 02 23:00:21.060904 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 12/24] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 2 23:00:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:00:21.130202 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-0e98846a-cae1-473d-85e9-c3286c9cfd41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.small", "vcpus": 1, "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:00:21.150484 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-0e98846a-cae1-473d-85e9-c3286c9cfd41 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082000 Nov 02 23:00:21.151029 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 13/25] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 2 23:00:21 2021] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:00:21.164025 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-722afd42-3c6a-4cab-a356-244a0f1ae5d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:00:21.189903 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-722afd42-3c6a-4cab-a356-244a0f1ae5d4 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029312 Nov 02 23:00:21.190649 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 13/26] 10.222.0.41 () {64 vars in 1332 bytes} [Tue Nov 2 23:00:21 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:00:23.509039 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-0e98846a-cae1-473d-85e9-c3286c9cfd41 admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:00:23.510198 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-0e98846a-cae1-473d-85e9-c3286c9cfd41 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Nov 02 23:00:23.510680 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 14/27] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 2 23:00:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:00:23.569271 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-066a854c-b3cb-4cba-851a-0f1d18661d94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.medium"}} {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:00:23.589884 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-066a854c-b3cb-4cba-851a-0f1d18661d94 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072476 Nov 02 23:00:23.590439 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 14/28] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 2 23:00:23 2021] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:00:23.603291 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-d784addd-30dc-428c-ba44-c6dbed607c9f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:00:23.627253 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-d784addd-30dc-428c-ba44-c6dbed607c9f admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027503 Nov 02 23:00:23.627859 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 15/29] 10.222.0.41 () {64 vars in 1332 bytes} [Tue Nov 2 23:00:23 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:00:25.972991 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-066a854c-b3cb-4cba-851a-0f1d18661d94 admin admin] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:00:25.973981 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-066a854c-b3cb-4cba-851a-0f1d18661d94 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Nov 02 23:00:25.974652 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 15/30] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 2 23:00:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:00:26.035274 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-43906f45-ad24-46bb-bf53-4a28f355b9dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "m1.large", "disk": 80, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:00:26.054532 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-43906f45-ad24-46bb-bf53-4a28f355b9dd admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073062 Nov 02 23:00:26.055573 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 16/31] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 2 23:00:25 2021] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:00:26.068249 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-78ae8db7-2220-41da-9204-e86f090f5beb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:00:26.094338 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-78ae8db7-2220-41da-9204-e86f090f5beb admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030316 Nov 02 23:00:26.095702 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 16/32] 10.222.0.41 () {64 vars in 1332 bytes} [Tue Nov 2 23:00:26 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:00:28.483535 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-43906f45-ad24-46bb-bf53-4a28f355b9dd admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:00:28.484849 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-43906f45-ad24-46bb-bf53-4a28f355b9dd admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001865 Nov 02 23:00:28.486081 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 17/33] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 2 23:00:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:00:28.550493 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-9d5b4c9c-6af1-47a2-b30f-fd72c7568f94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "swap": 0, "name": "m1.xlarge", "rxtx_factor": 1.0, "disk": 160, "vcpus": 8, "id": "5"}} {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:00:28.570747 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-9d5b4c9c-6af1-47a2-b30f-fd72c7568f94 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078118 Nov 02 23:00:28.571334 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 17/34] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 2 23:00:28 2021] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:00:28.583884 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-9643f1c2-7271-4650-be35-dff8446cfb34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:00:28.609307 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-9643f1c2-7271-4650-be35-dff8446cfb34 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029127 Nov 02 23:00:28.609887 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 18/35] 10.222.0.41 () {64 vars in 1332 bytes} [Tue Nov 2 23:00:28 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:01:07.585286 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-9d5b4c9c-6af1-47a2-b30f-fd72c7568f94 admin admin] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:07.586347 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-9d5b4c9c-6af1-47a2-b30f-fd72c7568f94 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Nov 02 23:01:07.586778 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 18/36] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 2 23:01:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:01:07.644716 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-8c6a1be7-de6d-4feb-bd89-f9d5f12d94a8 admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:07.661138 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-8c6a1be7-de6d-4feb-bd89-f9d5f12d94a8 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067674 Nov 02 23:01:07.661671 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 19/37] 10.222.0.41 () {60 vars in 1291 bytes} [Tue Nov 2 23:01:07 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:01:09.188706 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-9d5b4c9c-6af1-47a2-b30f-fd72c7568f94 admin admin] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:09.189710 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-9d5b4c9c-6af1-47a2-b30f-fd72c7568f94 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Nov 02 23:01:09.190120 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 19/38] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 2 23:01:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:01:09.381124 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-5b06013e-b8aa-4fe9-bca9-20303244656d admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:09.386571 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.wsgi [None req-5b06013e-b8aa-4fe9-bca9-20303244656d admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 23:01:09.387154 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-5b06013e-b8aa-4fe9-bca9-20303244656d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:01:09.387934 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-5b06013e-b8aa-4fe9-bca9-20303244656d admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059148 Nov 02 23:01:09.388444 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 20/39] 10.222.0.41 () {60 vars in 1190 bytes} [Tue Nov 2 23:01:09 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 23:01:09.398076 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-3d27001f-6874-4f1f-88d2-9d2653232fa0 admin admin] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:09.418075 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-3d27001f-6874-4f1f-88d2-9d2653232fa0 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023410 Nov 02 23:01:09.418759 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 20/40] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Nov 2 23:01:09 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:01:09.430210 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-f1c210ce-2597-43ea-9342-6f28dd093353 admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:09.452389 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-f1c210ce-2597-43ea-9342-6f28dd093353 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025900 Nov 02 23:01:09.453030 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 21/41] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Nov 2 23:01:09 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:01:09.463931 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-36c5154e-8b65-46da-b446-6183c6ed86aa admin admin] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:09.470101 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.wsgi [None req-36c5154e-8b65-46da-b446-6183c6ed86aa admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 23:01:09.470657 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-36c5154e-8b65-46da-b446-6183c6ed86aa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:01:09.471478 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-36c5154e-8b65-46da-b446-6183c6ed86aa admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011682 Nov 02 23:01:09.472085 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 21/42] 10.222.0.41 () {60 vars in 1190 bytes} [Tue Nov 2 23:01:09 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 23:01:10.932941 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-f1c210ce-2597-43ea-9342-6f28dd093353 admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:10.933935 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-f1c210ce-2597-43ea-9342-6f28dd093353 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Nov 02 23:01:10.934331 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 22/43] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 2 23:01:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:01:11.135830 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-2b88f9d0-761c-4dc3-bc4a-89d587ffcde3 admin admin] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:11.141778 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.wsgi [None req-2b88f9d0-761c-4dc3-bc4a-89d587ffcde3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 23:01:11.142347 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-2b88f9d0-761c-4dc3-bc4a-89d587ffcde3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:01:11.143172 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-2b88f9d0-761c-4dc3-bc4a-89d587ffcde3 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.065938 Nov 02 23:01:11.143707 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 22/44] 10.222.0.41 () {60 vars in 1190 bytes} [Tue Nov 2 23:01:11 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 23:01:11.153662 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-a38a13f8-5005-44e3-b6c8-1860d68e85fc admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:11.170411 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-a38a13f8-5005-44e3-b6c8-1860d68e85fc admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020271 Nov 02 23:01:11.170990 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 23/45] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Nov 2 23:01:11 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:01:11.181217 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-11505a1d-31c7-47df-9c43-8a8ff8c08bd0 admin admin] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:11.196164 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-11505a1d-31c7-47df-9c43-8a8ff8c08bd0 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018389 Nov 02 23:01:11.196714 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 23/46] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Nov 2 23:01:11 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:01:11.207876 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-1e8e63f6-0c88-47da-bb4a-3a24d318e4eb admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:11.214253 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.wsgi [None req-1e8e63f6-0c88-47da-bb4a-3a24d318e4eb admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 23:01:11.214984 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-1e8e63f6-0c88-47da-bb4a-3a24d318e4eb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:01:11.216235 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-1e8e63f6-0c88-47da-bb4a-3a24d318e4eb admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012337 Nov 02 23:01:11.217048 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 24/47] 10.222.0.41 () {60 vars in 1190 bytes} [Tue Nov 2 23:01:11 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 23:01:12.699903 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-11505a1d-31c7-47df-9c43-8a8ff8c08bd0 admin admin] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:12.700903 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-11505a1d-31c7-47df-9c43-8a8ff8c08bd0 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Nov 02 23:01:12.701300 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 24/48] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 2 23:01:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:01:12.900065 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-e3ca225a-088e-45d5-8c28-fd455e9541e7 admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:12.906591 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.wsgi [None req-e3ca225a-088e-45d5-8c28-fd455e9541e7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 23:01:12.907128 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-e3ca225a-088e-45d5-8c28-fd455e9541e7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:01:12.907955 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-e3ca225a-088e-45d5-8c28-fd455e9541e7 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.066249 Nov 02 23:01:12.908522 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 25/49] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Nov 2 23:01:12 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 23:01:12.919084 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-5dfa5ec3-4e00-4b00-abed-22af543572ef admin admin] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:12.933305 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-5dfa5ec3-4e00-4b00-abed-22af543572ef admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017701 Nov 02 23:01:12.933849 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 25/50] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Nov 2 23:01:12 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:01:12.944705 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-2a253105-976b-4c1f-a091-558ec065e9ac admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:12.960045 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-2a253105-976b-4c1f-a091-558ec065e9ac admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018775 Nov 02 23:01:12.960623 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 26/51] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Nov 2 23:01:12 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:01:12.971517 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-a20ff83b-9493-4cca-a839-e4b5aa6ae118 admin admin] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:12.976711 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.wsgi [None req-a20ff83b-9493-4cca-a839-e4b5aa6ae118 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 23:01:12.977261 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-a20ff83b-9493-4cca-a839-e4b5aa6ae118 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:01:12.978024 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-a20ff83b-9493-4cca-a839-e4b5aa6ae118 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010182 Nov 02 23:01:12.978515 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 26/52] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Nov 2 23:01:12 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 23:01:14.417838 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-2a253105-976b-4c1f-a091-558ec065e9ac admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:14.418862 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-2a253105-976b-4c1f-a091-558ec065e9ac admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Nov 02 23:01:14.419294 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 27/53] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 2 23:01:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:01:14.611780 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-97fa413c-0b0d-40ea-b58c-efedb21884d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:01:14.630501 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-97fa413c-0b0d-40ea-b58c-efedb21884d9 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.072010 Nov 02 23:01:14.631241 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 27/54] 10.222.0.41 () {64 vars in 1235 bytes} [Tue Nov 2 23:01:14 2021] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:01:16.065048 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-2a253105-976b-4c1f-a091-558ec065e9ac admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:16.066045 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-2a253105-976b-4c1f-a091-558ec065e9ac admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Nov 02 23:01:16.066440 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 28/55] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 2 23:01:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:01:16.259417 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-112a56e7-3b19-4776-a768-34ea6270ab9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:01:16.277970 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-112a56e7-3b19-4776-a768-34ea6270ab9f admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.071382 Nov 02 23:01:16.278478 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 28/56] 10.222.0.41 () {64 vars in 1235 bytes} [Tue Nov 2 23:01:16 2021] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:01:17.690037 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-2a253105-976b-4c1f-a091-558ec065e9ac admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:17.691084 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-2a253105-976b-4c1f-a091-558ec065e9ac admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Nov 02 23:01:17.691517 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 29/57] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 2 23:01:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:01:17.889186 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-bcdb77d4-05cf-4597-967d-459f5d5bad9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:01:17.908358 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-bcdb77d4-05cf-4597-967d-459f5d5bad9f admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.073111 Nov 02 23:01:17.908832 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 29/58] 10.222.0.41 () {64 vars in 1235 bytes} [Tue Nov 2 23:01:17 2021] POST /compute/v2.1/flavors => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:01:19.379252 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-2a253105-976b-4c1f-a091-558ec065e9ac admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:19.380428 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-2a253105-976b-4c1f-a091-558ec065e9ac admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Nov 02 23:01:19.380887 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 30/59] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 2 23:01:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:01:19.593024 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-d9c49067-e414-495d-b08a-bc196664724b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:01:19.623382 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-d9c49067-e414-495d-b08a-bc196664724b admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.081707 Nov 02 23:01:19.623997 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 30/60] 10.222.0.41 () {64 vars in 1235 bytes} [Tue Nov 2 23:01:19 2021] POST /compute/v2.1/flavors => generated 409 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:01:21.046716 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-2a253105-976b-4c1f-a091-558ec065e9ac admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:21.048299 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-2a253105-976b-4c1f-a091-558ec065e9ac admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002004 Nov 02 23:01:21.048867 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 31/61] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 2 23:01:21 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:01:21.240463 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-37ab8153-fe70-4826-8ed4-35327c0fdc6e admin admin] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:21.259375 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-37ab8153-fe70-4826-8ed4-35327c0fdc6e admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072386 Nov 02 23:01:21.259849 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 31/62] 10.222.0.41 () {60 vars in 1202 bytes} [Tue Nov 2 23:01:21 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:02:08.719356 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-2a253105-976b-4c1f-a091-558ec065e9ac admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:02:08.720355 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-2a253105-976b-4c1f-a091-558ec065e9ac admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Nov 02 23:02:08.720752 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 32/63] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 2 23:02:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:02:08.779332 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-edcdcb34-b115-44c1-b632-9e1226a16309 admin admin] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:02:08.798592 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-edcdcb34-b115-44c1-b632-9e1226a16309 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071105 Nov 02 23:02:08.799156 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 32/64] 10.222.0.41 () {60 vars in 1291 bytes} [Tue Nov 2 23:02:08 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:02:08.820959 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-4317dcd0-4d4e-4842-8057-c3f9785768a0 admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:02:08.828898 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-4317dcd0-4d4e-4842-8057-c3f9785768a0 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011467 Nov 02 23:02:08.829407 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 33/65] 10.222.0.41 () {60 vars in 1282 bytes} [Tue Nov 2 23:02:08 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:02:08.841174 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-35a10757-b50e-41f2-aaa3-23fdb93c666f admin admin] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:02:08.849137 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-35a10757-b50e-41f2-aaa3-23fdb93c666f admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011415 Nov 02 23:02:08.849639 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 33/66] 10.222.0.41 () {60 vars in 1285 bytes} [Tue Nov 2 23:02:08 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:02:08.861041 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-71ffdd73-4563-4f6b-b303-aae34e4eee37 admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:02:08.868275 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-71ffdd73-4563-4f6b-b303-aae34e4eee37 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010577 Nov 02 23:02:08.868779 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 34/67] 10.222.0.41 () {60 vars in 1285 bytes} [Tue Nov 2 23:02:08 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:02:08.880197 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-fdaa562c-1e6e-4bc6-8686-91ec56819a08 admin admin] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:02:08.887691 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-fdaa562c-1e6e-4bc6-8686-91ec56819a08 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010884 Nov 02 23:02:08.888205 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 34/68] 10.222.0.41 () {60 vars in 1282 bytes} [Tue Nov 2 23:02:08 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:03:38.124739 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-ecb77ca9-3cbd-4631-9a54-47c294b0af6f tempest-verify_tempest_config-1438863459 tempest-verify_tempest_config-1438863459-project] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:03:38.126730 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-ecb77ca9-3cbd-4631-9a54-47c294b0af6f tempest-verify_tempest_config-1438863459 tempest-verify_tempest_config-1438863459-project] 10.222.0.41 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.103957 Nov 02 23:03:38.127289 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 35/69] 10.222.0.41 () {58 vars in 1133 bytes} [Tue Nov 2 23:03:38 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:05:14.220906 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-fdaa562c-1e6e-4bc6-8686-91ec56819a08 admin admin] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:05:14.221905 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-fdaa562c-1e6e-4bc6-8686-91ec56819a08 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Nov 02 23:05:14.222323 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 35/70] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 2 23:05:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:05:14.490791 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-f4d9e6cb-38e2-4b70-aa69-e8761eee8ee0 admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:05:14.492080 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:05:14.492080 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: warnings.warn(msg) Nov 02 23:05:14.493722 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_concurrency.lockutils [None req-f4d9e6cb-38e2-4b70-aa69-e8761eee8ee0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:05:14.494198 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_concurrency.lockutils [None req-f4d9e6cb-38e2-4b70-aa69-e8761eee8ee0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:05:14.495074 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_concurrency.lockutils [None req-f4d9e6cb-38e2-4b70-aa69-e8761eee8ee0 admin admin] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:05:14.495544 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_concurrency.lockutils [None req-f4d9e6cb-38e2-4b70-aa69-e8761eee8ee0 admin admin] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:05:14.531716 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-f4d9e6cb-38e2-4b70-aa69-e8761eee8ee0 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.162971 Nov 02 23:05:14.532336 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 36/71] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Nov 2 23:05:14 2021] GET /compute/v2.1/os-services => generated 791 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:05:15.967263 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-fdaa562c-1e6e-4bc6-8686-91ec56819a08 admin admin] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:05:15.968255 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-fdaa562c-1e6e-4bc6-8686-91ec56819a08 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Nov 02 23:05:15.968651 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 36/72] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 2 23:05:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:05:16.160641 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-29a3d3ca-5b5e-4edf-9382-c670463b02e9 admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:05:16.161780 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:05:16.161780 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: warnings.warn(msg) Nov 02 23:05:16.163420 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_concurrency.lockutils [None req-29a3d3ca-5b5e-4edf-9382-c670463b02e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:05:16.163846 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_concurrency.lockutils [None req-29a3d3ca-5b5e-4edf-9382-c670463b02e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:05:16.164621 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_concurrency.lockutils [None req-29a3d3ca-5b5e-4edf-9382-c670463b02e9 admin admin] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:05:16.165035 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_concurrency.lockutils [None req-29a3d3ca-5b5e-4edf-9382-c670463b02e9 admin admin] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:05:16.183668 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-29a3d3ca-5b5e-4edf-9382-c670463b02e9 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073045 Nov 02 23:05:16.184145 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 37/73] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Nov 2 23:05:16 2021] GET /compute/v2.1/os-services => generated 791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:05:28.047759 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-fdaa562c-1e6e-4bc6-8686-91ec56819a08 admin admin] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:05:28.048757 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-fdaa562c-1e6e-4bc6-8686-91ec56819a08 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Nov 02 23:05:28.049160 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 37/74] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 2 23:05:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:05:28.246147 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-6242f2fa-4e4a-4125-8bab-8f50723ce153 admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:05:28.247391 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:05:28.247391 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: warnings.warn(msg) Nov 02 23:05:28.248898 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_concurrency.lockutils [None req-6242f2fa-4e4a-4125-8bab-8f50723ce153 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:05:28.249333 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_concurrency.lockutils [None req-6242f2fa-4e4a-4125-8bab-8f50723ce153 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:05:28.250114 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_concurrency.lockutils [None req-6242f2fa-4e4a-4125-8bab-8f50723ce153 admin admin] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:05:28.250567 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_concurrency.lockutils [None req-6242f2fa-4e4a-4125-8bab-8f50723ce153 admin admin] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:05:28.275816 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-6242f2fa-4e4a-4125-8bab-8f50723ce153 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084039 Nov 02 23:05:28.276296 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 38/75] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Nov 2 23:05:28 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:05:29.707193 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: DEBUG nova.api.openstack.wsgi [None req-fdaa562c-1e6e-4bc6-8686-91ec56819a08 admin admin] Calling method '>' {{(pid=100821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:05:29.708434 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: INFO nova.api.openstack.requestlog [None req-fdaa562c-1e6e-4bc6-8686-91ec56819a08 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Nov 02 23:05:29.708831 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: [pid: 100821|app: 0|req: 38/76] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 2 23:05:29 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:05:29.905755 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG nova.api.openstack.wsgi [None req-eb5c7077-6e16-48f3-af41-822b956ee50e admin admin] Calling method '>' {{(pid=100822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:05:29.907021 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:05:29.907021 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: warnings.warn(msg) Nov 02 23:05:29.909610 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_concurrency.lockutils [None req-eb5c7077-6e16-48f3-af41-822b956ee50e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:05:29.910340 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_concurrency.lockutils [None req-eb5c7077-6e16-48f3-af41-822b956ee50e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:05:29.911832 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_concurrency.lockutils [None req-eb5c7077-6e16-48f3-af41-822b956ee50e admin admin] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:05:29.912376 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: DEBUG oslo_concurrency.lockutils [None req-eb5c7077-6e16-48f3-af41-822b956ee50e admin admin] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:05:29.935908 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: INFO nova.api.openstack.requestlog [None req-eb5c7077-6e16-48f3-af41-822b956ee50e admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082233 Nov 02 23:05:29.936400 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: [pid: 100822|app: 0|req: 39/77] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Nov 2 23:05:29 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:06:29.474224 dv-cinder-815848-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 02 23:06:29.474796 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: Tue Nov 2 23:06:29 2021 - graceful shutdown triggered... Nov 02 23:06:29.475257 dv-cinder-815848-3-iscsi devstack@n-api.service[100821]: Gracefully killing worker 1 (pid: 100821)... Nov 02 23:06:29.475612 dv-cinder-815848-3-iscsi devstack@n-api.service[100822]: Gracefully killing worker 2 (pid: 100822)... Nov 02 23:06:30.475934 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: worker 1 buried after 1 seconds Nov 02 23:06:30.476475 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: worker 2 buried after 1 seconds Nov 02 23:06:30.476475 dv-cinder-815848-3-iscsi devstack@n-api.service[100820]: goodbye to uWSGI. Nov 02 23:06:30.477485 dv-cinder-815848-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 02 23:06:30.478059 dv-cinder-815848-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 02 23:06:30.480919 dv-cinder-815848-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 23:06:30.489982 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 23:06:30.492617 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 2 23:06:30 2021] *** Nov 02 23:06:30.492802 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 23:06:30.492945 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 23:06:30.493082 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: nodename: dv-cinder-815848-3-iscsi Nov 02 23:06:30.493082 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: machine: x86_64 Nov 02 23:06:30.493082 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: clock source: unix Nov 02 23:06:30.493082 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: pcre jit disabled Nov 02 23:06:30.493082 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: detected number of CPU cores: 4 Nov 02 23:06:30.493082 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: current working directory: / Nov 02 23:06:30.493082 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: detected binary path: /usr/bin/uwsgi-core Nov 02 23:06:30.493082 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: your processes number limit is 47680 Nov 02 23:06:30.493082 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: your memory page size is 4096 bytes Nov 02 23:06:30.493082 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: detected max file descriptor number: 2048 Nov 02 23:06:30.493766 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: lock engine: pthread robust mutexes Nov 02 23:06:30.493766 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: thunder lock: enabled Nov 02 23:06:30.493766 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 23:06:30.493766 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 02 23:06:30.539433 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: Python main interpreter initialized at 0x5621fe04f9c0 Nov 02 23:06:30.539433 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: python threads support enabled Nov 02 23:06:30.539433 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: your server socket listen backlog is limited to 100 connections Nov 02 23:06:30.539433 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: your mercy for graceful operations on workers is 90 seconds Nov 02 23:06:30.539916 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 23:06:30.539916 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: *** Operational MODE: preforking *** Nov 02 23:06:30.540182 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: *** uWSGI is running in multiple interpreter mode *** Nov 02 23:06:30.540182 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: spawned uWSGI master process (pid: 115784) Nov 02 23:06:30.540366 dv-cinder-815848-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 02 23:06:30.543399 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: spawned uWSGI worker 1 (pid: 115799, cores: 1) Nov 02 23:06:30.543753 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: spawned uWSGI worker 2 (pid: 115800, cores: 1) Nov 02 23:06:30.544016 dv-cinder-815848-3-iscsi devstack@n-api.service[115784]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 23:06:32.369286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 23:06:32.369286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: from cryptography.utils import int_from_bytes Nov 02 23:06:32.370004 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 23:06:32.370004 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: from cryptography.utils import int_from_bytes Nov 02 23:06:32.370448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 23:06:32.370448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: from cryptography.utils import int_from_bytes Nov 02 23:06:32.370573 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 23:06:32.370573 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: from cryptography.utils import int_from_bytes Nov 02 23:06:34.918767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 23:06:34.919350 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 23:06:34.919571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 23:06:34.919889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 23:06:34.920151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 23:06:34.920546 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 23:06:34.920940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.921022 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 23:06:34.921107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.921190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.921265 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 23:06:34.921513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.921625 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 23:06:34.921854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.921961 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 23:06:34.922174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.922281 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.922506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.922614 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.922839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.923043 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.923203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.923298 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.923470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.923582 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.923795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.923901 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.924130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815848-3-iscsi {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.924226 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.924458 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.924563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.924772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.924891 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.925041 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.925139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.925359 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.925473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.925689 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815848-3-iscsi {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.925787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.926015 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.926184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.926341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.926489 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.926642 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.926819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.927007 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.927263 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.927591 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.927900 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.928367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.928595 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.928857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.929076 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.929282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.929497 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.929497 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.929908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.930126 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.930349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.930556 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.930761 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.930977 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.931208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.931421 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.931637 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.931867 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.932079 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.932290 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.932505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.932720 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.932923 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815848-3-iscsi {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.933157 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815848-3-iscsi {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.933340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.933555 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.933717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.933903 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.934044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.934409 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.934563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.934721 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.934900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.935094 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.935248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.935398 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.935547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.935715 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.935874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.936028 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.936169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.936350 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.936496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.936653 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.937514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.937683 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.937830 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.937980 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.938137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.938280 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.938427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.938568 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.938727 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.938876 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.939186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.939339 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.939481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.939620 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.939775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.939926 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.940077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.940218 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.940369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.940517 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.940677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.940819 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.940973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.941114 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.941262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.941412 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.941553 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.941775 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.941922 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.942073 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.942225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.942380 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.942534 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.942683 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.942833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.943007 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.943155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.943305 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.943468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.943620 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.943771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.943913 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.944054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.944210 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.944365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.944513 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.944660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.944810 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.944958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.945112 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.945253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.945400 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.945552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.946194 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.946338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.946494 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.946651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.946802 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.946984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.947723 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.947876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.948027 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.948170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.948323 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.948465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.948605 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.948754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.948908 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.949068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.949343 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.949509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.949653 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.949803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.949945 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.950093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.950242 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.950403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.950661 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.950840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.951005 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.951158 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.951320 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.951471 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.951618 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.951773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.951920 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.952060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.952207 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.952434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.952611 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.952768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.952917 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.953063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.953209 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.953360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.953519 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.953673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.953815 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.953962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.954110 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.954110 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.954384 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.954526 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.954665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.954811 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.954980 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.955138 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.955306 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.955455 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.955597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.955753 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.956397 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.956549 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.956710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.956860 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.957000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.957899 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.958061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.958219 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.958387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.958627 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.958782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.959007 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.959167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.959343 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.959566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.959719 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.959869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.960017 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.960165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.960318 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.960465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.960616 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.960775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.960918 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.961071 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.961219 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.961989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.962142 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.962282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.962431 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.962578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.962733 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.962898 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.963982 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.964142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.964299 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.964460 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.964611 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.964754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.964894 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.965043 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.965195 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.965346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.965488 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.965634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.965783 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.965924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.966082 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.966235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.966376 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.966516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.966657 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.966803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.966964 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.967125 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.967269 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.967409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.968111 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.968265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.968426 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.968588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.968845 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.968991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.969132 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.969284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.969438 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.969597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.969827 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.969974 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.970115 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.970266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.970416 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.970556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.970708 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.970849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.971062 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.971222 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.971373 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.971523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.971664 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.971804 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 23:06:34.971945 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.972095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.972238 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.972379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.972530 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.972690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.972852 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.973002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.973154 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.973297 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.973442 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.973589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.973743 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.973893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.974034 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.974175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.974315 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.974468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.974618 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.974760 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.974900 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.975079 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.975222 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.975376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.975519 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.975659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.975806 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.975947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.976087 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.976254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.976396 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.976552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.976703 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.976852 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.976995 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.977145 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.977296 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.977437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.977586 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.978438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.978602 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.978760 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.979070 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.979232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.979393 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.979629 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.979800 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.980033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.980194 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.980345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.980488 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.980636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.980781 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.980922 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.981075 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.981229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.981371 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.981525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.981668 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.981823 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.981966 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.982113 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.982254 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.982394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.982541 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.982693 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.982844 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.983045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.983202 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.983351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.983493 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.983655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.983808 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.983952 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.984103 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.984245 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.984386 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.984539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.984681 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.984821 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.984981 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.985123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.985278 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.985420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.985568 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.985716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.985858 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.985999 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.986147 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.986296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.986438 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.986585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.986734 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.986892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.987074 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.987218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.987366 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.987516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.987665 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.987806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.988406 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.988567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.988811 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.988959 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.989199 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.989357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.989517 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.989668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.989820 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.989970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.990206 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.990364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.990514 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.990656 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.990804 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.990965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.991121 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.991276 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.991440 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.991582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.991723 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.991873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.992015 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.992169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.992312 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.992453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.992594 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.992742 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.992893 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.993035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.993183 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.993336 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.993485 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.993633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.993830 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.993973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.994114 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.994262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.994406 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.994552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.994707 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.994848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.995057 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.995211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.995371 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.998620 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.998830 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.999106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.999378 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.999533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.999695 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:34.999852 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.000011 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.000156 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.000407 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.000561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.000713 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.000884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.001037 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.001186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.001335 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.001485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.001629 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.001780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.001921 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.002063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.002211 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.002353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.002500 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.002663 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.002818 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.002978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.003127 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.003127 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.003416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.003565 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.003716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.003865 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.004007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.004007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.004365 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.004365 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.004655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.004655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.004932 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.005074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.005225 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.005225 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.005500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.005641 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.005788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.005937 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.006092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.006241 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.006383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.006541 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.006683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.006838 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.007003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.007146 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.007286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.007436 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.007578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.007727 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.007876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.008124 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.009651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.009815 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.009979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.010133 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.010355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.010602 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.010749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.011038 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.011202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.011358 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.011501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.011649 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.011800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.011941 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.012127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.012304 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.012455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.012603 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.012745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.012892 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.013159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.013317 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.013466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.013622 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.013767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.013915 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.014070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.014219 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.014379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.014528 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.014668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.014819 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.014990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.015146 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.015295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.015462 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.017311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.017490 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.017651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.018311 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.018480 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.018668 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.018839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.019398 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.019579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.019921 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.020072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.020216 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.020356 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.020511 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.020754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.020909 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.021052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.021209 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.021357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.021508 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.021652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.021801 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.021950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.022101 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.022243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.022393 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.022542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.022692 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.022833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.023023 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.023193 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.023337 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.023487 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.023634 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.023787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.024535 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.024688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.024839 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.024991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.025133 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.025274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.025414 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.025563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.025724 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.025867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.026007 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.026146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.026287 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.026436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.026586 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.026734 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.026883 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.027063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.027215 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.027357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.027505 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.027657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.027805 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.027948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.028102 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.028261 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.028481 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.028635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.028777 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.028924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.029092 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.029612 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.029763 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.030121 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.030281 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.030441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.030598 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.030768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.031003 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.031165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.031321 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.031464 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.031619 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.031761 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.031918 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.032068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.032229 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.032384 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.032527 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.032678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.032827 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.032976 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.033118 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.033269 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.033419 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.033569 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.033717 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.033860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.034001 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.034161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.034312 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.034454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.034601 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.034747 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.034888 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.035121 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.035273 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.035423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.035579 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.035722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.035872 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.036031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.036727 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.036889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.037164 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.037334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.037490 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.037641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.037791 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.037939 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.038089 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.038231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.038231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.038614 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.038782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.038952 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.039101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.039243 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.039795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.039955 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.040116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.040363 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.040527 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.040703 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.040965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.041211 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.041364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.041528 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.041677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.041834 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.041990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.042146 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.042300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.042448 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.042603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.042759 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.042991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.043162 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.043600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.043764 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.043935 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.044099 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.044255 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.044412 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.044584 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.044786 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.044947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.045097 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.045244 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.045398 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.045546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.045700 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.045873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.046030 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.046184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.046333 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.046479 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.046625 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.046784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.046952 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.047106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.047264 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.047420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.047568 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.047799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.047971 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.048132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.048286 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.048441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.048613 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.048851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.049018 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.049167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.049321 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.049488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.050017 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.050189 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.050541 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.050716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.051619 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.051782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.051944 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.052104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.052253 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.052408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.052648 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.052815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.052972 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.053131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.053281 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.053427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.053585 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.053585 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.053885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.053885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.053885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.053885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.053885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.054573 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.054732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.054888 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.055090 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.055479 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.055655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.055811 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.055968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.056117 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.056263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.056416 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.056571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.056726 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.056887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.057035 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.057188 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.057337 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.057482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.057647 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.057807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.057955 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.058102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.058255 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.058403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.058563 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.058717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.058891 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.059131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.059296 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.059453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.059610 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.060142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.060307 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.060456 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.060630 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.060868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.061031 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.061188 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.061360 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.061606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.061853 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.062005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.062167 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.062323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.062323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.062323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.062751 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.062910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.063119 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.063269 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.063416 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.063563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.063717 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.063882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.064038 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.064186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.064340 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.064496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.064652 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.064808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.064964 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.065119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.065266 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.065420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.065568 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.065728 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.065876 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.066022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.066167 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.066331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.066488 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.066642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.066791 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.066955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.067110 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.067271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.067433 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.067588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.067742 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.067890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.068037 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.068191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.068357 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.068505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.068652 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.068799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.068799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.069085 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.069342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.069520 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.069735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.069898 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.070441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.070610 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.071411 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.071607 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.071858 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.072112 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.072112 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.072416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.072572 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.072720 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.072874 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.073023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.073170 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.073326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.073474 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.073621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.073789 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.073945 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.074095 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.074262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.074413 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.074568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.074715 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.074869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.075098 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.075251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.075398 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.075543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.075700 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.075846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.076006 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.076154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.076310 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.076465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.076612 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.076757 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.076916 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.077071 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.077219 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.077364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.077510 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.077667 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.077885 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.078035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.078181 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.078335 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.078557 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.078723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.078883 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.079066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.079590 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.079750 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.079906 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.080069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.080730 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.080890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.081040 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.081267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.081446 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.081707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.081878 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.082389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.082548 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.082809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.083058 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.083227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.083412 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.083589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.083747 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.083958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.084122 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.084291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.084449 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.084647 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.084797 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.084948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.085120 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.085276 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.085425 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.085572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.085572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.085572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.086099 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.086279 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.087620 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.087798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.087959 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.088115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.088279 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.088436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.089280 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.089470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.090121 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.090786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.090786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.091215 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.091401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.091563 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.093194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.093379 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.093535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.093683 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.093839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.094009 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.094634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.094794 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.094972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.095130 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.095288 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.095444 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.095607 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.095763 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.095912 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.096060 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.096223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.096371 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.096930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.097102 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.097253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.097401 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.097556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.097706 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.097863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.098020 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.098177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.098325 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.098484 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.098891 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.099703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.100071 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.100242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.100422 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.101717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.101914 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.102111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.102281 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.102462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.102614 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.102768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.102946 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.103128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.103620 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.103779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.103927 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.104115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.104281 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.104444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.104618 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.104789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.104989 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.105151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.105308 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.105456 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.105626 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.105775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.105931 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.106087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.106269 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.106428 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.106586 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.106735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.106881 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.107054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.107213 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.107375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.107547 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.107697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.107697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.107697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.107697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.107697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.107697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.107697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.107697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.108890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.109040 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.109203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.109351 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.109516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.109516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.109814 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.109979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.109979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.111353 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.111530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.111682 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.111839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.111839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.112139 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.112288 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.112434 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.112832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.113003 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.113148 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.113243 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.113335 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.113335 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.113843 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.113953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.114212 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.114360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.114360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.114360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.114360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.114360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.114360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.114360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.114360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.115213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.115345 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.115435 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.115526 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.115616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.115739 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.115830 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.115830 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.115992 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.116081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.116171 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.116263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.116263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.116263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.116547 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.116631 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.116713 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.116795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.116795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.116955 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.117038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.117120 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.117211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.117295 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.117387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.117471 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.118068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.118163 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.118246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.118335 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.118470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.118628 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.118717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.118807 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.118890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.119008 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.119095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.119177 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.119266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.119357 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.119440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.119530 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.119614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.119614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.119614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.119845 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.119934 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.120030 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.120114 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.120114 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.120289 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.120379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.120463 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.120572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.120663 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.120754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.120843 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.120926 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.120926 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.121444 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.121540 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.121624 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.121706 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.121788 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.121883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.121883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.122043 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.122043 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.122244 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.122387 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.122529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.122529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.122778 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.122903 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.123073 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.123213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.123351 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.123488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.123583 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.123740 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.123883 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.123979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.124065 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.124155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.124239 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.124321 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.124411 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.124503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.124596 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.124687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.124769 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.124857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.124950 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.125044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.125135 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.125218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.125300 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.125381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.125381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.125551 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.125551 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.125551 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.125775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.125775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.125932 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.126023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.126106 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.126331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.126433 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.126519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.126620 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.126752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.126847 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.126947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.127044 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.127135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.127233 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.127324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.127415 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.127505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.127589 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.127720 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.127856 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.127991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.128126 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.128261 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.128349 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.128445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.128530 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.128611 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.128693 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.128822 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.128910 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.129005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.129089 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.129246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.129339 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.129423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.129423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.129423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.129423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.129423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.129818 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.129902 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.129999 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.130083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.130171 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.130303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.130398 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.130482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.130640 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.130732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.130822 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.130912 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.131049 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.131142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.131250 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.131619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.131720 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.131812 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.131903 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.131998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.132090 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.132181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.132264 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.132353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.132443 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.132522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.132593 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.132662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.132737 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.132867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.132995 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.133133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.133822 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.133969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.134099 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.134232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.134232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.134487 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.134623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.134750 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.134878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.135037 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.135174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.135309 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.135436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.135563 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.135695 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.135829 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.135950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.136085 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.136212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.136353 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.136561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.136675 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.136874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.136999 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.137111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.137241 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.137372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.137512 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.137631 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.137747 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.137856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.137971 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.138090 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.138208 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.138319 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.138434 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.138434 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.138649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.138772 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.138883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.139189 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.139311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.139421 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.139532 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.139651 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.139762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.139877 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.139987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.140095 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.140211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.140335 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.140454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.140454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.140713 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.140842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.140982 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.141111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.141111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.141111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.141793 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.141926 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.142071 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.142208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.142337 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.142465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.142592 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.142727 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.142864 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.143021 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.143141 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.143258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.143375 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.143493 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.143613 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.143731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.143842 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.143951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.144067 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.144186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.144306 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.144417 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.144546 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.144681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.144816 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.144958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.144958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.145118 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.145202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.145292 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.145383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.145475 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.145559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.145640 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.145722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.145804 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.145894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.145977 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.145977 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.145977 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.146201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.146283 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.146380 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.146464 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.146562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.146648 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.146738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.146828 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.146980 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.147107 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.147218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.147338 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.147533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.147647 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.147769 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.147887 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.148004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.148114 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.148114 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.148326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.148326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.148569 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.148666 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.148780 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.148868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.148949 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.149020 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.149088 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.149088 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.149218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.149308 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.149466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.149551 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.149633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.149715 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.149802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.149892 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.149987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.150070 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.150152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.150234 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.150315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.150420 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.150506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.150589 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.150747 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.150840 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.150939 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.151043 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.151129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.151218 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.151301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.151382 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.151470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.151915 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.152024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.152118 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.152118 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.152277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.152361 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.152452 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.152536 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.152646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.152790 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.152879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.152971 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.153102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.153231 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.153365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.153499 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.153626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.153762 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.153891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.153978 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.154067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.154151 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.154232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.154328 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.154492 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.154578 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.154657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.154785 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.154880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.155042 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.155138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.155230 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.155321 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.155413 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.155413 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.155582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.155582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.155732 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.155732 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.155882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.155973 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.156063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.156153 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.156237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.156327 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.156410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.156501 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.156633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.156633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.156633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.156855 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.156948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.157031 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.157121 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.157204 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.157286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.157368 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.157530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.157530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.157692 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.157777 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.157859 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.157997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.158093 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.158177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.158259 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.158340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.158421 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.158510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.158602 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.158731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.158823 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.158905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.159080 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.159175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.159266 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.159350 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.159432 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.159521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.159605 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.159701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.159810 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.159947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.160129 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.160282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.160450 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.160614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.160770 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.160941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.161071 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.161254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.161381 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.161589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.161683 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.162033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.162144 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.162239 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.162339 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.162531 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.162656 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.162851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.163017 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.163200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.163346 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.163521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.163665 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.163859 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.163986 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.164195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.164295 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.164539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.164641 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.164876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.164968 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.165206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.165297 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.165534 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.165632 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.165860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.165951 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.166181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.166314 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.166521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.166687 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.166842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.167007 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.167197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.167289 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.167518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.167616 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.167844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.167946 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.168172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.168264 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.168497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.168588 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.168831 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.168931 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.169163 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.169253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.169494 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.169584 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.169831 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.169935 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.170165 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.170262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.170498 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.170594 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.170816 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.171002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.171203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.171309 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.171451 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 23:06:35.171547 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.171850 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.172186 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.172507 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.172839 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.173160 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.173488 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.173805 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.174135 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.174465 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.174789 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.175136 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.175478 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.175794 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.176113 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.176438 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.176756 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.177075 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.177394 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.177728 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.178059 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.178373 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.178719 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.179058 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.179383 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.179780 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.180525 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.180873 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.181192 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.181513 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.181831 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.182152 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.182479 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.182798 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.183158 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.183490 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.183821 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.184154 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.184508 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.184828 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.185182 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.185518 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 23:06:35.185765 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 23:06:35.194312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_db.sqlalchemy.engines [None req-86e0a8b8-7330-46a7-935d-a945fac1bc0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 23:06:35.210220 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_db.sqlalchemy.engines [None req-0fab46ea-d417-4064-a16b-509cfefa24e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115799) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 23:06:35.274597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.context [None req-86e0a8b8-7330-46a7-935d-a945fac1bc0c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cf0116f-06d0-4573-b34b-f5af4d2eb5ed(cell1) {{(pid=115800) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 23:06:35.279105 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86e0a8b8-7330-46a7-935d-a945fac1bc0c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:06:35.280696 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86e0a8b8-7330-46a7-935d-a945fac1bc0c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:06:35.281517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86e0a8b8-7330-46a7-935d-a945fac1bc0c None None] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:06:35.283513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86e0a8b8-7330-46a7-935d-a945fac1bc0c None None] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:06:35.289746 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.context [None req-0fab46ea-d417-4064-a16b-509cfefa24e4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cf0116f-06d0-4573-b34b-f5af4d2eb5ed(cell1) {{(pid=115799) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 23:06:35.294440 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0fab46ea-d417-4064-a16b-509cfefa24e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:06:35.294646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_db.sqlalchemy.engines [None req-86e0a8b8-7330-46a7-935d-a945fac1bc0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 23:06:35.295430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_db.sqlalchemy.engines [None req-86e0a8b8-7330-46a7-935d-a945fac1bc0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 23:06:35.296105 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0fab46ea-d417-4064-a16b-509cfefa24e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:06:35.296953 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0fab46ea-d417-4064-a16b-509cfefa24e4 None None] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:06:35.298986 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0fab46ea-d417-4064-a16b-509cfefa24e4 None None] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:06:35.310314 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_db.sqlalchemy.engines [None req-0fab46ea-d417-4064-a16b-509cfefa24e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115799) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 23:06:35.312058 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_db.sqlalchemy.engines [None req-0fab46ea-d417-4064-a16b-509cfefa24e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115799) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 23:06:35.559783 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_db.sqlalchemy.engines [None req-86e0a8b8-7330-46a7-935d-a945fac1bc0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 23:06:35.573732 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_db.sqlalchemy.engines [None req-0fab46ea-d417-4064-a16b-509cfefa24e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115799) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 23:06:35.887846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: WARNING keystonemiddleware.auth_token [None req-86e0a8b8-7330-46a7-935d-a945fac1bc0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 23:06:35.894502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: WARNING keystonemiddleware.auth_token [None req-86e0a8b8-7330-46a7-935d-a945fac1bc0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 23:06:35.906797 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: WARNING keystonemiddleware.auth_token [None req-0fab46ea-d417-4064-a16b-509cfefa24e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 23:06:35.913575 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: WARNING keystonemiddleware.auth_token [None req-0fab46ea-d417-4064-a16b-509cfefa24e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 23:06:36.247577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: WARNING keystonemiddleware.auth_token [None req-86e0a8b8-7330-46a7-935d-a945fac1bc0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 23:06:36.252925 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: WARNING keystonemiddleware.auth_token [None req-86e0a8b8-7330-46a7-935d-a945fac1bc0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 23:06:36.258642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5621fe04f9c0 pid: 115800 (default app) Nov 02 23:06:36.273588 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: WARNING keystonemiddleware.auth_token [None req-0fab46ea-d417-4064-a16b-509cfefa24e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 23:06:36.279099 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: WARNING keystonemiddleware.auth_token [None req-0fab46ea-d417-4064-a16b-509cfefa24e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 23:06:36.284537 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5621fe04f9c0 pid: 115799 (default app) Nov 02 23:07:10.841756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9aef5277-8d98-425e-aab2-6741dd1f7054 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Action: 'create', calling method: .version_select at 0x7fd8598569d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-500586994"}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:07:12.161627 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9aef5277-8d98-425e-aab2-6741dd1f7054 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.979044 Nov 02 23:07:12.170125 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1/1] 10.222.0.41 () {60 vars in 1154 bytes} [Tue Nov 2 23:07:09 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 2989 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 02 23:07:12.509791 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-9d8b4ad7-5c0f-4c86-979c-4cd1f5efd8bb tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd8598a55e0>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:13.218587 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-9d8b4ad7-5c0f-4c86-979c-4cd1f5efd8bb tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9" status: 200 len: 344 microversion: 2.1 time: 1.045565 Nov 02 23:07:13.219204 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 1/2] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:12 2021] GET /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9 => generated 344 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:13.872516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3e12364b-6c0b-41f8-9672-fe05ff53eb5a tempest-VolumesTestJSON-743612218 tempest-VolumesTestJSON-743612218-project] Calling method '.version_select at 0x7fd859723550>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:14.020741 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e811fe05-a9a0-462f-a003-16c3374ebb98 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1913111519", "imageRef": "4159c567-fd66-4bbb-9bf4-6ce0afd65d88", "flavorRef": "452", "networks": [{"uuid": "128b58a2-4c09-4b9f-a6ac-1ddc3088f8ac"}]}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:07:14.041694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3e12364b-6c0b-41f8-9672-fe05ff53eb5a tempest-VolumesTestJSON-743612218 tempest-VolumesTestJSON-743612218-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/2431a513-d29d-4e7f-ae8d-3051a0818435" status: 200 len: 350 microversion: 2.1 time: 0.175929 Nov 02 23:07:14.042469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2/3] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:13 2021] GET /compute/v2.1/os-volumes/2431a513-d29d-4e7f-ae8d-3051a0818435 => generated 350 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:14.325541 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.network.neutron [None req-e811fe05-a9a0-462f-a003-16c3374ebb98 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] validate_networks() for [('128b58a2-4c09-4b9f-a6ac-1ddc3088f8ac', None, None, None, None, None)] {{(pid=115799) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 23:07:14.932288 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-99df4633-dcf4-40a8-b1ae-dbd2d8df8a3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1039138352", "imageRef": "4159c567-fd66-4bbb-9bf4-6ce0afd65d88", "flavorRef": "452", "networks": [{"uuid": "a641b2e8-96fc-4d47-b974-970483d44042"}]}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:07:15.170383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.network.neutron [None req-99df4633-dcf4-40a8-b1ae-dbd2d8df8a3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] validate_networks() for [('a641b2e8-96fc-4d47-b974-970483d44042', None, None, None, None, None)] {{(pid=115800) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 23:07:16.415019 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-99df4633-dcf4-40a8-b1ae-dbd2d8df8a3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Flavor limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 23:07:16.416206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-99df4633-dcf4-40a8-b1ae-dbd2d8df8a3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Image limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 23:07:16.416841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-99df4633-dcf4-40a8-b1ae-dbd2d8df8a3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Flavor pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 23:07:16.417415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-99df4633-dcf4-40a8-b1ae-dbd2d8df8a3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Image pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 23:07:16.418201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-99df4633-dcf4-40a8-b1ae-dbd2d8df8a3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 23:07:16.434981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-99df4633-dcf4-40a8-b1ae-dbd2d8df8a3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:16.435638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-99df4633-dcf4-40a8-b1ae-dbd2d8df8a3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:16.436754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-99df4633-dcf4-40a8-b1ae-dbd2d8df8a3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:16.441407 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-99df4633-dcf4-40a8-b1ae-dbd2d8df8a3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:16.487861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-99df4633-dcf4-40a8-b1ae-dbd2d8df8a3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Getting quotas for project 0f70e69ec3db4f378ac856e1e93b45e5. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:07:16.510610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-99df4633-dcf4-40a8-b1ae-dbd2d8df8a3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Getting quotas for user 81a16c3887f94b4d825e21e2fe34e26b and project 0f70e69ec3db4f378ac856e1e93b45e5. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:07:16.537650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-99df4633-dcf4-40a8-b1ae-dbd2d8df8a3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Going to run 1 instances... {{(pid=115800) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 23:07:16.547380 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-99df4633-dcf4-40a8-b1ae-dbd2d8df8a3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4159c567-fd66-4bbb-9bf4-6ce0afd65d88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 23:07:16.698538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-99df4633-dcf4-40a8-b1ae-dbd2d8df8a3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.484938 Nov 02 23:07:16.699549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 3/4] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 2 23:07:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 2486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 23:07:16.709102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c2fbd3a1-9f2a-496a-a704-45b34554cbe7 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd859635d30>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:16.784627 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c2fbd3a1-9f2a-496a-a704-45b34554cbe7 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9" status: 200 len: 345 microversion: 2.1 time: 0.081947 Nov 02 23:07:16.785427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 4/5] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:16 2021] GET /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9 => generated 345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:16.791018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ecc42f02-a09a-407a-b07b-cd9299e88d99 tempest-VolumesTestJSON-743612218 tempest-VolumesTestJSON-743612218-project] Calling method '.version_select at 0x7fd859635dc0>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:16.871375 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-e811fe05-a9a0-462f-a003-16c3374ebb98 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Flavor limits 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 23:07:16.872445 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-e811fe05-a9a0-462f-a003-16c3374ebb98 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Image limits 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 23:07:16.873104 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-e811fe05-a9a0-462f-a003-16c3374ebb98 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Flavor pref 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 23:07:16.874209 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-e811fe05-a9a0-462f-a003-16c3374ebb98 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Image pref 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 23:07:16.874790 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-e811fe05-a9a0-462f-a003-16c3374ebb98 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 23:07:16.912296 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e811fe05-a9a0-462f-a003-16c3374ebb98 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:16.912664 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e811fe05-a9a0-462f-a003-16c3374ebb98 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:16.914032 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e811fe05-a9a0-462f-a003-16c3374ebb98 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:16.919660 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e811fe05-a9a0-462f-a003-16c3374ebb98 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:16.922019 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ecc42f02-a09a-407a-b07b-cd9299e88d99 tempest-VolumesTestJSON-743612218 tempest-VolumesTestJSON-743612218-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/985df483-7015-4194-a3bb-5957d4c5edd0" status: 200 len: 351 microversion: 2.1 time: 0.135372 Nov 02 23:07:16.928855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 5/6] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:16 2021] GET /compute/v2.1/os-volumes/985df483-7015-4194-a3bb-5957d4c5edd0 => generated 351 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:17.053813 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.quota [None req-e811fe05-a9a0-462f-a003-16c3374ebb98 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Getting quotas for project 1f8273a7a71541c19aa61c501250b84a. Resources: {'cores', 'instances', 'ram'} {{(pid=115799) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:07:17.080334 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.quota [None req-e811fe05-a9a0-462f-a003-16c3374ebb98 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Getting quotas for user 129ecb0ff30d461e9ce6727cd4d6839f and project 1f8273a7a71541c19aa61c501250b84a. Resources: {'cores', 'instances', 'ram'} {{(pid=115799) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:07:17.122777 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e811fe05-a9a0-462f-a003-16c3374ebb98 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Going to run 1 instances... {{(pid=115799) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 23:07:17.133274 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e811fe05-a9a0-462f-a003-16c3374ebb98 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4159c567-fd66-4bbb-9bf4-6ce0afd65d88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 23:07:17.333704 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e811fe05-a9a0-462f-a003-16c3374ebb98 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.437653 Nov 02 23:07:17.336012 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 2/7] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 2 23:07:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 3442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 23:07:17.341846 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-62a0611f-cf30-4871-ac9f-9b416b2f9d4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:17.347075 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-62a0611f-cf30-4871-ac9f-9b416b2f9d4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:17.352929 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-66cf97be-f441-4d1d-a7ee-f8cc8fc9ecca tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'create', calling method: .version_select at 0x7fd85a0fdee0>, body: {"keypair": {"name": "tempest-keypair-1819848099"}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:07:17.423334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-66cf97be-f441-4d1d-a7ee-f8cc8fc9ecca tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Getting quotas for project 77f208bd920d437bb32e5caebf9eb2f9. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:07:17.435384 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-66cf97be-f441-4d1d-a7ee-f8cc8fc9ecca tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Getting quotas for user c4b6bd01b54d492f9d37414393e9aec9 and project 77f208bd920d437bb32e5caebf9eb2f9. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:07:17.627307 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-62a0611f-cf30-4871-ac9f-9b416b2f9d4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:17.658847 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-62a0611f-cf30-4871-ac9f-9b416b2f9d4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1218 microversion: 2.1 time: 0.321153 Nov 02 23:07:17.659472 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 3/8] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:17 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1218 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:17.670961 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-05ea6872-7eca-4785-b6c7-910835784a8e tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Action: 'create', calling method: .version_select at 0x7fd8585d7790>, body: {"snapshot": {"volume_id": "646ecc58-0bd6-4d23-a141-be00bcd1dfe9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1860506360"}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:07:17.913249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-66cf97be-f441-4d1d-a7ee-f8cc8fc9ecca tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Getting quotas for project 77f208bd920d437bb32e5caebf9eb2f9. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:07:17.931824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-66cf97be-f441-4d1d-a7ee-f8cc8fc9ecca tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Getting quotas for user c4b6bd01b54d492f9d37414393e9aec9 and project 77f208bd920d437bb32e5caebf9eb2f9. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:07:17.982785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-66cf97be-f441-4d1d-a7ee-f8cc8fc9ecca tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.052241 Nov 02 23:07:17.993606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 6/9] 10.222.0.41 () {60 vars in 1157 bytes} [Tue Nov 2 23:07:16 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:17.998200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4b9ae4e6-f9bf-4595-9ea8-26f24796a3ac tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:18.002643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4b9ae4e6-f9bf-4595-9ea8-26f24796a3ac tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:18.099639 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-05ea6872-7eca-4785-b6c7-910835784a8e tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.438733 Nov 02 23:07:18.101796 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 4/10] 10.222.0.41 () {60 vars in 1161 bytes} [Tue Nov 2 23:07:17 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:18.110741 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-45ba9597-249b-431f-8230-3c33c513bcff tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd8585e7af0>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:18.257080 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-45ba9597-249b-431f-8230-3c33c513bcff tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/f974cdb0-983b-4d65-b425-d67dc6344d14" status: 200 len: 287 microversion: 2.1 time: 0.150632 Nov 02 23:07:18.257903 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 5/11] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Nov 2 23:07:18 2021] GET /compute/v2.1/os-snapshots/f974cdb0-983b-4d65-b425-d67dc6344d14 => generated 287 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:07:18.267906 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-0f3b563a-7d78-4a8c-9b20-37b7cdbd7f7a tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd8585f64c0>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:18.354900 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-0f3b563a-7d78-4a8c-9b20-37b7cdbd7f7a tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.090553 Nov 02 23:07:18.355504 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 6/12] 10.222.0.41 () {58 vars in 1139 bytes} [Tue Nov 2 23:07:18 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:07:18.367222 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-058b1c64-bb5b-4df3-af20-9178edaa8a33 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd8585d79d0>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:18.437486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4b9ae4e6-f9bf-4595-9ea8-26f24796a3ac tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:18.457954 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-058b1c64-bb5b-4df3-af20-9178edaa8a33 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/f974cdb0-983b-4d65-b425-d67dc6344d14" status: 200 len: 287 microversion: 2.1 time: 0.095633 Nov 02 23:07:18.465357 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 7/13] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Nov 2 23:07:18 2021] GET /compute/v2.1/os-snapshots/f974cdb0-983b-4d65-b425-d67dc6344d14 => generated 287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:18.466433 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4b9ae4e6-f9bf-4595-9ea8-26f24796a3ac tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1215 microversion: 2.1 time: 0.471630 Nov 02 23:07:18.481217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 7/14] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:17 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1215 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:18.676842 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b300daa1-b585-4b10-ac46-a2da093e1f8d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:18.678157 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b300daa1-b585-4b10-ac46-a2da093e1f8d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:18.784842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ae6a7964-1f4c-4d56-9b56-e18ae5b248f3 tempest-VolumesTestJSON-743612218 tempest-VolumesTestJSON-743612218-project] Calling method '.version_select at 0x7fd858597ca0>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:18.943568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ae6a7964-1f4c-4d56-9b56-e18ae5b248f3 tempest-VolumesTestJSON-743612218 tempest-VolumesTestJSON-743612218-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/390792d9-b543-4760-8bd6-9e1731b32e37" status: 200 len: 351 microversion: 2.1 time: 0.162853 Nov 02 23:07:18.945145 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 8/15] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:18 2021] GET /compute/v2.1/os-volumes/390792d9-b543-4760-8bd6-9e1731b32e37 => generated 351 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:07:18.957227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4711960a-75c0-493c-b7bb-edbd6deb26c6 tempest-VolumesTestJSON-743612218 tempest-VolumesTestJSON-743612218-project] Calling method '.version_select at 0x7fd858597b80>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:19.016806 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-b300daa1-b585-4b10-ac46-a2da093e1f8d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:19.027808 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b300daa1-b585-4b10-ac46-a2da093e1f8d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1218 microversion: 2.1 time: 0.354508 Nov 02 23:07:19.030402 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 8/16] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:18 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1218 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:19.168813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4711960a-75c0-493c-b7bb-edbd6deb26c6 tempest-VolumesTestJSON-743612218 tempest-VolumesTestJSON-743612218-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.215793 Nov 02 23:07:19.169673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 9/17] 10.222.0.41 () {58 vars in 1133 bytes} [Tue Nov 2 23:07:18 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:19.184434 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e145418a-07a3-4f9b-bc42-b423673a32df tempest-VolumesTestJSON-743612218 tempest-VolumesTestJSON-743612218-project] Calling method '.version_select at 0x7fd8585f6f70>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:19.365228 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e145418a-07a3-4f9b-bc42-b423673a32df tempest-VolumesTestJSON-743612218 tempest-VolumesTestJSON-743612218-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.187166 Nov 02 23:07:19.365828 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 9/18] 10.222.0.41 () {58 vars in 1148 bytes} [Tue Nov 2 23:07:19 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:19.407588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bdac2251-c8df-4eae-a555-b6d09ff0572b tempest-VolumesTestJSON-743612218 tempest-VolumesTestJSON-743612218-project] Calling method '.version_select at 0x7fd858597e50>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:19.476866 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-1058900a-fd7d-40b1-b6e0-6848075616a2 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd8585d7670>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:19.533038 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-1058900a-fd7d-40b1-b6e0-6848075616a2 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/f974cdb0-983b-4d65-b425-d67dc6344d14" status: 200 len: 287 microversion: 2.1 time: 0.060645 Nov 02 23:07:19.533937 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 10/19] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Nov 2 23:07:19 2021] GET /compute/v2.1/os-snapshots/f974cdb0-983b-4d65-b425-d67dc6344d14 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:19.540601 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-296f0058-359c-4743-8565-0e1bfa017d13 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:19.541396 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-296f0058-359c-4743-8565-0e1bfa017d13 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:19.555327 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-296f0058-359c-4743-8565-0e1bfa017d13 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:19.557748 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-296f0058-359c-4743-8565-0e1bfa017d13 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:19.559641 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-296f0058-359c-4743-8565-0e1bfa017d13 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:19.564858 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-296f0058-359c-4743-8565-0e1bfa017d13 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:19.689103 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bdac2251-c8df-4eae-a555-b6d09ff0572b tempest-VolumesTestJSON-743612218 tempest-VolumesTestJSON-743612218-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.314629 Nov 02 23:07:19.690165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 10/20] 10.222.0.41 () {58 vars in 1133 bytes} [Tue Nov 2 23:07:19 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:19.701181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-54b806e1-9843-4f06-b9df-3873ad37e981 tempest-VolumesTestJSON-743612218 tempest-VolumesTestJSON-743612218-project] Calling method '.version_select at 0x7fd858545160>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:19.904818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-54b806e1-9843-4f06-b9df-3873ad37e981 tempest-VolumesTestJSON-743612218 tempest-VolumesTestJSON-743612218-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.207641 Nov 02 23:07:19.907716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 11/21] 10.222.0.41 () {58 vars in 1166 bytes} [Tue Nov 2 23:07:19 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:07:19.928690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2e612d7a-67c1-413d-835c-a965ec733bf8 tempest-VolumesTestJSON-743612218 tempest-VolumesTestJSON-743612218-project] Calling method '.version_select at 0x7fd858597e50>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:19.983759 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-296f0058-359c-4743-8565-0e1bfa017d13 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:20.006198 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-296f0058-359c-4743-8565-0e1bfa017d13 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1219 microversion: 2.1 time: 0.470746 Nov 02 23:07:20.018373 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 11/22] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:19 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1219 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:20.046707 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ad011ffb-9e22-4d92-89f2-461819c727fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:20.047990 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ad011ffb-9e22-4d92-89f2-461819c727fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:20.057831 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ad011ffb-9e22-4d92-89f2-461819c727fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:20.058383 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ad011ffb-9e22-4d92-89f2-461819c727fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:20.059217 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ad011ffb-9e22-4d92-89f2-461819c727fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:20.059656 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ad011ffb-9e22-4d92-89f2-461819c727fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:20.195381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2e612d7a-67c1-413d-835c-a965ec733bf8 tempest-VolumesTestJSON-743612218 tempest-VolumesTestJSON-743612218-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.272363 Nov 02 23:07:20.196604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 12/23] 10.222.0.41 () {58 vars in 1169 bytes} [Tue Nov 2 23:07:19 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:20.212638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-71b1cdaa-afa1-4a7a-aebd-318cbff7bb79 tempest-VolumesTestJSON-743612218 tempest-VolumesTestJSON-743612218-project] Calling method '.version_select at 0x7fd858545940>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:20.296720 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-ad011ffb-9e22-4d92-89f2-461819c727fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:20.309460 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ad011ffb-9e22-4d92-89f2-461819c727fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1222 microversion: 2.1 time: 0.263210 Nov 02 23:07:20.313854 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 12/24] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:20 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1222 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:20.431167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-71b1cdaa-afa1-4a7a-aebd-318cbff7bb79 tempest-VolumesTestJSON-743612218 tempest-VolumesTestJSON-743612218-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.226295 Nov 02 23:07:20.441204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 13/25] 10.222.0.41 () {58 vars in 1154 bytes} [Tue Nov 2 23:07:20 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:20.456408 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-bf4d3007-c6d3-4cf9-9bab-bc759dc27fc9 tempest-VolumesTestJSON-743612218 tempest-VolumesTestJSON-743612218-project] Calling method '.version_select at 0x7fd858567ee0>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:20.550230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4a755b18-d182-47b4-9dab-28889165fa9e tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd8585be8b0>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:20.601175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4a755b18-d182-47b4-9dab-28889165fa9e tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/f974cdb0-983b-4d65-b425-d67dc6344d14" status: 200 len: 287 microversion: 2.1 time: 0.059014 Nov 02 23:07:20.603867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 14/26] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Nov 2 23:07:20 2021] GET /compute/v2.1/os-snapshots/f974cdb0-983b-4d65-b425-d67dc6344d14 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:20.685508 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-bf4d3007-c6d3-4cf9-9bab-bc759dc27fc9 tempest-VolumesTestJSON-743612218 tempest-VolumesTestJSON-743612218-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.245189 Nov 02 23:07:20.686904 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 13/27] 10.222.0.41 () {58 vars in 1187 bytes} [Tue Nov 2 23:07:20 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:07:20.701961 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c36a7829-5410-4803-809e-22d49227026d tempest-VolumesTestJSON-743612218 tempest-VolumesTestJSON-743612218-project] Calling method '.version_select at 0x7fd8585beca0>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:20.919873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c36a7829-5410-4803-809e-22d49227026d tempest-VolumesTestJSON-743612218 tempest-VolumesTestJSON-743612218-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.223493 Nov 02 23:07:20.920457 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 15/28] 10.222.0.41 () {58 vars in 1154 bytes} [Tue Nov 2 23:07:20 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:21.026956 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b32217d5-c54f-455c-bd78-cd1c8add4047 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:21.027586 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b32217d5-c54f-455c-bd78-cd1c8add4047 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:21.043832 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b32217d5-c54f-455c-bd78-cd1c8add4047 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:21.046498 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b32217d5-c54f-455c-bd78-cd1c8add4047 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:21.053612 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b32217d5-c54f-455c-bd78-cd1c8add4047 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:21.057081 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b32217d5-c54f-455c-bd78-cd1c8add4047 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:21.320346 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-b32217d5-c54f-455c-bd78-cd1c8add4047 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:21.328664 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b32217d5-c54f-455c-bd78-cd1c8add4047 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1219 microversion: 2.1 time: 0.306759 Nov 02 23:07:21.331272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-96348885-8181-4c2c-94b3-469995a43150 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:21.332152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-96348885-8181-4c2c-94b3-469995a43150 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:21.339490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-96348885-8181-4c2c-94b3-469995a43150 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:21.341308 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 14/29] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:21 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1219 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:21.343796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-96348885-8181-4c2c-94b3-469995a43150 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:21.344959 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-96348885-8181-4c2c-94b3-469995a43150 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:21.352919 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-96348885-8181-4c2c-94b3-469995a43150 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:21.615043 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-38c7a5f5-730b-4aef-a5c4-edc5cf3bbaf7 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd8585729d0>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:21.721226 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-38c7a5f5-730b-4aef-a5c4-edc5cf3bbaf7 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/f974cdb0-983b-4d65-b425-d67dc6344d14" status: 200 len: 287 microversion: 2.1 time: 0.110231 Nov 02 23:07:21.721833 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 15/30] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Nov 2 23:07:21 2021] GET /compute/v2.1/os-snapshots/f974cdb0-983b-4d65-b425-d67dc6344d14 => generated 287 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:21.822266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-96348885-8181-4c2c-94b3-469995a43150 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:21.840405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-96348885-8181-4c2c-94b3-469995a43150 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1222 microversion: 2.1 time: 0.514783 Nov 02 23:07:21.852782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 16/31] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:21 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1222 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:22.348687 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-823d2e29-5d53-4767-b5a1-8215118babb2 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:22.349732 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-823d2e29-5d53-4767-b5a1-8215118babb2 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:22.376443 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-823d2e29-5d53-4767-b5a1-8215118babb2 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:22.376921 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-823d2e29-5d53-4767-b5a1-8215118babb2 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:22.377756 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-823d2e29-5d53-4767-b5a1-8215118babb2 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:22.378220 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-823d2e29-5d53-4767-b5a1-8215118babb2 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:22.615315 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-823d2e29-5d53-4767-b5a1-8215118babb2 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:22.625032 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-823d2e29-5d53-4767-b5a1-8215118babb2 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1219 microversion: 2.1 time: 0.280247 Nov 02 23:07:22.629189 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 16/32] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:22 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1219 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:22.733123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8b2cdc8c-d2ae-4a66-9e3d-e87f7a108c0c tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd85852a9d0>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:22.777306 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8b2cdc8c-d2ae-4a66-9e3d-e87f7a108c0c tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/f974cdb0-983b-4d65-b425-d67dc6344d14" status: 200 len: 287 microversion: 2.1 time: 0.047799 Nov 02 23:07:22.778437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 17/33] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Nov 2 23:07:22 2021] GET /compute/v2.1/os-snapshots/f974cdb0-983b-4d65-b425-d67dc6344d14 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:22.860172 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-cace23ec-fd6c-4faf-9971-92514bb7244a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:22.860791 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-cace23ec-fd6c-4faf-9971-92514bb7244a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:22.874587 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cace23ec-fd6c-4faf-9971-92514bb7244a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:22.875640 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cace23ec-fd6c-4faf-9971-92514bb7244a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:22.889011 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cace23ec-fd6c-4faf-9971-92514bb7244a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:22.940206 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cace23ec-fd6c-4faf-9971-92514bb7244a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:23.089491 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-cace23ec-fd6c-4faf-9971-92514bb7244a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:23.102624 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-cace23ec-fd6c-4faf-9971-92514bb7244a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1222 microversion: 2.1 time: 0.242461 Nov 02 23:07:23.114293 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 17/34] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:22 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1222 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:23.123231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d49b5365-0996-4adb-a7e2-a4bbb8ab616c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1690556955", "imageRef": "4159c567-fd66-4bbb-9bf4-6ce0afd65d88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "abf5285d-6abf-4483-8a42-c57127452e47"}], "security_groups": [{"name": "tempest-securitygroup--1894829793"}], "key_name": "tempest-keypair-1819848099", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:07:23.310995 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.network.neutron [None req-d49b5365-0996-4adb-a7e2-a4bbb8ab616c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] validate_networks() for [('abf5285d-6abf-4483-8a42-c57127452e47', None, None, None, None, None)] {{(pid=115800) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 23:07:23.651625 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-835a88ae-71a0-4eda-8059-134f16522ace tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'create', calling method: .version_select at 0x7fd8585d7790>, body: {"keypair": {"name": "tempest-keypair-1891433527"}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:07:23.687314 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.quota [None req-835a88ae-71a0-4eda-8059-134f16522ace tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Getting quotas for project f6d6ef936bc64892a3d3ff11413f78b8. Resources: {'key_pairs'} {{(pid=115799) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:07:23.693263 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.quota [None req-835a88ae-71a0-4eda-8059-134f16522ace tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Getting quotas for user 5c145054a2644e17b76cb2b67dcbd57a and project f6d6ef936bc64892a3d3ff11413f78b8. Resources: {'key_pairs'} {{(pid=115799) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:07:23.773138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-d49b5365-0996-4adb-a7e2-a4bbb8ab616c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Flavor limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 23:07:23.773823 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-d49b5365-0996-4adb-a7e2-a4bbb8ab616c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Image limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 23:07:23.774562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-d49b5365-0996-4adb-a7e2-a4bbb8ab616c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Flavor pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 23:07:23.775381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-d49b5365-0996-4adb-a7e2-a4bbb8ab616c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Image pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 23:07:23.776086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-d49b5365-0996-4adb-a7e2-a4bbb8ab616c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 23:07:23.786819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d49b5365-0996-4adb-a7e2-a4bbb8ab616c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:23.787673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d49b5365-0996-4adb-a7e2-a4bbb8ab616c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:23.789546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d49b5365-0996-4adb-a7e2-a4bbb8ab616c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:23.792085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d49b5365-0996-4adb-a7e2-a4bbb8ab616c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:23.809539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-d49b5365-0996-4adb-a7e2-a4bbb8ab616c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Getting quotas for project 77f208bd920d437bb32e5caebf9eb2f9. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:07:23.813653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-d49b5365-0996-4adb-a7e2-a4bbb8ab616c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Getting quotas for user c4b6bd01b54d492f9d37414393e9aec9 and project 77f208bd920d437bb32e5caebf9eb2f9. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:07:23.831393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d49b5365-0996-4adb-a7e2-a4bbb8ab616c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Going to run 1 instances... {{(pid=115800) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 23:07:23.839879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d49b5365-0996-4adb-a7e2-a4bbb8ab616c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4159c567-fd66-4bbb-9bf4-6ce0afd65d88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 23:07:23.918052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d49b5365-0996-4adb-a7e2-a4bbb8ab616c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.807640 Nov 02 23:07:23.924462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 18/35] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 2 23:07:23 2021] POST /compute/v2.1/servers => generated 402 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 23:07:23.930336 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5c484186-6e72-4cb2-b8e5-3bf68f3f2628 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:23.931185 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5c484186-6e72-4cb2-b8e5-3bf68f3f2628 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:23.946533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5c484186-6e72-4cb2-b8e5-3bf68f3f2628 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:23.947177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5c484186-6e72-4cb2-b8e5-3bf68f3f2628 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:23.950363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5c484186-6e72-4cb2-b8e5-3bf68f3f2628 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:23.951310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5c484186-6e72-4cb2-b8e5-3bf68f3f2628 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:23.990593 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.quota [None req-835a88ae-71a0-4eda-8059-134f16522ace tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Getting quotas for project f6d6ef936bc64892a3d3ff11413f78b8. Resources: {'key_pairs'} {{(pid=115799) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:07:23.996614 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.quota [None req-835a88ae-71a0-4eda-8059-134f16522ace tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Getting quotas for user 5c145054a2644e17b76cb2b67dcbd57a and project f6d6ef936bc64892a3d3ff11413f78b8. Resources: {'key_pairs'} {{(pid=115799) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:07:24.015426 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-835a88ae-71a0-4eda-8059-134f16522ace tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.520024 Nov 02 23:07:24.017071 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 18/36] 10.222.0.41 () {62 vars in 1198 bytes} [Tue Nov 2 23:07:23 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 522 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 02 23:07:24.025963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5c484186-6e72-4cb2-b8e5-3bf68f3f2628 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:24.034831 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5c484186-6e72-4cb2-b8e5-3bf68f3f2628 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1219 microversion: 2.1 time: 0.107867 Nov 02 23:07:24.037500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 19/37] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:23 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:24.043500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1191f0a8-01f3-436e-915e-b0e543e3e0aa tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:24.044376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1191f0a8-01f3-436e-915e-b0e543e3e0aa tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:24.046397 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b525a349-d88b-461f-bc10-0321cab8317e tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd8585679d0>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:24.088921 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b525a349-d88b-461f-bc10-0321cab8317e tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/f974cdb0-983b-4d65-b425-d67dc6344d14" status: 200 len: 287 microversion: 2.1 time: 0.067641 Nov 02 23:07:24.089793 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 19/38] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Nov 2 23:07:24 2021] GET /compute/v2.1/os-snapshots/f974cdb0-983b-4d65-b425-d67dc6344d14 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:24.108556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1191f0a8-01f3-436e-915e-b0e543e3e0aa tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:24.117375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1191f0a8-01f3-436e-915e-b0e543e3e0aa tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1238 microversion: 2.1 time: 0.078010 Nov 02 23:07:24.118735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 20/39] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:24 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:24.134202 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-170fd920-1054-4adf-81bb-6153ad7d58df tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:24.135194 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-170fd920-1054-4adf-81bb-6153ad7d58df tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:24.142100 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-170fd920-1054-4adf-81bb-6153ad7d58df tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:24.143044 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-170fd920-1054-4adf-81bb-6153ad7d58df tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:24.144294 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-170fd920-1054-4adf-81bb-6153ad7d58df tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:24.145047 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-170fd920-1054-4adf-81bb-6153ad7d58df tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:24.224118 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-170fd920-1054-4adf-81bb-6153ad7d58df tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:24.241238 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-170fd920-1054-4adf-81bb-6153ad7d58df tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1222 microversion: 2.1 time: 0.113668 Nov 02 23:07:24.245442 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 20/40] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:24 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1222 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:25.054906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7673498c-6395-4cd4-942b-968acb3d576a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:25.057342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7673498c-6395-4cd4-942b-968acb3d576a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:25.071722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7673498c-6395-4cd4-942b-968acb3d576a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:25.072578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7673498c-6395-4cd4-942b-968acb3d576a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:25.076084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7673498c-6395-4cd4-942b-968acb3d576a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:25.076084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7673498c-6395-4cd4-942b-968acb3d576a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:25.112810 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-7ffdd8fb-e81e-4a22-8276-e6fe35eedfb5 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd8584e6550>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:25.187752 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-7ffdd8fb-e81e-4a22-8276-e6fe35eedfb5 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/f974cdb0-983b-4d65-b425-d67dc6344d14" status: 200 len: 288 microversion: 2.1 time: 0.090417 Nov 02 23:07:25.189010 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 21/41] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Nov 2 23:07:25 2021] GET /compute/v2.1/os-snapshots/f974cdb0-983b-4d65-b425-d67dc6344d14 => generated 288 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:25.194990 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e905e9ab-0844-4adc-b279-270920ed63fc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:25.195854 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e905e9ab-0844-4adc-b279-270920ed63fc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:25.202654 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e905e9ab-0844-4adc-b279-270920ed63fc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:25.207785 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e905e9ab-0844-4adc-b279-270920ed63fc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:25.209384 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e905e9ab-0844-4adc-b279-270920ed63fc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:25.211123 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e905e9ab-0844-4adc-b279-270920ed63fc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:25.269948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7673498c-6395-4cd4-942b-968acb3d576a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:25.278584 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7673498c-6395-4cd4-942b-968acb3d576a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1267 microversion: 2.1 time: 0.228053 Nov 02 23:07:25.292666 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 21/42] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:25 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:25.294124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d88fe601-ae2f-4789-9e28-8e28039828bd tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd8584ebdc0>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:25.302312 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e905e9ab-0844-4adc-b279-270920ed63fc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:25.325542 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e905e9ab-0844-4adc-b279-270920ed63fc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1234 microversion: 2.1 time: 0.134712 Nov 02 23:07:25.326909 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 22/43] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:25 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1234 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:25.339991 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-c31ca6f0-42cb-4e6f-a54d-42de89398747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:25.340682 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-c31ca6f0-42cb-4e6f-a54d-42de89398747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:25.348712 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c31ca6f0-42cb-4e6f-a54d-42de89398747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:25.349176 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c31ca6f0-42cb-4e6f-a54d-42de89398747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:25.349997 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c31ca6f0-42cb-4e6f-a54d-42de89398747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:25.351167 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c31ca6f0-42cb-4e6f-a54d-42de89398747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:25.426267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d88fe601-ae2f-4789-9e28-8e28039828bd tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "DELETE /compute/v2.1/os-snapshots/f974cdb0-983b-4d65-b425-d67dc6344d14" status: 202 len: 0 microversion: 2.1 time: 0.141527 Nov 02 23:07:25.427330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 22/44] 10.222.0.41 () {58 vars in 1253 bytes} [Tue Nov 2 23:07:25 2021] DELETE /compute/v2.1/os-snapshots/f974cdb0-983b-4d65-b425-d67dc6344d14 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:07:25.435757 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1b5b61f1-5fff-48cf-bd8d-3db832959acb tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd858498670>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:25.492611 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1b5b61f1-5fff-48cf-bd8d-3db832959acb tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/f974cdb0-983b-4d65-b425-d67dc6344d14" status: 200 len: 287 microversion: 2.1 time: 0.060418 Nov 02 23:07:25.497667 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 23/45] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Nov 2 23:07:25 2021] GET /compute/v2.1/os-snapshots/f974cdb0-983b-4d65-b425-d67dc6344d14 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:25.577161 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-c31ca6f0-42cb-4e6f-a54d-42de89398747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:25.588335 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-c31ca6f0-42cb-4e6f-a54d-42de89398747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1288 microversion: 2.1 time: 0.259801 Nov 02 23:07:25.589855 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 23/46] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:25 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1288 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:26.164454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1fe2d264-8b20-411b-88ce-bb45599793fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-524330911", "imageRef": "4159c567-fd66-4bbb-9bf4-6ce0afd65d88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fdc236b7-7cb8-4ee0-a8bc-b772823b9da2"}], "security_groups": [{"name": "tempest-securitygroup--974226597"}], "key_name": "tempest-keypair-1891433527", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:07:26.300575 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f9b9d2fe-0454-4bb5-b50e-8c4ea9c3e4fa tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:26.301254 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f9b9d2fe-0454-4bb5-b50e-8c4ea9c3e4fa tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:26.315703 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f9b9d2fe-0454-4bb5-b50e-8c4ea9c3e4fa tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:26.316173 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f9b9d2fe-0454-4bb5-b50e-8c4ea9c3e4fa tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:26.316980 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f9b9d2fe-0454-4bb5-b50e-8c4ea9c3e4fa tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:26.321283 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f9b9d2fe-0454-4bb5-b50e-8c4ea9c3e4fa tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:26.359126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.network.neutron [None req-1fe2d264-8b20-411b-88ce-bb45599793fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] validate_networks() for [('fdc236b7-7cb8-4ee0-a8bc-b772823b9da2', None, None, None, None, None)] {{(pid=115800) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 23:07:26.525079 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-f9b9d2fe-0454-4bb5-b50e-8c4ea9c3e4fa tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:26.534009 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f9b9d2fe-0454-4bb5-b50e-8c4ea9c3e4fa tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1273 microversion: 2.1 time: 0.238107 Nov 02 23:07:26.542266 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 24/47] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:26 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1273 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:26.562509 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ca728741-8699-48f1-abb4-4eff7f2fdb5b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:26.563183 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ca728741-8699-48f1-abb4-4eff7f2fdb5b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:26.616114 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ca728741-8699-48f1-abb4-4eff7f2fdb5b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:26.616603 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ca728741-8699-48f1-abb4-4eff7f2fdb5b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:26.617452 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ca728741-8699-48f1-abb4-4eff7f2fdb5b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:26.617895 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ca728741-8699-48f1-abb4-4eff7f2fdb5b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:26.812865 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-ca728741-8699-48f1-abb4-4eff7f2fdb5b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:26.822596 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ca728741-8699-48f1-abb4-4eff7f2fdb5b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1308 microversion: 2.1 time: 0.278829 Nov 02 23:07:26.841836 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 25/48] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:26 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1308 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:26.846720 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-0bd5840c-83ca-434b-8d67-02ee045dbec5 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd8584ada60>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:26.924794 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.wsgi [None req-0bd5840c-83ca-434b-8d67-02ee045dbec5 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] HTTP exception thrown: Snapshot f974cdb0-983b-4d65-b425-d67dc6344d14 could not be found. Nov 02 23:07:26.925412 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-0bd5840c-83ca-434b-8d67-02ee045dbec5 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Returning 404 to user: Snapshot f974cdb0-983b-4d65-b425-d67dc6344d14 could not be found. {{(pid=115799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:07:26.927112 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-0bd5840c-83ca-434b-8d67-02ee045dbec5 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/f974cdb0-983b-4d65-b425-d67dc6344d14" status: 404 len: 111 microversion: 2.1 time: 0.091772 Nov 02 23:07:26.932385 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 26/49] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Nov 2 23:07:26 2021] GET /compute/v2.1/os-snapshots/f974cdb0-983b-4d65-b425-d67dc6344d14 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 23:07:26.940843 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-cdc36c62-a9a7-46fe-a018-0372e91b1046 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:26.941502 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-cdc36c62-a9a7-46fe-a018-0372e91b1046 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:26.965733 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cdc36c62-a9a7-46fe-a018-0372e91b1046 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:26.966207 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cdc36c62-a9a7-46fe-a018-0372e91b1046 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:26.967144 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cdc36c62-a9a7-46fe-a018-0372e91b1046 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:26.967619 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cdc36c62-a9a7-46fe-a018-0372e91b1046 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:27.645623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-1fe2d264-8b20-411b-88ce-bb45599793fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Flavor limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 23:07:27.646843 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-1fe2d264-8b20-411b-88ce-bb45599793fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Image limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 23:07:27.647626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-1fe2d264-8b20-411b-88ce-bb45599793fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Flavor pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 23:07:27.648247 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-1fe2d264-8b20-411b-88ce-bb45599793fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Image pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 23:07:27.648963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-1fe2d264-8b20-411b-88ce-bb45599793fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 23:07:27.677538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fe2d264-8b20-411b-88ce-bb45599793fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:27.679063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fe2d264-8b20-411b-88ce-bb45599793fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:27.683845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fe2d264-8b20-411b-88ce-bb45599793fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:27.685237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fe2d264-8b20-411b-88ce-bb45599793fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:27.745470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-1fe2d264-8b20-411b-88ce-bb45599793fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Getting quotas for project f6d6ef936bc64892a3d3ff11413f78b8. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:07:27.753506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-1fe2d264-8b20-411b-88ce-bb45599793fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Getting quotas for user 5c145054a2644e17b76cb2b67dcbd57a and project f6d6ef936bc64892a3d3ff11413f78b8. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:07:27.805728 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1fe2d264-8b20-411b-88ce-bb45599793fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Going to run 1 instances... {{(pid=115800) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 23:07:27.811476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1fe2d264-8b20-411b-88ce-bb45599793fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4159c567-fd66-4bbb-9bf4-6ce0afd65d88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 23:07:27.950356 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1fe2d264-8b20-411b-88ce-bb45599793fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.789360 Nov 02 23:07:27.952970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 24/50] 10.222.0.41 () {62 vars in 1187 bytes} [Tue Nov 2 23:07:26 2021] POST /compute/v2.1/servers => generated 401 bytes in 1794 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 23:07:27.981948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ce2be463-754f-4a22-a4a3-25a2ccedca24 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd858536310>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:28.003086 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-cdc36c62-a9a7-46fe-a018-0372e91b1046 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:28.019482 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-cdc36c62-a9a7-46fe-a018-0372e91b1046 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 1.085108 Nov 02 23:07:28.025604 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 27/51] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:26 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:28.037367 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-64708b05-66da-478b-8aa6-2b037f4c6559 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:28.040185 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-64708b05-66da-478b-8aa6-2b037f4c6559 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:28.053316 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-64708b05-66da-478b-8aa6-2b037f4c6559 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:28.062423 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-64708b05-66da-478b-8aa6-2b037f4c6559 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:28.063409 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-64708b05-66da-478b-8aa6-2b037f4c6559 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:28.064294 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-64708b05-66da-478b-8aa6-2b037f4c6559 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:28.239127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ce2be463-754f-4a22-a4a3-25a2ccedca24 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9" status: 202 len: 0 microversion: 2.1 time: 0.283254 Nov 02 23:07:28.243299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 25/52] 10.222.0.41 () {58 vars in 1247 bytes} [Tue Nov 2 23:07:27 2021] DELETE /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:07:28.248435 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-48ce1564-fb0b-45fd-9b82-0cd61681f571 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:28.249095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-48ce1564-fb0b-45fd-9b82-0cd61681f571 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:28.251794 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-64708b05-66da-478b-8aa6-2b037f4c6559 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:28.260426 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-64708b05-66da-478b-8aa6-2b037f4c6559 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1273 microversion: 2.1 time: 0.233356 Nov 02 23:07:28.266666 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 28/53] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:28 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1273 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:28.281732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48ce1564-fb0b-45fd-9b82-0cd61681f571 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:28.282150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48ce1564-fb0b-45fd-9b82-0cd61681f571 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:28.282973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48ce1564-fb0b-45fd-9b82-0cd61681f571 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:28.283416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48ce1564-fb0b-45fd-9b82-0cd61681f571 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:28.286950 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e7db5c23-9ef5-4b00-b626-230423c9f47b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:28.288666 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e7db5c23-9ef5-4b00-b626-230423c9f47b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:28.400700 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e7db5c23-9ef5-4b00-b626-230423c9f47b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:28.424710 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e7db5c23-9ef5-4b00-b626-230423c9f47b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:28.432072 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e7db5c23-9ef5-4b00-b626-230423c9f47b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:28.436983 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e7db5c23-9ef5-4b00-b626-230423c9f47b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1281 microversion: 2.20 time: 0.155330 Nov 02 23:07:28.443598 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 29/54] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:28 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1281 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:07:28.458478 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e9c55a26-b8dd-40f2-85eb-01132ccac372 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd85851a3a0>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:28.575038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-48ce1564-fb0b-45fd-9b82-0cd61681f571 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:28.588123 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e9c55a26-b8dd-40f2-85eb-01132ccac372 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9" status: 200 len: 344 microversion: 2.1 time: 0.143166 Nov 02 23:07:28.588993 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 30/55] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:28 2021] GET /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:28.592121 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-48ce1564-fb0b-45fd-9b82-0cd61681f571 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1296 microversion: 2.1 time: 0.347423 Nov 02 23:07:28.607650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 26/56] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:28 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1296 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:29.039412 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-1cadbe40-5eee-4271-bc61-1a4b9f8d3d53 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:29.040777 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-1cadbe40-5eee-4271-bc61-1a4b9f8d3d53 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:29.061177 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1cadbe40-5eee-4271-bc61-1a4b9f8d3d53 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:29.061635 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1cadbe40-5eee-4271-bc61-1a4b9f8d3d53 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:29.062447 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1cadbe40-5eee-4271-bc61-1a4b9f8d3d53 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:29.062898 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1cadbe40-5eee-4271-bc61-1a4b9f8d3d53 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:29.261825 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-1cadbe40-5eee-4271-bc61-1a4b9f8d3d53 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:29.270069 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-1cadbe40-5eee-4271-bc61-1a4b9f8d3d53 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.235893 Nov 02 23:07:29.271164 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 31/57] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:29 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:29.289751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-af2a4f78-72fd-45d3-ba5e-fcd0d750d411 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:29.291178 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-af2a4f78-72fd-45d3-ba5e-fcd0d750d411 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:29.298349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af2a4f78-72fd-45d3-ba5e-fcd0d750d411 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:29.299215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af2a4f78-72fd-45d3-ba5e-fcd0d750d411 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:29.300371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af2a4f78-72fd-45d3-ba5e-fcd0d750d411 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:29.301097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af2a4f78-72fd-45d3-ba5e-fcd0d750d411 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:29.458846 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-59fdeb77-c152-4cc2-a091-0b810892244b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:29.471429 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-59fdeb77-c152-4cc2-a091-0b810892244b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:29.473725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-af2a4f78-72fd-45d3-ba5e-fcd0d750d411 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:29.478206 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-59fdeb77-c152-4cc2-a091-0b810892244b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:29.478985 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-59fdeb77-c152-4cc2-a091-0b810892244b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:29.480020 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-59fdeb77-c152-4cc2-a091-0b810892244b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:29.480660 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-59fdeb77-c152-4cc2-a091-0b810892244b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:29.489562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-af2a4f78-72fd-45d3-ba5e-fcd0d750d411 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.204924 Nov 02 23:07:29.490878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 27/58] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:29 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:29.551202 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-59fdeb77-c152-4cc2-a091-0b810892244b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:29.561081 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-59fdeb77-c152-4cc2-a091-0b810892244b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:29.562696 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-59fdeb77-c152-4cc2-a091-0b810892244b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:29.563858 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-59fdeb77-c152-4cc2-a091-0b810892244b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1285 microversion: 2.20 time: 0.110983 Nov 02 23:07:29.564431 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 32/59] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:29 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:07:29.601868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-098a3ddc-4402-499f-9711-4bc1676016ed tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd8584eb430>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:29.609531 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-922b43bf-a8a8-4e9d-95e2-ad9a131a3391 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:29.610305 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-922b43bf-a8a8-4e9d-95e2-ad9a131a3391 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:29.623894 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-922b43bf-a8a8-4e9d-95e2-ad9a131a3391 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:29.624591 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-922b43bf-a8a8-4e9d-95e2-ad9a131a3391 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:29.625548 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-922b43bf-a8a8-4e9d-95e2-ad9a131a3391 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:29.626129 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-922b43bf-a8a8-4e9d-95e2-ad9a131a3391 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:29.670897 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-098a3ddc-4402-499f-9711-4bc1676016ed tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9" status: 200 len: 344 microversion: 2.1 time: 0.073141 Nov 02 23:07:29.671518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 28/60] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:29 2021] GET /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9 => generated 344 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:29.801000 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-922b43bf-a8a8-4e9d-95e2-ad9a131a3391 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:29.815158 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-922b43bf-a8a8-4e9d-95e2-ad9a131a3391 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.209386 Nov 02 23:07:29.815755 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 33/61] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:29 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:07:30.287725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-693b15bc-bc85-488a-b95c-9bb745469ede tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:30.288831 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-693b15bc-bc85-488a-b95c-9bb745469ede tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:30.294622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-693b15bc-bc85-488a-b95c-9bb745469ede tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:30.295237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-693b15bc-bc85-488a-b95c-9bb745469ede tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:30.295853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-693b15bc-bc85-488a-b95c-9bb745469ede tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:30.296288 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-693b15bc-bc85-488a-b95c-9bb745469ede tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:30.431005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-693b15bc-bc85-488a-b95c-9bb745469ede tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:30.438545 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-693b15bc-bc85-488a-b95c-9bb745469ede tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.154356 Nov 02 23:07:30.439134 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 29/62] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:30 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:30.507079 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-41055ae9-8175-4ba4-a367-63396f575276 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:30.507691 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-41055ae9-8175-4ba4-a367-63396f575276 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:30.513465 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-41055ae9-8175-4ba4-a367-63396f575276 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:30.513912 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-41055ae9-8175-4ba4-a367-63396f575276 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:30.514678 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-41055ae9-8175-4ba4-a367-63396f575276 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:30.515137 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-41055ae9-8175-4ba4-a367-63396f575276 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:30.581901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b4431007-90cb-4609-8275-47fa9fd1aab5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:30.582512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b4431007-90cb-4609-8275-47fa9fd1aab5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:30.588756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b4431007-90cb-4609-8275-47fa9fd1aab5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:30.589205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b4431007-90cb-4609-8275-47fa9fd1aab5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:30.589981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b4431007-90cb-4609-8275-47fa9fd1aab5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:30.590415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b4431007-90cb-4609-8275-47fa9fd1aab5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:30.643359 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-41055ae9-8175-4ba4-a367-63396f575276 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:30.650062 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b4431007-90cb-4609-8275-47fa9fd1aab5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:30.656558 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-41055ae9-8175-4ba4-a367-63396f575276 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.153022 Nov 02 23:07:30.657142 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 34/63] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:30 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:30.658452 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b4431007-90cb-4609-8275-47fa9fd1aab5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:30.660171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b4431007-90cb-4609-8275-47fa9fd1aab5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:30.661271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b4431007-90cb-4609-8275-47fa9fd1aab5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1285 microversion: 2.20 time: 0.083399 Nov 02 23:07:30.662112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 30/64] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:30 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1285 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:07:30.683197 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-6b5018ff-f6a1-4301-bde3-59d4d3df6aa7 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd8584e6c10>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:30.729590 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-6b5018ff-f6a1-4301-bde3-59d4d3df6aa7 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9" status: 200 len: 344 microversion: 2.1 time: 0.049928 Nov 02 23:07:30.730158 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 35/65] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:30 2021] GET /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:30.832673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ccb9e970-f502-4955-b516-89b55bcb13d7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:30.833271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ccb9e970-f502-4955-b516-89b55bcb13d7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:30.843977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ccb9e970-f502-4955-b516-89b55bcb13d7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:30.844421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ccb9e970-f502-4955-b516-89b55bcb13d7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:30.845207 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ccb9e970-f502-4955-b516-89b55bcb13d7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:30.845632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ccb9e970-f502-4955-b516-89b55bcb13d7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:30.985460 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ccb9e970-f502-4955-b516-89b55bcb13d7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:30.994970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ccb9e970-f502-4955-b516-89b55bcb13d7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.166035 Nov 02 23:07:30.995624 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 31/66] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:30 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:31.455669 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f886db5f-0207-44d0-aab6-e0f42dcb827d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:31.456293 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f886db5f-0207-44d0-aab6-e0f42dcb827d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:31.462799 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f886db5f-0207-44d0-aab6-e0f42dcb827d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:31.463353 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f886db5f-0207-44d0-aab6-e0f42dcb827d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:31.464127 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f886db5f-0207-44d0-aab6-e0f42dcb827d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:31.464562 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f886db5f-0207-44d0-aab6-e0f42dcb827d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:31.603105 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-f886db5f-0207-44d0-aab6-e0f42dcb827d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:31.610311 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f886db5f-0207-44d0-aab6-e0f42dcb827d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.158473 Nov 02 23:07:31.610881 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 36/67] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:31 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:31.673333 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ff32a8ff-4869-475a-94d8-cc80118e2834 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:31.673938 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ff32a8ff-4869-475a-94d8-cc80118e2834 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:31.679487 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-c76ea6a9-dfec-4daa-a8a8-cfc6272f18de tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:31.680090 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-c76ea6a9-dfec-4daa-a8a8-cfc6272f18de tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:31.680491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff32a8ff-4869-475a-94d8-cc80118e2834 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:31.680941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff32a8ff-4869-475a-94d8-cc80118e2834 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:31.681703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff32a8ff-4869-475a-94d8-cc80118e2834 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:31.682133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff32a8ff-4869-475a-94d8-cc80118e2834 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:31.685909 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c76ea6a9-dfec-4daa-a8a8-cfc6272f18de tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:31.686356 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c76ea6a9-dfec-4daa-a8a8-cfc6272f18de tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:31.687155 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c76ea6a9-dfec-4daa-a8a8-cfc6272f18de tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:31.687589 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c76ea6a9-dfec-4daa-a8a8-cfc6272f18de tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:31.745839 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-c76ea6a9-dfec-4daa-a8a8-cfc6272f18de tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:31.753610 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-c76ea6a9-dfec-4daa-a8a8-cfc6272f18de tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:31.755150 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-c76ea6a9-dfec-4daa-a8a8-cfc6272f18de tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:31.756243 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-c76ea6a9-dfec-4daa-a8a8-cfc6272f18de tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1285 microversion: 2.20 time: 0.080851 Nov 02 23:07:31.756803 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 37/68] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:31 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1285 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:07:31.760968 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-6f32e88b-bb29-4ac8-862a-3169a8df0938 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd8584f4040>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:31.806905 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-6f32e88b-bb29-4ac8-862a-3169a8df0938 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9" status: 200 len: 344 microversion: 2.1 time: 0.049047 Nov 02 23:07:31.807499 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 38/69] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:31 2021] GET /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9 => generated 344 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:31.814316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ff32a8ff-4869-475a-94d8-cc80118e2834 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:31.822044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ff32a8ff-4869-475a-94d8-cc80118e2834 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.152219 Nov 02 23:07:31.822650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 32/70] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:31 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:32.012113 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-2ff4eb22-ce5d-4ef0-a6a6-710333372c71 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:32.012646 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-2ff4eb22-ce5d-4ef0-a6a6-710333372c71 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:32.018983 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2ff4eb22-ce5d-4ef0-a6a6-710333372c71 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:32.019443 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2ff4eb22-ce5d-4ef0-a6a6-710333372c71 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:32.020244 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2ff4eb22-ce5d-4ef0-a6a6-710333372c71 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:32.020675 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2ff4eb22-ce5d-4ef0-a6a6-710333372c71 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:32.152195 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-2ff4eb22-ce5d-4ef0-a6a6-710333372c71 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:32.159623 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-2ff4eb22-ce5d-4ef0-a6a6-710333372c71 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.151218 Nov 02 23:07:32.160383 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 39/71] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:32 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:32.627767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9f44d2b1-1d69-470c-8074-7543c5c38ae9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:32.628476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9f44d2b1-1d69-470c-8074-7543c5c38ae9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:32.634857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f44d2b1-1d69-470c-8074-7543c5c38ae9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:32.635466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f44d2b1-1d69-470c-8074-7543c5c38ae9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:32.636351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f44d2b1-1d69-470c-8074-7543c5c38ae9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:32.637025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f44d2b1-1d69-470c-8074-7543c5c38ae9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:32.773879 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-8d3c5927-c5a3-46c0-ab17-0f3075ce3601 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:32.774491 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-8d3c5927-c5a3-46c0-ab17-0f3075ce3601 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:32.775778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9f44d2b1-1d69-470c-8074-7543c5c38ae9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:32.787572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9f44d2b1-1d69-470c-8074-7543c5c38ae9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.163466 Nov 02 23:07:32.788324 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8d3c5927-c5a3-46c0-ab17-0f3075ce3601 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:32.788669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 33/72] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:32 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:32.788948 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8d3c5927-c5a3-46c0-ab17-0f3075ce3601 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:32.789859 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8d3c5927-c5a3-46c0-ab17-0f3075ce3601 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:32.790291 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8d3c5927-c5a3-46c0-ab17-0f3075ce3601 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:32.822743 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4059c714-2e67-43fe-9766-56268df61155 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd858536310>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:32.864056 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-8d3c5927-c5a3-46c0-ab17-0f3075ce3601 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:32.872300 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-8d3c5927-c5a3-46c0-ab17-0f3075ce3601 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:32.873061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4059c714-2e67-43fe-9766-56268df61155 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9" status: 200 len: 344 microversion: 2.1 time: 0.057073 Nov 02 23:07:32.873637 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 34/73] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:32 2021] GET /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:07:32.873815 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-8d3c5927-c5a3-46c0-ab17-0f3075ce3601 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:32.875117 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-8d3c5927-c5a3-46c0-ab17-0f3075ce3601 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1285 microversion: 2.20 time: 0.105072 Nov 02 23:07:32.875831 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 40/74] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:32 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:07:32.877956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-12db7bba-f35a-42ee-9963-67a1ee11f96c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:32.878498 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-12db7bba-f35a-42ee-9963-67a1ee11f96c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:32.884568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-12db7bba-f35a-42ee-9963-67a1ee11f96c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:32.885013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-12db7bba-f35a-42ee-9963-67a1ee11f96c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:32.885778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-12db7bba-f35a-42ee-9963-67a1ee11f96c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:32.886201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-12db7bba-f35a-42ee-9963-67a1ee11f96c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:33.013999 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-12db7bba-f35a-42ee-9963-67a1ee11f96c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:33.021306 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-12db7bba-f35a-42ee-9963-67a1ee11f96c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.146722 Nov 02 23:07:33.021868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 35/75] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:32 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:33.176606 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-776adae7-fb91-4e84-b478-ae54a62aa5a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:33.177158 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-776adae7-fb91-4e84-b478-ae54a62aa5a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:33.183437 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-776adae7-fb91-4e84-b478-ae54a62aa5a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:33.183882 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-776adae7-fb91-4e84-b478-ae54a62aa5a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:33.184660 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-776adae7-fb91-4e84-b478-ae54a62aa5a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:33.185086 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-776adae7-fb91-4e84-b478-ae54a62aa5a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:33.326522 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-776adae7-fb91-4e84-b478-ae54a62aa5a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:33.335579 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-776adae7-fb91-4e84-b478-ae54a62aa5a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.162611 Nov 02 23:07:33.336351 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 41/76] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:33 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:33.804464 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1d37848d-eae3-46fa-88ab-91b8a914bf4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:33.805053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1d37848d-eae3-46fa-88ab-91b8a914bf4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:33.810800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d37848d-eae3-46fa-88ab-91b8a914bf4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:33.811322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d37848d-eae3-46fa-88ab-91b8a914bf4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:33.812091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d37848d-eae3-46fa-88ab-91b8a914bf4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:33.812525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d37848d-eae3-46fa-88ab-91b8a914bf4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:33.885436 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-3bb4cb5b-7911-45ff-b646-7604ec309968 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd858531c10>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:33.949417 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-3bb4cb5b-7911-45ff-b646-7604ec309968 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9" status: 200 len: 344 microversion: 2.1 time: 0.067570 Nov 02 23:07:33.950265 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 42/77] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:33 2021] GET /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9 => generated 344 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:07:33.955061 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-93ccefe7-671a-42d5-8882-a19a6d056604 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:33.955831 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-93ccefe7-671a-42d5-8882-a19a6d056604 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:33.957914 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1d37848d-eae3-46fa-88ab-91b8a914bf4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:33.963018 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-93ccefe7-671a-42d5-8882-a19a6d056604 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:33.963474 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-93ccefe7-671a-42d5-8882-a19a6d056604 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:33.964253 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-93ccefe7-671a-42d5-8882-a19a6d056604 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:33.964686 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-93ccefe7-671a-42d5-8882-a19a6d056604 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:33.966406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1d37848d-eae3-46fa-88ab-91b8a914bf4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.165641 Nov 02 23:07:33.967248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 36/78] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:33 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:34.040339 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-93ccefe7-671a-42d5-8882-a19a6d056604 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:34.041194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cd70d7b2-d68a-4f98-bbbb-2ffcc36969e2 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:34.041996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cd70d7b2-d68a-4f98-bbbb-2ffcc36969e2 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:34.048332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd70d7b2-d68a-4f98-bbbb-2ffcc36969e2 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:34.048884 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-93ccefe7-671a-42d5-8882-a19a6d056604 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:34.049056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd70d7b2-d68a-4f98-bbbb-2ffcc36969e2 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:34.050040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd70d7b2-d68a-4f98-bbbb-2ffcc36969e2 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:34.050567 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-93ccefe7-671a-42d5-8882-a19a6d056604 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:34.050689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd70d7b2-d68a-4f98-bbbb-2ffcc36969e2 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:34.051777 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-93ccefe7-671a-42d5-8882-a19a6d056604 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1285 microversion: 2.20 time: 0.100197 Nov 02 23:07:34.052397 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 43/79] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:33 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:07:34.211684 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cd70d7b2-d68a-4f98-bbbb-2ffcc36969e2 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:34.218959 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cd70d7b2-d68a-4f98-bbbb-2ffcc36969e2 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.181983 Nov 02 23:07:34.219846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 37/80] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:34 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:07:34.354487 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-7c1f8182-eaa1-45e1-8964-d584973d7a78 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:34.355663 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-7c1f8182-eaa1-45e1-8964-d584973d7a78 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:34.377501 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7c1f8182-eaa1-45e1-8964-d584973d7a78 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:34.377881 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7c1f8182-eaa1-45e1-8964-d584973d7a78 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:34.378696 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7c1f8182-eaa1-45e1-8964-d584973d7a78 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:34.379114 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7c1f8182-eaa1-45e1-8964-d584973d7a78 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:34.624598 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-7c1f8182-eaa1-45e1-8964-d584973d7a78 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:34.645525 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-7c1f8182-eaa1-45e1-8964-d584973d7a78 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.290748 Nov 02 23:07:34.646904 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 44/81] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:34 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:34.962319 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ea9789fc-5019-4ad1-89c2-f77420cc394b tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd85852a8b0>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:34.984031 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-561594cc-6967-44f8-8720-5eb3d6006919 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:34.984641 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-561594cc-6967-44f8-8720-5eb3d6006919 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:34.992830 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-561594cc-6967-44f8-8720-5eb3d6006919 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:34.993148 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-561594cc-6967-44f8-8720-5eb3d6006919 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:34.994173 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-561594cc-6967-44f8-8720-5eb3d6006919 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:34.994603 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-561594cc-6967-44f8-8720-5eb3d6006919 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:34.995080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-ea9789fc-5019-4ad1-89c2-f77420cc394b tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] HTTP exception thrown: Volume 646ecc58-0bd6-4d23-a141-be00bcd1dfe9 could not be found. Nov 02 23:07:34.995739 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ea9789fc-5019-4ad1-89c2-f77420cc394b tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Returning 404 to user: Volume 646ecc58-0bd6-4d23-a141-be00bcd1dfe9 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:07:34.996632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ea9789fc-5019-4ad1-89c2-f77420cc394b tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9" status: 404 len: 109 microversion: 2.1 time: 0.038130 Nov 02 23:07:34.997408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 38/82] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:34 2021] GET /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 23:07:35.012382 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-baa5ac87-cb5b-460e-bc4a-20be968b8999 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd8584eb8b0>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:35.044766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-baa5ac87-cb5b-460e-bc4a-20be968b8999 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] HTTP exception thrown: Volume 646ecc58-0bd6-4d23-a141-be00bcd1dfe9 could not be found. Nov 02 23:07:35.045816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-baa5ac87-cb5b-460e-bc4a-20be968b8999 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Returning 404 to user: Volume 646ecc58-0bd6-4d23-a141-be00bcd1dfe9 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:07:35.046210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-baa5ac87-cb5b-460e-bc4a-20be968b8999 tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9" status: 404 len: 109 microversion: 2.1 time: 0.043504 Nov 02 23:07:35.050577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 39/83] 10.222.0.41 () {58 vars in 1247 bytes} [Tue Nov 2 23:07:35 2021] DELETE /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 23:07:35.055958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6e1101b5-522e-4831-b5e3-d76a97afbfbb tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Calling method '.version_select at 0x7fd8584b3e50>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:35.084277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-6e1101b5-522e-4831-b5e3-d76a97afbfbb tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] HTTP exception thrown: Volume 646ecc58-0bd6-4d23-a141-be00bcd1dfe9 could not be found. Nov 02 23:07:35.085619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6e1101b5-522e-4831-b5e3-d76a97afbfbb tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] Returning 404 to user: Volume 646ecc58-0bd6-4d23-a141-be00bcd1dfe9 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:07:35.086518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6e1101b5-522e-4831-b5e3-d76a97afbfbb tempest-VolumesSnapshotsTestJSON-1825495568 tempest-VolumesSnapshotsTestJSON-1825495568-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9" status: 404 len: 109 microversion: 2.1 time: 0.034930 Nov 02 23:07:35.087178 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 40/84] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:35 2021] GET /compute/v2.1/os-volumes/646ecc58-0bd6-4d23-a141-be00bcd1dfe9 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 23:07:35.095563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0276e57a-85a5-4b4a-aacf-850c9a3ab00b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:35.096174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0276e57a-85a5-4b4a-aacf-850c9a3ab00b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:35.102362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0276e57a-85a5-4b4a-aacf-850c9a3ab00b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:35.102816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0276e57a-85a5-4b4a-aacf-850c9a3ab00b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:35.103626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0276e57a-85a5-4b4a-aacf-850c9a3ab00b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:35.104218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0276e57a-85a5-4b4a-aacf-850c9a3ab00b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:35.178139 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-561594cc-6967-44f8-8720-5eb3d6006919 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:35.191155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0276e57a-85a5-4b4a-aacf-850c9a3ab00b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:35.191734 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-561594cc-6967-44f8-8720-5eb3d6006919 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.211481 Nov 02 23:07:35.192308 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 45/85] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:34 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:35.200824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0276e57a-85a5-4b4a-aacf-850c9a3ab00b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:35.202562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0276e57a-85a5-4b4a-aacf-850c9a3ab00b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:35.203860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0276e57a-85a5-4b4a-aacf-850c9a3ab00b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1285 microversion: 2.20 time: 0.112082 Nov 02 23:07:35.204384 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 41/86] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:35 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:07:35.236508 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a019f45e-93d3-4aba-96fa-28fd40b68351 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:35.237450 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a019f45e-93d3-4aba-96fa-28fd40b68351 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:35.252436 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a019f45e-93d3-4aba-96fa-28fd40b68351 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:35.252976 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a019f45e-93d3-4aba-96fa-28fd40b68351 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:35.253833 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a019f45e-93d3-4aba-96fa-28fd40b68351 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:35.254358 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a019f45e-93d3-4aba-96fa-28fd40b68351 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:35.405080 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-a019f45e-93d3-4aba-96fa-28fd40b68351 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:35.412540 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a019f45e-93d3-4aba-96fa-28fd40b68351 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.179688 Nov 02 23:07:35.413697 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 46/87] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:35 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:35.676724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-60ab5c64-31f5-4a46-bbd9-f5147af290f9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:35.677350 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-60ab5c64-31f5-4a46-bbd9-f5147af290f9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:35.683563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-60ab5c64-31f5-4a46-bbd9-f5147af290f9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:35.685232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-60ab5c64-31f5-4a46-bbd9-f5147af290f9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:35.685232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-60ab5c64-31f5-4a46-bbd9-f5147af290f9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:35.685508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-60ab5c64-31f5-4a46-bbd9-f5147af290f9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:35.894074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-60ab5c64-31f5-4a46-bbd9-f5147af290f9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:35.904407 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-60ab5c64-31f5-4a46-bbd9-f5147af290f9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.241666 Nov 02 23:07:35.905085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 42/88] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:35 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:36.208587 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-3a365979-c352-4a95-aea9-eca111a94e2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:36.209280 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-3a365979-c352-4a95-aea9-eca111a94e2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:36.216041 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-3a365979-c352-4a95-aea9-eca111a94e2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:36.216498 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-3a365979-c352-4a95-aea9-eca111a94e2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:36.217402 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-3a365979-c352-4a95-aea9-eca111a94e2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:36.217713 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-3a365979-c352-4a95-aea9-eca111a94e2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:36.221385 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0e9f3f61-1517-475f-aa42-2877a54da512 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:36.222013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0e9f3f61-1517-475f-aa42-2877a54da512 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:36.228432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e9f3f61-1517-475f-aa42-2877a54da512 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:36.228875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e9f3f61-1517-475f-aa42-2877a54da512 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:36.229643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e9f3f61-1517-475f-aa42-2877a54da512 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:36.230072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e9f3f61-1517-475f-aa42-2877a54da512 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:36.297289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0e9f3f61-1517-475f-aa42-2877a54da512 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:36.306289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0e9f3f61-1517-475f-aa42-2877a54da512 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:36.307831 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0e9f3f61-1517-475f-aa42-2877a54da512 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:36.309069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0e9f3f61-1517-475f-aa42-2877a54da512 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1285 microversion: 2.20 time: 0.091392 Nov 02 23:07:36.309973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 43/89] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:36 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:07:36.355582 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-3a365979-c352-4a95-aea9-eca111a94e2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:36.362677 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-3a365979-c352-4a95-aea9-eca111a94e2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.157944 Nov 02 23:07:36.363301 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 47/90] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:36 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:07:36.434902 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-82f7ae70-c9c7-4d07-a2be-ed2c4dcaac4c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:36.435536 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-82f7ae70-c9c7-4d07-a2be-ed2c4dcaac4c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:36.441265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82f7ae70-c9c7-4d07-a2be-ed2c4dcaac4c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:36.441724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82f7ae70-c9c7-4d07-a2be-ed2c4dcaac4c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:36.442530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82f7ae70-c9c7-4d07-a2be-ed2c4dcaac4c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:36.443054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82f7ae70-c9c7-4d07-a2be-ed2c4dcaac4c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:36.582660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-82f7ae70-c9c7-4d07-a2be-ed2c4dcaac4c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:36.592976 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-82f7ae70-c9c7-4d07-a2be-ed2c4dcaac4c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.161286 Nov 02 23:07:36.594052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 44/91] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:36 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:36.771206 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e2b96fc8-48f3-416a-9661-6803ed80a1d4 tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] Action: 'create', calling method: .version_select at 0x7fd858505700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2050255100", "metadata": {"Type": "work"}}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:07:36.923073 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-739a9935-eccb-402e-9b3c-2d05619487dc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:36.923692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-739a9935-eccb-402e-9b3c-2d05619487dc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:36.930295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-739a9935-eccb-402e-9b3c-2d05619487dc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:36.930742 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-739a9935-eccb-402e-9b3c-2d05619487dc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:36.931539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-739a9935-eccb-402e-9b3c-2d05619487dc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:36.931973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-739a9935-eccb-402e-9b3c-2d05619487dc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:37.055436 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e2b96fc8-48f3-416a-9661-6803ed80a1d4 tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.420030 Nov 02 23:07:37.056055 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 48/92] 10.222.0.41 () {60 vars in 1155 bytes} [Tue Nov 2 23:07:36 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 421 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 02 23:07:37.066357 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-748d0ab6-d8f5-443e-8479-7b1bf7fa3ada tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] Calling method '.version_select at 0x7fd8584848b0>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:37.115260 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-748d0ab6-d8f5-443e-8479-7b1bf7fa3ada tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/b4885520-3643-4a2c-91cd-ed23b557be88" status: 200 len: 353 microversion: 2.1 time: 0.052281 Nov 02 23:07:37.115957 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 49/93] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:37 2021] GET /compute/v2.1/os-volumes/b4885520-3643-4a2c-91cd-ed23b557be88 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:07:37.121000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-739a9935-eccb-402e-9b3c-2d05619487dc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:37.128204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-739a9935-eccb-402e-9b3c-2d05619487dc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.209135 Nov 02 23:07:37.128774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 45/94] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:36 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:07:37.327601 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f7ae0cf5-a8af-428b-a205-c7063e7f1f17 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:37.328210 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f7ae0cf5-a8af-428b-a205-c7063e7f1f17 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:37.336188 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f7ae0cf5-a8af-428b-a205-c7063e7f1f17 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:37.336946 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f7ae0cf5-a8af-428b-a205-c7063e7f1f17 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:37.337801 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f7ae0cf5-a8af-428b-a205-c7063e7f1f17 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:37.338318 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f7ae0cf5-a8af-428b-a205-c7063e7f1f17 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:37.380071 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-148c0e93-c905-46c5-aacc-26125823a47e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:37.381542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-148c0e93-c905-46c5-aacc-26125823a47e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:37.387505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-148c0e93-c905-46c5-aacc-26125823a47e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:37.387946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-148c0e93-c905-46c5-aacc-26125823a47e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:37.388712 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-148c0e93-c905-46c5-aacc-26125823a47e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:37.389137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-148c0e93-c905-46c5-aacc-26125823a47e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:37.398828 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-f7ae0cf5-a8af-428b-a205-c7063e7f1f17 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:37.407030 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-f7ae0cf5-a8af-428b-a205-c7063e7f1f17 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:37.408834 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-f7ae0cf5-a8af-428b-a205-c7063e7f1f17 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:37.409941 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f7ae0cf5-a8af-428b-a205-c7063e7f1f17 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1285 microversion: 2.20 time: 0.086218 Nov 02 23:07:37.410490 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 50/95] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:37 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:07:37.533332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-148c0e93-c905-46c5-aacc-26125823a47e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:37.541453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-148c0e93-c905-46c5-aacc-26125823a47e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.165026 Nov 02 23:07:37.542034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 46/96] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:37 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:07:37.611093 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ddc6a8be-9bbd-41bd-8641-3033afc00205 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:37.611618 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ddc6a8be-9bbd-41bd-8641-3033afc00205 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:37.617481 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ddc6a8be-9bbd-41bd-8641-3033afc00205 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:37.617919 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ddc6a8be-9bbd-41bd-8641-3033afc00205 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:37.618677 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ddc6a8be-9bbd-41bd-8641-3033afc00205 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:37.619143 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ddc6a8be-9bbd-41bd-8641-3033afc00205 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:37.889168 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-ddc6a8be-9bbd-41bd-8641-3033afc00205 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:37.900722 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ddc6a8be-9bbd-41bd-8641-3033afc00205 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.293185 Nov 02 23:07:37.901664 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 51/97] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:37 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:38.129062 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-09fd9de4-e75b-4e7e-97fa-21381b124b3e tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] Calling method '.version_select at 0x7fd8584eb1f0>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:38.144894 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-eb759868-94af-406c-8dd3-f72ba185f57b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:38.145575 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-eb759868-94af-406c-8dd3-f72ba185f57b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:38.152725 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-eb759868-94af-406c-8dd3-f72ba185f57b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:38.153178 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-eb759868-94af-406c-8dd3-f72ba185f57b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:38.153977 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-eb759868-94af-406c-8dd3-f72ba185f57b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:38.154473 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-eb759868-94af-406c-8dd3-f72ba185f57b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:38.182080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-09fd9de4-e75b-4e7e-97fa-21381b124b3e tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/b4885520-3643-4a2c-91cd-ed23b557be88" status: 200 len: 353 microversion: 2.1 time: 0.057407 Nov 02 23:07:38.187511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 47/98] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:38 2021] GET /compute/v2.1/os-volumes/b4885520-3643-4a2c-91cd-ed23b557be88 => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:07:38.287270 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-eb759868-94af-406c-8dd3-f72ba185f57b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:38.294660 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-eb759868-94af-406c-8dd3-f72ba185f57b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.153757 Nov 02 23:07:38.295526 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 52/99] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:38 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:38.428148 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-087a6bef-a07c-4bd8-b150-fe23e3ca701e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:38.429163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-087a6bef-a07c-4bd8-b150-fe23e3ca701e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:38.435196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-087a6bef-a07c-4bd8-b150-fe23e3ca701e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:38.435642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-087a6bef-a07c-4bd8-b150-fe23e3ca701e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:38.436407 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-087a6bef-a07c-4bd8-b150-fe23e3ca701e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:38.436839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-087a6bef-a07c-4bd8-b150-fe23e3ca701e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:38.497686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-087a6bef-a07c-4bd8-b150-fe23e3ca701e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:38.505351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-087a6bef-a07c-4bd8-b150-fe23e3ca701e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:38.506844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-087a6bef-a07c-4bd8-b150-fe23e3ca701e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:38.507954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-087a6bef-a07c-4bd8-b150-fe23e3ca701e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1285 microversion: 2.20 time: 0.083640 Nov 02 23:07:38.508501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 48/100] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:38 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1285 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:07:38.557866 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-83cc63fe-3ee9-4782-81b6-a5ee88472111 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:38.558602 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-83cc63fe-3ee9-4782-81b6-a5ee88472111 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:38.565461 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-83cc63fe-3ee9-4782-81b6-a5ee88472111 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:38.565893 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-83cc63fe-3ee9-4782-81b6-a5ee88472111 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:38.566672 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-83cc63fe-3ee9-4782-81b6-a5ee88472111 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:38.567134 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-83cc63fe-3ee9-4782-81b6-a5ee88472111 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:38.694402 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-83cc63fe-3ee9-4782-81b6-a5ee88472111 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:38.701753 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-83cc63fe-3ee9-4782-81b6-a5ee88472111 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.148090 Nov 02 23:07:38.702317 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 53/101] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:38 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:38.918328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-92c9d76f-2d8b-4bb3-a059-f54a543f4ead tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:38.919067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-92c9d76f-2d8b-4bb3-a059-f54a543f4ead tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:38.925084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92c9d76f-2d8b-4bb3-a059-f54a543f4ead tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:38.925522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92c9d76f-2d8b-4bb3-a059-f54a543f4ead tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:38.926286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92c9d76f-2d8b-4bb3-a059-f54a543f4ead tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:38.926882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92c9d76f-2d8b-4bb3-a059-f54a543f4ead tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:39.056842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-92c9d76f-2d8b-4bb3-a059-f54a543f4ead tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:39.066932 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-92c9d76f-2d8b-4bb3-a059-f54a543f4ead tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.152240 Nov 02 23:07:39.067756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 49/102] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:38 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:07:39.193723 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-28c6a397-966d-4ef0-9611-d3998721c79a tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] Calling method '.version_select at 0x7fd858531670>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:39.273883 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-28c6a397-966d-4ef0-9611-d3998721c79a tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/b4885520-3643-4a2c-91cd-ed23b557be88" status: 200 len: 353 microversion: 2.1 time: 0.083880 Nov 02 23:07:39.274473 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 54/103] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:39 2021] GET /compute/v2.1/os-volumes/b4885520-3643-4a2c-91cd-ed23b557be88 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:39.312109 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4f1e12f1-b3cd-467b-8969-cef784ae9d70 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:39.312723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4f1e12f1-b3cd-467b-8969-cef784ae9d70 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:39.319624 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f1e12f1-b3cd-467b-8969-cef784ae9d70 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:39.320072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f1e12f1-b3cd-467b-8969-cef784ae9d70 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:39.320855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f1e12f1-b3cd-467b-8969-cef784ae9d70 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:39.321286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f1e12f1-b3cd-467b-8969-cef784ae9d70 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:39.458074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4f1e12f1-b3cd-467b-8969-cef784ae9d70 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:39.466184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4f1e12f1-b3cd-467b-8969-cef784ae9d70 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.157726 Nov 02 23:07:39.466762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 50/104] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:39 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:39.526059 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e7d6d798-f1c7-430b-ac16-a8f071436d01 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:39.526584 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e7d6d798-f1c7-430b-ac16-a8f071436d01 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:39.532588 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e7d6d798-f1c7-430b-ac16-a8f071436d01 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:39.533032 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e7d6d798-f1c7-430b-ac16-a8f071436d01 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:39.533804 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e7d6d798-f1c7-430b-ac16-a8f071436d01 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:39.534235 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e7d6d798-f1c7-430b-ac16-a8f071436d01 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:39.594948 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e7d6d798-f1c7-430b-ac16-a8f071436d01 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:39.602499 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e7d6d798-f1c7-430b-ac16-a8f071436d01 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:39.604006 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e7d6d798-f1c7-430b-ac16-a8f071436d01 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:39.605098 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e7d6d798-f1c7-430b-ac16-a8f071436d01 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1285 microversion: 2.20 time: 0.083396 Nov 02 23:07:39.605840 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 55/105] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:39 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:07:39.718528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-738dc773-879e-45e4-b5da-aea172814dad tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:39.719159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-738dc773-879e-45e4-b5da-aea172814dad tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:39.725949 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-738dc773-879e-45e4-b5da-aea172814dad tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:39.726397 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-738dc773-879e-45e4-b5da-aea172814dad tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:39.727203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-738dc773-879e-45e4-b5da-aea172814dad tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:39.727636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-738dc773-879e-45e4-b5da-aea172814dad tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:39.873620 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-738dc773-879e-45e4-b5da-aea172814dad tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:39.881277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-738dc773-879e-45e4-b5da-aea172814dad tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.166275 Nov 02 23:07:39.882115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 51/106] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:39 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:40.083693 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f9fda3e8-91a4-46c5-ae90-8b4ebdca5165 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:40.084243 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f9fda3e8-91a4-46c5-ae90-8b4ebdca5165 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:40.090832 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f9fda3e8-91a4-46c5-ae90-8b4ebdca5165 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:40.091398 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f9fda3e8-91a4-46c5-ae90-8b4ebdca5165 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:40.092293 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f9fda3e8-91a4-46c5-ae90-8b4ebdca5165 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:40.092838 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f9fda3e8-91a4-46c5-ae90-8b4ebdca5165 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:40.221287 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-f9fda3e8-91a4-46c5-ae90-8b4ebdca5165 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:40.228675 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f9fda3e8-91a4-46c5-ae90-8b4ebdca5165 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.148956 Nov 02 23:07:40.229443 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 56/107] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:40 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:40.285973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e6ff9d0f-0057-4109-8fa4-3076a3618a6c tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] Calling method '.version_select at 0x7fd85852a430>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:40.330253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e6ff9d0f-0057-4109-8fa4-3076a3618a6c tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/b4885520-3643-4a2c-91cd-ed23b557be88" status: 200 len: 353 microversion: 2.1 time: 0.047815 Nov 02 23:07:40.330819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 52/108] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:40 2021] GET /compute/v2.1/os-volumes/b4885520-3643-4a2c-91cd-ed23b557be88 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:40.482528 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ca3a93b7-d1a0-4591-bfe6-a938056d0f30 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:40.483172 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ca3a93b7-d1a0-4591-bfe6-a938056d0f30 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:40.489039 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ca3a93b7-d1a0-4591-bfe6-a938056d0f30 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:40.489483 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ca3a93b7-d1a0-4591-bfe6-a938056d0f30 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:40.490235 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ca3a93b7-d1a0-4591-bfe6-a938056d0f30 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:40.490660 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ca3a93b7-d1a0-4591-bfe6-a938056d0f30 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:40.622872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e6785785-1d4e-42e0-a473-ebf9317c7d1b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:40.623471 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e6785785-1d4e-42e0-a473-ebf9317c7d1b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:40.629182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e6785785-1d4e-42e0-a473-ebf9317c7d1b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:40.629598 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-ca3a93b7-d1a0-4591-bfe6-a938056d0f30 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:40.630116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e6785785-1d4e-42e0-a473-ebf9317c7d1b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:40.630385 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e6785785-1d4e-42e0-a473-ebf9317c7d1b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:40.630816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e6785785-1d4e-42e0-a473-ebf9317c7d1b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:40.637801 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ca3a93b7-d1a0-4591-bfe6-a938056d0f30 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.158822 Nov 02 23:07:40.638467 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 57/109] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:40 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:40.688685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e6785785-1d4e-42e0-a473-ebf9317c7d1b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:40.697300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e6785785-1d4e-42e0-a473-ebf9317c7d1b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:40.698802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e6785785-1d4e-42e0-a473-ebf9317c7d1b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:40.699924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e6785785-1d4e-42e0-a473-ebf9317c7d1b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1285 microversion: 2.20 time: 0.080898 Nov 02 23:07:40.700497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 53/110] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:40 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1285 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:07:40.897285 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b46c4012-efa9-4dfc-9b27-bc8263cf28fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:40.897829 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b46c4012-efa9-4dfc-9b27-bc8263cf28fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:40.903807 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b46c4012-efa9-4dfc-9b27-bc8263cf28fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:40.904255 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b46c4012-efa9-4dfc-9b27-bc8263cf28fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:40.905057 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b46c4012-efa9-4dfc-9b27-bc8263cf28fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:40.905490 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b46c4012-efa9-4dfc-9b27-bc8263cf28fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:41.031702 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-b46c4012-efa9-4dfc-9b27-bc8263cf28fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:41.039303 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b46c4012-efa9-4dfc-9b27-bc8263cf28fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.145644 Nov 02 23:07:41.039877 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 58/111] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:40 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:41.248909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9c2e321f-ed71-44b1-9586-0d94a3a3af90 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:41.248909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9c2e321f-ed71-44b1-9586-0d94a3a3af90 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:41.262543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c2e321f-ed71-44b1-9586-0d94a3a3af90 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:41.262543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c2e321f-ed71-44b1-9586-0d94a3a3af90 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:41.262543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c2e321f-ed71-44b1-9586-0d94a3a3af90 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:41.262543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c2e321f-ed71-44b1-9586-0d94a3a3af90 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:41.346544 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a24cd23c-57bb-45e5-bcce-fca5af029f85 tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] Calling method '.version_select at 0x7fd8584f4040>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:41.433317 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a24cd23c-57bb-45e5-bcce-fca5af029f85 tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/b4885520-3643-4a2c-91cd-ed23b557be88" status: 200 len: 353 microversion: 2.1 time: 0.093212 Nov 02 23:07:41.433893 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 59/112] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:41 2021] GET /compute/v2.1/os-volumes/b4885520-3643-4a2c-91cd-ed23b557be88 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:07:41.448988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9c2e321f-ed71-44b1-9586-0d94a3a3af90 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:41.456539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9c2e321f-ed71-44b1-9586-0d94a3a3af90 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.214363 Nov 02 23:07:41.457121 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 54/113] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:41 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:41.654837 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-5dbc78d9-460b-49c4-aba7-50080d2edb7c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:41.655470 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-5dbc78d9-460b-49c4-aba7-50080d2edb7c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:41.661430 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5dbc78d9-460b-49c4-aba7-50080d2edb7c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:41.661878 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5dbc78d9-460b-49c4-aba7-50080d2edb7c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:41.663184 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5dbc78d9-460b-49c4-aba7-50080d2edb7c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:41.663619 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5dbc78d9-460b-49c4-aba7-50080d2edb7c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:41.717454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4f76e1d0-249f-4f2b-b4c8-3564f62247e6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:41.718154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4f76e1d0-249f-4f2b-b4c8-3564f62247e6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:41.724356 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f76e1d0-249f-4f2b-b4c8-3564f62247e6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:41.724789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f76e1d0-249f-4f2b-b4c8-3564f62247e6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:41.726081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f76e1d0-249f-4f2b-b4c8-3564f62247e6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:41.726657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f76e1d0-249f-4f2b-b4c8-3564f62247e6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:41.790075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4f76e1d0-249f-4f2b-b4c8-3564f62247e6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:41.803427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4f76e1d0-249f-4f2b-b4c8-3564f62247e6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:41.805219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4f76e1d0-249f-4f2b-b4c8-3564f62247e6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:41.806534 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4f76e1d0-249f-4f2b-b4c8-3564f62247e6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1285 microversion: 2.20 time: 0.092755 Nov 02 23:07:41.807654 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 55/114] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:41 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:07:41.821596 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-5dbc78d9-460b-49c4-aba7-50080d2edb7c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:41.829205 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-5dbc78d9-460b-49c4-aba7-50080d2edb7c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.178132 Nov 02 23:07:41.829790 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 60/115] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:41 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:42.057767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ac0bad62-bc4c-4d6f-b9d2-513efbde6ed2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:42.058414 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ac0bad62-bc4c-4d6f-b9d2-513efbde6ed2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:42.064443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac0bad62-bc4c-4d6f-b9d2-513efbde6ed2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:42.064892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac0bad62-bc4c-4d6f-b9d2-513efbde6ed2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:42.065664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac0bad62-bc4c-4d6f-b9d2-513efbde6ed2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:42.066093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac0bad62-bc4c-4d6f-b9d2-513efbde6ed2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:42.194470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ac0bad62-bc4c-4d6f-b9d2-513efbde6ed2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:42.201734 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ac0bad62-bc4c-4d6f-b9d2-513efbde6ed2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.149286 Nov 02 23:07:42.202299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 56/116] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:42 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:42.445279 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-c92e917e-d6ab-459d-bc16-b23598c5b3e4 tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] Calling method '.version_select at 0x7fd858531dc0>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:42.472985 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-73026654-a8bf-4f52-a748-3ff04db934da tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:42.473564 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-73026654-a8bf-4f52-a748-3ff04db934da tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:42.480083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73026654-a8bf-4f52-a748-3ff04db934da tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:42.480520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73026654-a8bf-4f52-a748-3ff04db934da tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:42.481279 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73026654-a8bf-4f52-a748-3ff04db934da tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:42.481704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73026654-a8bf-4f52-a748-3ff04db934da tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:42.491541 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-c92e917e-d6ab-459d-bc16-b23598c5b3e4 tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/b4885520-3643-4a2c-91cd-ed23b557be88" status: 200 len: 353 microversion: 2.1 time: 0.049140 Nov 02 23:07:42.492127 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 61/117] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:42 2021] GET /compute/v2.1/os-volumes/b4885520-3643-4a2c-91cd-ed23b557be88 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:42.608793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-73026654-a8bf-4f52-a748-3ff04db934da tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:42.617114 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-73026654-a8bf-4f52-a748-3ff04db934da tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.147708 Nov 02 23:07:42.617672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 57/118] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:42 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:07:42.824196 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-2984ec0f-539e-49d0-b352-2638033c564e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:42.824737 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-2984ec0f-539e-49d0-b352-2638033c564e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:42.830642 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2984ec0f-539e-49d0-b352-2638033c564e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:42.831131 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2984ec0f-539e-49d0-b352-2638033c564e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:42.832163 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2984ec0f-539e-49d0-b352-2638033c564e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:42.832598 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2984ec0f-539e-49d0-b352-2638033c564e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:42.845210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6411dcca-68fa-4268-ab1e-ff7f66d70eda tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:42.845814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6411dcca-68fa-4268-ab1e-ff7f66d70eda tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:42.852070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6411dcca-68fa-4268-ab1e-ff7f66d70eda tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:42.852563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6411dcca-68fa-4268-ab1e-ff7f66d70eda tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:42.853328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6411dcca-68fa-4268-ab1e-ff7f66d70eda tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:42.853812 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6411dcca-68fa-4268-ab1e-ff7f66d70eda tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:42.895586 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-2984ec0f-539e-49d0-b352-2638033c564e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:42.903812 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-2984ec0f-539e-49d0-b352-2638033c564e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:42.905310 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-2984ec0f-539e-49d0-b352-2638033c564e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:42.906405 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-2984ec0f-539e-49d0-b352-2638033c564e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1285 microversion: 2.20 time: 0.086035 Nov 02 23:07:42.906998 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 62/119] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:42 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:07:42.983555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6411dcca-68fa-4268-ab1e-ff7f66d70eda tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:42.990598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6411dcca-68fa-4268-ab1e-ff7f66d70eda tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.148984 Nov 02 23:07:42.991198 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 58/120] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:42 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:07:43.217713 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-373aa134-7cb6-4dd5-89ff-190025c9553b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:43.218324 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-373aa134-7cb6-4dd5-89ff-190025c9553b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:43.224245 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-373aa134-7cb6-4dd5-89ff-190025c9553b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:43.224694 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-373aa134-7cb6-4dd5-89ff-190025c9553b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:43.225956 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-373aa134-7cb6-4dd5-89ff-190025c9553b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:43.226512 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-373aa134-7cb6-4dd5-89ff-190025c9553b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:43.363225 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-373aa134-7cb6-4dd5-89ff-190025c9553b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:43.375936 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-373aa134-7cb6-4dd5-89ff-190025c9553b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.161811 Nov 02 23:07:43.385579 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 63/121] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:43 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:43.504126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1e17a8fd-18ba-4244-9d4f-16a32b88a18a tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] Calling method '.version_select at 0x7fd85852af70>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:43.596374 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1e17a8fd-18ba-4244-9d4f-16a32b88a18a tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/b4885520-3643-4a2c-91cd-ed23b557be88" status: 200 len: 354 microversion: 2.1 time: 0.095950 Nov 02 23:07:43.604807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 59/122] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:43 2021] GET /compute/v2.1/os-volumes/b4885520-3643-4a2c-91cd-ed23b557be88 => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:43.611109 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-101c8607-4ede-4375-bb95-4c9977e426e8 tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] Calling method '.version_select at 0x7fd8584adf70>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:43.635443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-421a84a3-5f88-486b-a027-189d42087a17 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:43.636916 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-421a84a3-5f88-486b-a027-189d42087a17 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:43.651000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-421a84a3-5f88-486b-a027-189d42087a17 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:43.652042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-421a84a3-5f88-486b-a027-189d42087a17 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:43.657439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-421a84a3-5f88-486b-a027-189d42087a17 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:43.657938 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-421a84a3-5f88-486b-a027-189d42087a17 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:43.692911 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-101c8607-4ede-4375-bb95-4c9977e426e8 tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/b4885520-3643-4a2c-91cd-ed23b557be88" status: 200 len: 354 microversion: 2.1 time: 0.086782 Nov 02 23:07:43.694143 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 64/123] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:43 2021] GET /compute/v2.1/os-volumes/b4885520-3643-4a2c-91cd-ed23b557be88 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:43.711919 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-1fef5b19-184a-41f7-a7cb-21f522143799 tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] Calling method '.version_select at 0x7fd858484b80>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:43.793038 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-1fef5b19-184a-41f7-a7cb-21f522143799 tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/b4885520-3643-4a2c-91cd-ed23b557be88" status: 202 len: 0 microversion: 2.1 time: 0.084832 Nov 02 23:07:43.794745 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 65/124] 10.222.0.41 () {58 vars in 1247 bytes} [Tue Nov 2 23:07:43 2021] DELETE /compute/v2.1/os-volumes/b4885520-3643-4a2c-91cd-ed23b557be88 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:07:43.802672 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-c5487096-87c1-47a8-a1f4-bfcdff61c2fc tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] Calling method '.version_select at 0x7fd858531c10>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:43.934107 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-c5487096-87c1-47a8-a1f4-bfcdff61c2fc tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/b4885520-3643-4a2c-91cd-ed23b557be88" status: 200 len: 353 microversion: 2.1 time: 0.135236 Nov 02 23:07:43.934972 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 66/125] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:43 2021] GET /compute/v2.1/os-volumes/b4885520-3643-4a2c-91cd-ed23b557be88 => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:07:43.945814 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-31b89fbd-f602-494d-a40b-9452e3c29eef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:43.946799 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-31b89fbd-f602-494d-a40b-9452e3c29eef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:43.958066 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-31b89fbd-f602-494d-a40b-9452e3c29eef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:43.961872 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-31b89fbd-f602-494d-a40b-9452e3c29eef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:43.962880 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-31b89fbd-f602-494d-a40b-9452e3c29eef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:43.965108 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-31b89fbd-f602-494d-a40b-9452e3c29eef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:44.069777 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-31b89fbd-f602-494d-a40b-9452e3c29eef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:44.078771 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-31b89fbd-f602-494d-a40b-9452e3c29eef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:44.080317 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-31b89fbd-f602-494d-a40b-9452e3c29eef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:44.081885 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-31b89fbd-f602-494d-a40b-9452e3c29eef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1333 microversion: 2.20 time: 0.145624 Nov 02 23:07:44.082439 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 67/126] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:43 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1333 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:07:44.089579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-421a84a3-5f88-486b-a027-189d42087a17 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:44.093027 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d3d64c10-f8f2-46f2-829b-0893f29fc1d5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:44.093492 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d3d64c10-f8f2-46f2-829b-0893f29fc1d5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:44.100890 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d3d64c10-f8f2-46f2-829b-0893f29fc1d5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:44.101452 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-421a84a3-5f88-486b-a027-189d42087a17 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.470835 Nov 02 23:07:44.102800 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d3d64c10-f8f2-46f2-829b-0893f29fc1d5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:44.107263 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d3d64c10-f8f2-46f2-829b-0893f29fc1d5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:44.107708 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d3d64c10-f8f2-46f2-829b-0893f29fc1d5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:44.112168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 60/127] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:43 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:07:44.394578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8c04a4c2-464a-47ad-b797-0c3b468a00e2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:44.395522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8c04a4c2-464a-47ad-b797-0c3b468a00e2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:44.406720 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c04a4c2-464a-47ad-b797-0c3b468a00e2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:44.407745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c04a4c2-464a-47ad-b797-0c3b468a00e2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:44.410531 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c04a4c2-464a-47ad-b797-0c3b468a00e2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:44.412159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c04a4c2-464a-47ad-b797-0c3b468a00e2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:44.575198 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-d3d64c10-f8f2-46f2-829b-0893f29fc1d5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:44.587864 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d3d64c10-f8f2-46f2-829b-0893f29fc1d5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.504065 Nov 02 23:07:44.588462 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 68/128] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:44 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:44.839868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8c04a4c2-464a-47ad-b797-0c3b468a00e2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:44.847164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8c04a4c2-464a-47ad-b797-0c3b468a00e2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.457685 Nov 02 23:07:44.858085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 61/129] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:44 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:07:44.948040 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-3a4ded6b-8e5e-4031-b385-69a732d20676 tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] Calling method '.version_select at 0x7fd858484790>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:44.998549 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.wsgi [None req-3a4ded6b-8e5e-4031-b385-69a732d20676 tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] HTTP exception thrown: Volume b4885520-3643-4a2c-91cd-ed23b557be88 could not be found. Nov 02 23:07:44.999329 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-3a4ded6b-8e5e-4031-b385-69a732d20676 tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] Returning 404 to user: Volume b4885520-3643-4a2c-91cd-ed23b557be88 could not be found. {{(pid=115799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:07:45.000423 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-3a4ded6b-8e5e-4031-b385-69a732d20676 tempest-VolumesGetTestJSON-1081473623 tempest-VolumesGetTestJSON-1081473623-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/b4885520-3643-4a2c-91cd-ed23b557be88" status: 404 len: 109 microversion: 2.1 time: 0.057269 Nov 02 23:07:45.001101 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 69/130] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:44 2021] GET /compute/v2.1/os-volumes/b4885520-3643-4a2c-91cd-ed23b557be88 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 23:07:45.100960 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-237dabca-ee87-4037-9016-b635bce3a74c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:45.101571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-237dabca-ee87-4037-9016-b635bce3a74c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:45.107962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-237dabca-ee87-4037-9016-b635bce3a74c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:45.108702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-237dabca-ee87-4037-9016-b635bce3a74c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:45.109670 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-237dabca-ee87-4037-9016-b635bce3a74c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:45.112953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-237dabca-ee87-4037-9016-b635bce3a74c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:45.118816 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-fe05f711-1d41-4949-b6e1-388bf69beb0e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:45.120547 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-fe05f711-1d41-4949-b6e1-388bf69beb0e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:45.133409 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fe05f711-1d41-4949-b6e1-388bf69beb0e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:45.135638 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fe05f711-1d41-4949-b6e1-388bf69beb0e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:45.140039 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fe05f711-1d41-4949-b6e1-388bf69beb0e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:45.140983 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fe05f711-1d41-4949-b6e1-388bf69beb0e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:45.444553 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-237dabca-ee87-4037-9016-b635bce3a74c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:45.460900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-237dabca-ee87-4037-9016-b635bce3a74c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:45.463750 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-237dabca-ee87-4037-9016-b635bce3a74c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:45.466501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-237dabca-ee87-4037-9016-b635bce3a74c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1339 microversion: 2.20 time: 0.369190 Nov 02 23:07:45.467997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 62/131] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:45 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1339 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:07:45.485952 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-fe05f711-1d41-4949-b6e1-388bf69beb0e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:45.496479 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-fe05f711-1d41-4949-b6e1-388bf69beb0e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.381342 Nov 02 23:07:45.498572 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 70/132] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:45 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:07:45.579559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-ba07f321-eb50-410d-8a82-e1f0a31cda99 req-2306d94c-1ef0-43cd-a844-d92883c0b6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac92ad6f-13c2-4a74-bf07-98d2935a9b26", "tag": "cf4d550b-19f6-4434-904e-99469026b6db"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:07:45.583436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:07:45.583436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:07:45.603745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-ba07f321-eb50-410d-8a82-e1f0a31cda99 req-2306d94c-1ef0-43cd-a844-d92883c0b6a1 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:45.604573 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-ba07f321-eb50-410d-8a82-e1f0a31cda99 req-2306d94c-1ef0-43cd-a844-d92883c0b6a1 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:45.633675 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-ba07f321-eb50-410d-8a82-e1f0a31cda99 req-2306d94c-1ef0-43cd-a844-d92883c0b6a1 service nova] Creating event network-changed:cf4d550b-19f6-4434-904e-99469026b6db for instance ac92ad6f-13c2-4a74-bf07-98d2935a9b26 on hv-cinder-81584 Nov 02 23:07:45.636097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-ba07f321-eb50-410d-8a82-e1f0a31cda99 req-2306d94c-1ef0-43cd-a844-d92883c0b6a1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=115800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 02 23:07:45.638192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7149e9ba-cc4a-4131-afc2-37ddc5ff126f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:45.639294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7149e9ba-cc4a-4131-afc2-37ddc5ff126f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:45.641154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7149e9ba-cc4a-4131-afc2-37ddc5ff126f None None] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:45.642760 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7149e9ba-cc4a-4131-afc2-37ddc5ff126f None None] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:45.646643 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [req-ed2a0023-d9dd-4a4e-b458-9bb6165b6685 req-1d17c046-c604-4e2d-b398-93eb5c8acfcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8f293cf-a963-45dd-aaed-9149bfcfca7e", "tag": "4d11da3d-8afb-463d-8fa2-77489cf1ff97"}]} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:07:45.649774 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:07:45.649774 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: warnings.warn(msg) Nov 02 23:07:45.675953 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-ed2a0023-d9dd-4a4e-b458-9bb6165b6685 req-1d17c046-c604-4e2d-b398-93eb5c8acfcc service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:45.680023 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-ed2a0023-d9dd-4a4e-b458-9bb6165b6685 req-1d17c046-c604-4e2d-b398-93eb5c8acfcc service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:45.681637 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.compute.rpcapi [None req-7149e9ba-cc4a-4131-afc2-37ddc5ff126f None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 02 23:07:45.685383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7149e9ba-cc4a-4131-afc2-37ddc5ff126f None None] Releasing lock "compute-rpcapi-router" {{(pid=115800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 23:07:45.716991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7149e9ba-cc4a-4131-afc2-37ddc5ff126f None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.247057 Nov 02 23:07:45.718088 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 63/133] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:07:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:45.720980 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.compute.server_external_events [req-ed2a0023-d9dd-4a4e-b458-9bb6165b6685 req-1d17c046-c604-4e2d-b398-93eb5c8acfcc service nova] Creating event network-changed:4d11da3d-8afb-463d-8fa2-77489cf1ff97 for instance b8f293cf-a963-45dd-aaed-9149bfcfca7e on hv-cinder-81584 Nov 02 23:07:45.722957 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-ed2a0023-d9dd-4a4e-b458-9bb6165b6685 req-1d17c046-c604-4e2d-b398-93eb5c8acfcc service nova] Acquired lock "compute-rpcapi-router" {{(pid=115799) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 02 23:07:45.724698 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-34d13a47-7fc5-4263-8b63-6511233f594b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:45.725848 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-34d13a47-7fc5-4263-8b63-6511233f594b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:45.726491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-26eb4801-a40b-4049-8b1f-a4e404dbc5ca tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:45.727102 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-34d13a47-7fc5-4263-8b63-6511233f594b None None] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:45.727418 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-26eb4801-a40b-4049-8b1f-a4e404dbc5ca tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:45.728475 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-34d13a47-7fc5-4263-8b63-6511233f594b None None] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:45.734547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26eb4801-a40b-4049-8b1f-a4e404dbc5ca tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:45.735313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26eb4801-a40b-4049-8b1f-a4e404dbc5ca tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:45.736823 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26eb4801-a40b-4049-8b1f-a4e404dbc5ca tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:45.737477 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26eb4801-a40b-4049-8b1f-a4e404dbc5ca tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:45.745021 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.compute.rpcapi [None req-34d13a47-7fc5-4263-8b63-6511233f594b None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 02 23:07:45.746346 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-34d13a47-7fc5-4263-8b63-6511233f594b None None] Releasing lock "compute-rpcapi-router" {{(pid=115799) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 23:07:45.778357 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-34d13a47-7fc5-4263-8b63-6511233f594b None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.276064 Nov 02 23:07:45.779590 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 71/134] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:07:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:45.867912 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a0a4f1f8-e6de-4893-8c4a-b59594dfddcc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:45.868616 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a0a4f1f8-e6de-4893-8c4a-b59594dfddcc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:45.877040 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a0a4f1f8-e6de-4893-8c4a-b59594dfddcc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:45.877411 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a0a4f1f8-e6de-4893-8c4a-b59594dfddcc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:45.878196 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a0a4f1f8-e6de-4893-8c4a-b59594dfddcc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:45.878633 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a0a4f1f8-e6de-4893-8c4a-b59594dfddcc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:46.064969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-26eb4801-a40b-4049-8b1f-a4e404dbc5ca tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:46.083779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-26eb4801-a40b-4049-8b1f-a4e404dbc5ca tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.364129 Nov 02 23:07:46.088133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 64/135] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:45 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:46.097655 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-a0a4f1f8-e6de-4893-8c4a-b59594dfddcc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:46.105123 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a0a4f1f8-e6de-4893-8c4a-b59594dfddcc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.243556 Nov 02 23:07:46.107651 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 72/136] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:45 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:07:46.490048 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6e06732a-56ae-445a-ab40-13ebe07c4e69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:46.491672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6e06732a-56ae-445a-ab40-13ebe07c4e69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:46.499456 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e06732a-56ae-445a-ab40-13ebe07c4e69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:46.500392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e06732a-56ae-445a-ab40-13ebe07c4e69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:46.501446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e06732a-56ae-445a-ab40-13ebe07c4e69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:46.502087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e06732a-56ae-445a-ab40-13ebe07c4e69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:46.515952 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-33f7bdfd-b6ed-42ad-ae7e-08fb35da1ba5 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:46.517238 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-33f7bdfd-b6ed-42ad-ae7e-08fb35da1ba5 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:46.525524 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-33f7bdfd-b6ed-42ad-ae7e-08fb35da1ba5 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:46.526835 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-33f7bdfd-b6ed-42ad-ae7e-08fb35da1ba5 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:46.528105 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-33f7bdfd-b6ed-42ad-ae7e-08fb35da1ba5 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:46.528784 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-33f7bdfd-b6ed-42ad-ae7e-08fb35da1ba5 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:46.769259 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6e06732a-56ae-445a-ab40-13ebe07c4e69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:46.789402 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6e06732a-56ae-445a-ab40-13ebe07c4e69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:46.793015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6e06732a-56ae-445a-ab40-13ebe07c4e69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:46.795419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6e06732a-56ae-445a-ab40-13ebe07c4e69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.311527 Nov 02 23:07:46.796773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 65/137] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:46 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:07:46.849050 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-33f7bdfd-b6ed-42ad-ae7e-08fb35da1ba5 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:46.856578 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-33f7bdfd-b6ed-42ad-ae7e-08fb35da1ba5 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.345392 Nov 02 23:07:46.857154 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 73/138] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:46 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:47.101029 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-aecde52f-3736-481d-a533-d7a2c18ce23d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:47.101638 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-aecde52f-3736-481d-a533-d7a2c18ce23d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:47.107826 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-aecde52f-3736-481d-a533-d7a2c18ce23d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:47.108358 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-aecde52f-3736-481d-a533-d7a2c18ce23d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:47.109192 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-aecde52f-3736-481d-a533-d7a2c18ce23d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:47.109807 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-aecde52f-3736-481d-a533-d7a2c18ce23d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:47.251589 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-aecde52f-3736-481d-a533-d7a2c18ce23d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:47.258949 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-aecde52f-3736-481d-a533-d7a2c18ce23d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.161487 Nov 02 23:07:47.259804 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 74/139] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:47 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:47.264632 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-15e59987-2740-4c01-92db-636b122d5761 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:47.265319 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-15e59987-2740-4c01-92db-636b122d5761 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:47.271446 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-15e59987-2740-4c01-92db-636b122d5761 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:47.272503 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-15e59987-2740-4c01-92db-636b122d5761 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:47.273492 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-15e59987-2740-4c01-92db-636b122d5761 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:47.273994 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-15e59987-2740-4c01-92db-636b122d5761 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:47.333785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b1733416-dea1-42e6-985d-1c22dcbceb4a tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] Action: 'create', calling method: .version_select at 0x7fd858498160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1342689143", "metadata": {"Type": "work"}}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:07:47.336163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b1733416-dea1-42e6-985d-1c22dcbceb4a tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:07:47.337081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b1733416-dea1-42e6-985d-1c22dcbceb4a tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.268367 Nov 02 23:07:47.337618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 66/140] 10.222.0.41 () {60 vars in 1155 bytes} [Tue Nov 2 23:07:47 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 270 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 23:07:47.348999 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cb936ee8-f760-4731-ad38-2c16531cd710 tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] Action: 'create', calling method: .version_select at 0x7fd8584bcf70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-571325224", "metadata": {"Type": "work"}}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:07:47.350324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cb936ee8-f760-4731-ad38-2c16531cd710 tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:07:47.351339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cb936ee8-f760-4731-ad38-2c16531cd710 tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007500 Nov 02 23:07:47.352353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 67/141] 10.222.0.41 () {60 vars in 1155 bytes} [Tue Nov 2 23:07:47 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 23:07:47.361751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-769ef4da-450c-4ec9-b66b-e075d8ced10b tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] Action: 'create', calling method: .version_select at 0x7fd85a0b8040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1504351821", "metadata": {"Type": "work"}}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:07:47.362860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-769ef4da-450c-4ec9-b66b-e075d8ced10b tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:07:47.363671 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-769ef4da-450c-4ec9-b66b-e075d8ced10b tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006374 Nov 02 23:07:47.364177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 68/142] 10.222.0.41 () {60 vars in 1155 bytes} [Tue Nov 2 23:07:47 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 23:07:47.373434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f09878ba-c517-4041-9668-c3892e8b6d97 tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] Calling method '.version_select at 0x7fd85841a820>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:47.402567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-f09878ba-c517-4041-9668-c3892e8b6d97 tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] HTTP exception thrown: Volume tempest-invalid-1969056641 could not be found. Nov 02 23:07:47.403346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f09878ba-c517-4041-9668-c3892e8b6d97 tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] Returning 404 to user: Volume tempest-invalid-1969056641 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:07:47.404913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f09878ba-c517-4041-9668-c3892e8b6d97 tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1969056641" status: 404 len: 99 microversion: 2.1 time: 0.034881 Nov 02 23:07:47.405883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 69/143] 10.222.0.41 () {58 vars in 1217 bytes} [Tue Nov 2 23:07:47 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1969056641 => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 23:07:47.408147 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-15e59987-2740-4c01-92db-636b122d5761 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:47.415329 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-724caf04-86fc-4db7-922b-a459c126e85e tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004473 Nov 02 23:07:47.415964 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-15e59987-2740-4c01-92db-636b122d5761 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.154725 Nov 02 23:07:47.416305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 70/144] 10.222.0.41 () {58 vars in 1139 bytes} [Tue Nov 2 23:07:47 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 23:07:47.417099 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 75/145] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:47 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:47.424106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2a0245a9-0d4a-4817-b3ca-2ee0ac9c01df tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003344 Nov 02 23:07:47.424602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 71/146] 10.222.0.41 () {58 vars in 1136 bytes} [Tue Nov 2 23:07:47 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 02 23:07:47.433340 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-fec722f3-d89d-40d0-890a-194f8dd84baa tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] Calling method '.version_select at 0x7fd85851a3a0>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:47.461169 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.wsgi [None req-fec722f3-d89d-40d0-890a-194f8dd84baa tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] HTTP exception thrown: Volume ac9708f0-1dbe-4ebd-97b0-f9cbb892d1b4 could not be found. Nov 02 23:07:47.461861 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-fec722f3-d89d-40d0-890a-194f8dd84baa tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] Returning 404 to user: Volume ac9708f0-1dbe-4ebd-97b0-f9cbb892d1b4 could not be found. {{(pid=115799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:07:47.462678 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-fec722f3-d89d-40d0-890a-194f8dd84baa tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/ac9708f0-1dbe-4ebd-97b0-f9cbb892d1b4" status: 404 len: 109 microversion: 2.1 time: 0.032875 Nov 02 23:07:47.463255 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 76/147] 10.222.0.41 () {58 vars in 1247 bytes} [Tue Nov 2 23:07:47 2021] DELETE /compute/v2.1/os-volumes/ac9708f0-1dbe-4ebd-97b0-f9cbb892d1b4 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 23:07:47.472064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f19fed9e-023d-41c6-8caa-bf6b0cfaa9c4 tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] Calling method '.version_select at 0x7fd85841aee0>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:47.501923 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-f19fed9e-023d-41c6-8caa-bf6b0cfaa9c4 tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] HTTP exception thrown: Volume c63c8d16-4db2-479c-9fd7-88df13c800c1 could not be found. Nov 02 23:07:47.502503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f19fed9e-023d-41c6-8caa-bf6b0cfaa9c4 tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] Returning 404 to user: Volume c63c8d16-4db2-479c-9fd7-88df13c800c1 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:07:47.503350 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f19fed9e-023d-41c6-8caa-bf6b0cfaa9c4 tempest-VolumesNegativeTest-1772978760 tempest-VolumesNegativeTest-1772978760-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c63c8d16-4db2-479c-9fd7-88df13c800c1" status: 404 len: 109 microversion: 2.1 time: 0.034861 Nov 02 23:07:47.503898 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 72/148] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 2 23:07:47 2021] GET /compute/v2.1/os-volumes/c63c8d16-4db2-479c-9fd7-88df13c800c1 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 23:07:47.736959 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [req-692a4828-54f9-4707-bbfe-7068c2aa9ad6 req-e15ee3a9-4122-4e84-92ff-bc962d783f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ccc33d-e3f8-467c-9f5f-66238348fa70", "tag": "9ee5b124-d818-4612-b44b-e2c1d34e5cf3"}]} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:07:47.738733 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:07:47.738733 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: warnings.warn(msg) Nov 02 23:07:47.747703 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-692a4828-54f9-4707-bbfe-7068c2aa9ad6 req-e15ee3a9-4122-4e84-92ff-bc962d783f39 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:47.748447 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-692a4828-54f9-4707-bbfe-7068c2aa9ad6 req-e15ee3a9-4122-4e84-92ff-bc962d783f39 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:47.760519 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.compute.server_external_events [req-692a4828-54f9-4707-bbfe-7068c2aa9ad6 req-e15ee3a9-4122-4e84-92ff-bc962d783f39 service nova] Creating event network-changed:9ee5b124-d818-4612-b44b-e2c1d34e5cf3 for instance 84ccc33d-e3f8-467c-9f5f-66238348fa70 on hv-cinder-81584 Nov 02 23:07:47.765588 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [req-692a4828-54f9-4707-bbfe-7068c2aa9ad6 req-e15ee3a9-4122-4e84-92ff-bc962d783f39 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032422 Nov 02 23:07:47.766187 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 77/149] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:07:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:07:47.813465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2b47c0ba-e912-48da-b761-af8a98470163 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:47.814065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2b47c0ba-e912-48da-b761-af8a98470163 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:47.820701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b47c0ba-e912-48da-b761-af8a98470163 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:47.821403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b47c0ba-e912-48da-b761-af8a98470163 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:47.822332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b47c0ba-e912-48da-b761-af8a98470163 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:47.822904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b47c0ba-e912-48da-b761-af8a98470163 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:47.874853 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-77f129c9-e287-46f3-bccf-93e2fcce65d4 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:47.875737 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-77f129c9-e287-46f3-bccf-93e2fcce65d4 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:47.883141 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-77f129c9-e287-46f3-bccf-93e2fcce65d4 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:47.883820 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-77f129c9-e287-46f3-bccf-93e2fcce65d4 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:47.884943 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-77f129c9-e287-46f3-bccf-93e2fcce65d4 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:47.885371 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-77f129c9-e287-46f3-bccf-93e2fcce65d4 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:47.972933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2b47c0ba-e912-48da-b761-af8a98470163 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:47.981950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2b47c0ba-e912-48da-b761-af8a98470163 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:47.983488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2b47c0ba-e912-48da-b761-af8a98470163 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:47.984589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2b47c0ba-e912-48da-b761-af8a98470163 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.174932 Nov 02 23:07:47.985751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 73/150] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:47 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:07:48.150788 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-77f129c9-e287-46f3-bccf-93e2fcce65d4 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:48.156511 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-77f129c9-e287-46f3-bccf-93e2fcce65d4 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.286795 Nov 02 23:07:48.157079 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 78/151] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:47 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:07:48.276294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-515a9cc1-fe15-420b-8709-630c3cc375c3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:48.276940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-515a9cc1-fe15-420b-8709-630c3cc375c3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:48.282853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-515a9cc1-fe15-420b-8709-630c3cc375c3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:48.283338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-515a9cc1-fe15-420b-8709-630c3cc375c3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:48.284118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-515a9cc1-fe15-420b-8709-630c3cc375c3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:48.284551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-515a9cc1-fe15-420b-8709-630c3cc375c3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:48.435708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-515a9cc1-fe15-420b-8709-630c3cc375c3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:48.440147 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-701b35bf-e79f-44b5-9f5f-c9c7b4d7b281 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:48.440751 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-701b35bf-e79f-44b5-9f5f-c9c7b4d7b281 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:48.446811 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-701b35bf-e79f-44b5-9f5f-c9c7b4d7b281 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:48.447503 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-701b35bf-e79f-44b5-9f5f-c9c7b4d7b281 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:48.448292 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-701b35bf-e79f-44b5-9f5f-c9c7b4d7b281 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:48.448741 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-701b35bf-e79f-44b5-9f5f-c9c7b4d7b281 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:48.448876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-515a9cc1-fe15-420b-8709-630c3cc375c3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.176781 Nov 02 23:07:48.449772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 74/152] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:48 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:48.581771 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-701b35bf-e79f-44b5-9f5f-c9c7b4d7b281 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:48.589318 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-701b35bf-e79f-44b5-9f5f-c9c7b4d7b281 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.158696 Nov 02 23:07:48.589897 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 79/153] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:48 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:07:49.002152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f5e82173-b04d-4390-894e-273c135b4834 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:49.002681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f5e82173-b04d-4390-894e-273c135b4834 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:49.008448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f5e82173-b04d-4390-894e-273c135b4834 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:49.008898 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f5e82173-b04d-4390-894e-273c135b4834 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:49.009668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f5e82173-b04d-4390-894e-273c135b4834 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:49.010098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f5e82173-b04d-4390-894e-273c135b4834 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:49.145267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f5e82173-b04d-4390-894e-273c135b4834 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:49.155215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f5e82173-b04d-4390-894e-273c135b4834 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:49.157051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f5e82173-b04d-4390-894e-273c135b4834 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:49.158315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f5e82173-b04d-4390-894e-273c135b4834 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.159889 Nov 02 23:07:49.159450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 75/154] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:48 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:07:49.173346 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-7fc2904c-fe06-40c0-b37c-1c00e9ecc2d8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:49.173960 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-7fc2904c-fe06-40c0-b37c-1c00e9ecc2d8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:49.179916 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7fc2904c-fe06-40c0-b37c-1c00e9ecc2d8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:49.180364 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7fc2904c-fe06-40c0-b37c-1c00e9ecc2d8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:49.181193 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7fc2904c-fe06-40c0-b37c-1c00e9ecc2d8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:49.181629 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7fc2904c-fe06-40c0-b37c-1c00e9ecc2d8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:49.315452 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-7fc2904c-fe06-40c0-b37c-1c00e9ecc2d8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:49.323281 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-7fc2904c-fe06-40c0-b37c-1c00e9ecc2d8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.153531 Nov 02 23:07:49.323860 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 80/155] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:49 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:49.465246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-91a70773-0970-405f-961d-b925b905c156 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:49.465896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-91a70773-0970-405f-961d-b925b905c156 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:49.471676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-91a70773-0970-405f-961d-b925b905c156 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:49.472108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-91a70773-0970-405f-961d-b925b905c156 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:49.472885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-91a70773-0970-405f-961d-b925b905c156 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:49.473312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-91a70773-0970-405f-961d-b925b905c156 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:49.602573 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-91a70773-0970-405f-961d-b925b905c156 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:49.605433 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b92e5903-05d1-4b57-b734-8f642a103538 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:49.606048 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b92e5903-05d1-4b57-b734-8f642a103538 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:49.611228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-91a70773-0970-405f-961d-b925b905c156 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.149484 Nov 02 23:07:49.611879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 76/156] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:49 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:49.612093 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b92e5903-05d1-4b57-b734-8f642a103538 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:49.612537 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b92e5903-05d1-4b57-b734-8f642a103538 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:49.613707 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b92e5903-05d1-4b57-b734-8f642a103538 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:49.614143 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b92e5903-05d1-4b57-b734-8f642a103538 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:49.750252 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-b92e5903-05d1-4b57-b734-8f642a103538 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:49.758469 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b92e5903-05d1-4b57-b734-8f642a103538 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.156740 Nov 02 23:07:49.759071 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 81/157] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:49 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:07:50.176460 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-560f6f6a-6ed1-4cb9-9b4e-7a7ed4a9227b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:50.177064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-560f6f6a-6ed1-4cb9-9b4e-7a7ed4a9227b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:50.183431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-560f6f6a-6ed1-4cb9-9b4e-7a7ed4a9227b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:50.183874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-560f6f6a-6ed1-4cb9-9b4e-7a7ed4a9227b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:50.184639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-560f6f6a-6ed1-4cb9-9b4e-7a7ed4a9227b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:50.185074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-560f6f6a-6ed1-4cb9-9b4e-7a7ed4a9227b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:50.340446 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-2845b087-364d-4a1d-9805-acbc20d8516a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:50.341387 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-2845b087-364d-4a1d-9805-acbc20d8516a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:50.347666 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2845b087-364d-4a1d-9805-acbc20d8516a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:50.348221 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2845b087-364d-4a1d-9805-acbc20d8516a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:50.349439 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2845b087-364d-4a1d-9805-acbc20d8516a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:50.350176 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2845b087-364d-4a1d-9805-acbc20d8516a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:50.700295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-560f6f6a-6ed1-4cb9-9b4e-7a7ed4a9227b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:50.709075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-560f6f6a-6ed1-4cb9-9b4e-7a7ed4a9227b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:50.711406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-560f6f6a-6ed1-4cb9-9b4e-7a7ed4a9227b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:50.713322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-560f6f6a-6ed1-4cb9-9b4e-7a7ed4a9227b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.539853 Nov 02 23:07:50.715325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 77/158] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:50 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:07:50.721192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e4035b35-cc88-4a27-acb5-f62c11eb05fe tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:50.722098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e4035b35-cc88-4a27-acb5-f62c11eb05fe tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:50.729028 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4035b35-cc88-4a27-acb5-f62c11eb05fe tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:50.730211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4035b35-cc88-4a27-acb5-f62c11eb05fe tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:50.731052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4035b35-cc88-4a27-acb5-f62c11eb05fe tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:50.731880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4035b35-cc88-4a27-acb5-f62c11eb05fe tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:50.840777 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-2845b087-364d-4a1d-9805-acbc20d8516a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:50.848723 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-2845b087-364d-4a1d-9805-acbc20d8516a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.512103 Nov 02 23:07:50.849302 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 82/159] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:50 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:07:50.860737 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ddc88526-f605-4cc2-9d21-19544ec8320c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:50.863736 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ddc88526-f605-4cc2-9d21-19544ec8320c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:50.878739 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ddc88526-f605-4cc2-9d21-19544ec8320c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:50.879240 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ddc88526-f605-4cc2-9d21-19544ec8320c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:50.880034 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ddc88526-f605-4cc2-9d21-19544ec8320c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:50.880605 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ddc88526-f605-4cc2-9d21-19544ec8320c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:51.121409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e4035b35-cc88-4a27-acb5-f62c11eb05fe tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:51.139832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e4035b35-cc88-4a27-acb5-f62c11eb05fe tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.422802 Nov 02 23:07:51.140717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 78/160] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:50 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:51.238590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-411c2406-c199-4804-bbd5-1a27980bf216 req-17592964-4972-4eff-aadd-2e74ca97fe3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15750fff-dec6-4bcc-a69c-0f9576f7970e", "tag": "1be9ce23-4225-4b98-9740-ed6ade9ebf4a"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:07:51.242092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:07:51.242092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:07:51.262527 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-411c2406-c199-4804-bbd5-1a27980bf216 req-17592964-4972-4eff-aadd-2e74ca97fe3c service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:51.264006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-411c2406-c199-4804-bbd5-1a27980bf216 req-17592964-4972-4eff-aadd-2e74ca97fe3c service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:51.325904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-411c2406-c199-4804-bbd5-1a27980bf216 req-17592964-4972-4eff-aadd-2e74ca97fe3c service nova] Creating event network-changed:1be9ce23-4225-4b98-9740-ed6ade9ebf4a for instance 15750fff-dec6-4bcc-a69c-0f9576f7970e on hv-cinder-81584 Nov 02 23:07:51.333441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-411c2406-c199-4804-bbd5-1a27980bf216 req-17592964-4972-4eff-aadd-2e74ca97fe3c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102098 Nov 02 23:07:51.335967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 79/161] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:07:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:07:51.537725 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-ddc88526-f605-4cc2-9d21-19544ec8320c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:51.547640 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ddc88526-f605-4cc2-9d21-19544ec8320c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.694128 Nov 02 23:07:51.548749 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 83/162] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:50 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:51.732806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b9100625-19d9-449f-9f26-c8a126daa43d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:51.733780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b9100625-19d9-449f-9f26-c8a126daa43d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:51.740297 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9100625-19d9-449f-9f26-c8a126daa43d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:51.742827 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9100625-19d9-449f-9f26-c8a126daa43d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:51.743792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9100625-19d9-449f-9f26-c8a126daa43d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:51.744371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9100625-19d9-449f-9f26-c8a126daa43d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:51.865945 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-52c1526f-fba7-4a3e-8beb-b076cd18f6a8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:51.866348 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-52c1526f-fba7-4a3e-8beb-b076cd18f6a8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:51.873089 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-52c1526f-fba7-4a3e-8beb-b076cd18f6a8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:51.873809 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-52c1526f-fba7-4a3e-8beb-b076cd18f6a8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:51.874766 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-52c1526f-fba7-4a3e-8beb-b076cd18f6a8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:51.875666 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-52c1526f-fba7-4a3e-8beb-b076cd18f6a8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:52.109963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b9100625-19d9-449f-9f26-c8a126daa43d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:52.122220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b9100625-19d9-449f-9f26-c8a126daa43d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:52.124200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b9100625-19d9-449f-9f26-c8a126daa43d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:52.126182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b9100625-19d9-449f-9f26-c8a126daa43d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.397308 Nov 02 23:07:52.126778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 80/163] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:51 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:07:52.134384 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-52c1526f-fba7-4a3e-8beb-b076cd18f6a8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:52.142808 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-52c1526f-fba7-4a3e-8beb-b076cd18f6a8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.280903 Nov 02 23:07:52.143512 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 84/164] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:51 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:52.157518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e48967db-6f5b-4aa3-9a32-f74a7a07350f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:52.158140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e48967db-6f5b-4aa3-9a32-f74a7a07350f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:52.176521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e48967db-6f5b-4aa3-9a32-f74a7a07350f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:52.177216 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e48967db-6f5b-4aa3-9a32-f74a7a07350f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:52.178164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e48967db-6f5b-4aa3-9a32-f74a7a07350f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:52.178469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e48967db-6f5b-4aa3-9a32-f74a7a07350f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:52.408175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e48967db-6f5b-4aa3-9a32-f74a7a07350f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:52.415914 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e48967db-6f5b-4aa3-9a32-f74a7a07350f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.262388 Nov 02 23:07:52.416510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 81/165] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:52 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:52.565375 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-79203640-f174-4894-9463-df043d3502dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:52.565981 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-79203640-f174-4894-9463-df043d3502dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:52.572803 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-79203640-f174-4894-9463-df043d3502dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:52.573252 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-79203640-f174-4894-9463-df043d3502dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:52.574026 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-79203640-f174-4894-9463-df043d3502dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:52.574458 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-79203640-f174-4894-9463-df043d3502dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:52.797449 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-79203640-f174-4894-9463-df043d3502dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:52.805129 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-79203640-f174-4894-9463-df043d3502dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.243378 Nov 02 23:07:52.805684 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 85/166] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:52 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:53.144844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-979789ef-4888-4fd1-a533-743c66f775d2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:53.145593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-979789ef-4888-4fd1-a533-743c66f775d2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:53.152600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-979789ef-4888-4fd1-a533-743c66f775d2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:53.152876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-979789ef-4888-4fd1-a533-743c66f775d2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:53.153725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-979789ef-4888-4fd1-a533-743c66f775d2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:53.154651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-979789ef-4888-4fd1-a533-743c66f775d2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:53.161979 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-16951968-9516-49df-a359-a9aa298a8a57 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:53.163901 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-16951968-9516-49df-a359-a9aa298a8a57 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:53.172775 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-16951968-9516-49df-a359-a9aa298a8a57 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:53.173413 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-16951968-9516-49df-a359-a9aa298a8a57 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:53.174277 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-16951968-9516-49df-a359-a9aa298a8a57 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:53.174956 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-16951968-9516-49df-a359-a9aa298a8a57 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:53.331704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-979789ef-4888-4fd1-a533-743c66f775d2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:53.342279 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-979789ef-4888-4fd1-a533-743c66f775d2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:53.348564 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-979789ef-4888-4fd1-a533-743c66f775d2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:53.349736 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-979789ef-4888-4fd1-a533-743c66f775d2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.209098 Nov 02 23:07:53.350304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 82/167] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:53 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:07:53.351406 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-16951968-9516-49df-a359-a9aa298a8a57 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:53.361595 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-16951968-9516-49df-a359-a9aa298a8a57 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.204351 Nov 02 23:07:53.362190 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 86/168] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:53 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:53.433512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b69ce846-0741-4048-a57a-4c7a948beb10 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:53.434106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b69ce846-0741-4048-a57a-4c7a948beb10 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:53.441324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b69ce846-0741-4048-a57a-4c7a948beb10 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:53.441768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b69ce846-0741-4048-a57a-4c7a948beb10 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:53.443167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b69ce846-0741-4048-a57a-4c7a948beb10 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:53.444330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b69ce846-0741-4048-a57a-4c7a948beb10 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:53.583271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b69ce846-0741-4048-a57a-4c7a948beb10 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:53.591017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b69ce846-0741-4048-a57a-4c7a948beb10 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.161149 Nov 02 23:07:53.591600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 83/169] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:53 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:53.822344 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b2b1abcd-7364-4ec2-a482-eceff9dd45ba tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:53.823225 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b2b1abcd-7364-4ec2-a482-eceff9dd45ba tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:53.829301 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b2b1abcd-7364-4ec2-a482-eceff9dd45ba tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:53.829926 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b2b1abcd-7364-4ec2-a482-eceff9dd45ba tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:53.831072 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b2b1abcd-7364-4ec2-a482-eceff9dd45ba tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:53.831952 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b2b1abcd-7364-4ec2-a482-eceff9dd45ba tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:53.975554 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-b2b1abcd-7364-4ec2-a482-eceff9dd45ba tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:53.983453 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b2b1abcd-7364-4ec2-a482-eceff9dd45ba tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.165656 Nov 02 23:07:53.984033 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 87/170] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:53 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:07:54.367412 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f38a779a-6abb-48d4-beea-6e6562b746c6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:54.368072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f38a779a-6abb-48d4-beea-6e6562b746c6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:54.374167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f38a779a-6abb-48d4-beea-6e6562b746c6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:54.374613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f38a779a-6abb-48d4-beea-6e6562b746c6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:54.375444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f38a779a-6abb-48d4-beea-6e6562b746c6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:54.375875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f38a779a-6abb-48d4-beea-6e6562b746c6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:54.382545 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-579f54e5-2d78-46c8-aa41-152af50dae83 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:54.386541 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-579f54e5-2d78-46c8-aa41-152af50dae83 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:54.394093 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-579f54e5-2d78-46c8-aa41-152af50dae83 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:54.394894 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-579f54e5-2d78-46c8-aa41-152af50dae83 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:54.395885 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-579f54e5-2d78-46c8-aa41-152af50dae83 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:54.396610 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-579f54e5-2d78-46c8-aa41-152af50dae83 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:54.546164 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-579f54e5-2d78-46c8-aa41-152af50dae83 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:54.554044 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-579f54e5-2d78-46c8-aa41-152af50dae83 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.178442 Nov 02 23:07:54.555617 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 88/171] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:54 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:54.569645 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f38a779a-6abb-48d4-beea-6e6562b746c6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:54.579451 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f38a779a-6abb-48d4-beea-6e6562b746c6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:54.581988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f38a779a-6abb-48d4-beea-6e6562b746c6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:54.584307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f38a779a-6abb-48d4-beea-6e6562b746c6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.221443 Nov 02 23:07:54.585010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 84/172] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:54 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:07:54.608609 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-709e45d6-20e2-4c83-b94e-6ef2003976e0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:54.609317 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-709e45d6-20e2-4c83-b94e-6ef2003976e0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:54.615745 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-709e45d6-20e2-4c83-b94e-6ef2003976e0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:54.616305 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-709e45d6-20e2-4c83-b94e-6ef2003976e0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:54.617175 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-709e45d6-20e2-4c83-b94e-6ef2003976e0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:54.617714 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-709e45d6-20e2-4c83-b94e-6ef2003976e0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:54.775472 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-709e45d6-20e2-4c83-b94e-6ef2003976e0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:54.783228 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-709e45d6-20e2-4c83-b94e-6ef2003976e0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.179248 Nov 02 23:07:54.783800 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 89/173] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:54 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:55.000456 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4a796cc3-bbac-47f8-84bc-c2f96b96beb7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:55.001058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4a796cc3-bbac-47f8-84bc-c2f96b96beb7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:55.007872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a796cc3-bbac-47f8-84bc-c2f96b96beb7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:55.008481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a796cc3-bbac-47f8-84bc-c2f96b96beb7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:55.009397 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a796cc3-bbac-47f8-84bc-c2f96b96beb7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:55.010093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a796cc3-bbac-47f8-84bc-c2f96b96beb7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:55.154402 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4a796cc3-bbac-47f8-84bc-c2f96b96beb7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:55.162947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4a796cc3-bbac-47f8-84bc-c2f96b96beb7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.165583 Nov 02 23:07:55.163618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 85/174] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:54 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:55.572694 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-50deec4c-fdf3-4edb-ab02-c272232183ae tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:55.573330 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-50deec4c-fdf3-4edb-ab02-c272232183ae tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:55.580070 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-50deec4c-fdf3-4edb-ab02-c272232183ae tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:55.580572 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-50deec4c-fdf3-4edb-ab02-c272232183ae tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:55.581792 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-50deec4c-fdf3-4edb-ab02-c272232183ae tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:55.582324 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-50deec4c-fdf3-4edb-ab02-c272232183ae tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:55.601680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4cd68a22-bb77-4c78-a283-fde398135652 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:55.602277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4cd68a22-bb77-4c78-a283-fde398135652 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:55.608353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4cd68a22-bb77-4c78-a283-fde398135652 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:55.608824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4cd68a22-bb77-4c78-a283-fde398135652 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:55.609601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4cd68a22-bb77-4c78-a283-fde398135652 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:55.618137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4cd68a22-bb77-4c78-a283-fde398135652 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:55.746878 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-50deec4c-fdf3-4edb-ab02-c272232183ae tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:55.754361 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-50deec4c-fdf3-4edb-ab02-c272232183ae tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.186463 Nov 02 23:07:55.755330 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 90/175] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:55 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:55.791303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4cd68a22-bb77-4c78-a283-fde398135652 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:55.800451 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-c9492bea-abdd-4d0b-9059-79bbf5f60849 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:55.800638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4cd68a22-bb77-4c78-a283-fde398135652 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:55.801441 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-c9492bea-abdd-4d0b-9059-79bbf5f60849 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:55.802606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4cd68a22-bb77-4c78-a283-fde398135652 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:55.803862 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4cd68a22-bb77-4c78-a283-fde398135652 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.205873 Nov 02 23:07:55.804445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 86/176] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:55 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:07:55.808297 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c9492bea-abdd-4d0b-9059-79bbf5f60849 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:55.808737 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c9492bea-abdd-4d0b-9059-79bbf5f60849 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:55.809510 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c9492bea-abdd-4d0b-9059-79bbf5f60849 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:55.809934 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c9492bea-abdd-4d0b-9059-79bbf5f60849 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:55.972893 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-c9492bea-abdd-4d0b-9059-79bbf5f60849 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:55.981808 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-c9492bea-abdd-4d0b-9059-79bbf5f60849 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.185189 Nov 02 23:07:55.996788 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 91/177] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:55 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:07:56.180012 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1d6cb155-af25-4a01-8c27-0d3f0f57ad0a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:56.180613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1d6cb155-af25-4a01-8c27-0d3f0f57ad0a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:56.186778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d6cb155-af25-4a01-8c27-0d3f0f57ad0a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:56.187286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d6cb155-af25-4a01-8c27-0d3f0f57ad0a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:56.188079 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d6cb155-af25-4a01-8c27-0d3f0f57ad0a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:56.188496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d6cb155-af25-4a01-8c27-0d3f0f57ad0a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:56.336374 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1d6cb155-af25-4a01-8c27-0d3f0f57ad0a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:56.343770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1d6cb155-af25-4a01-8c27-0d3f0f57ad0a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.167349 Nov 02 23:07:56.344549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 87/178] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:56 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:56.771536 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-290d6c55-1ee9-4afd-b1d4-5bb4cbf43126 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:56.772146 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-290d6c55-1ee9-4afd-b1d4-5bb4cbf43126 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:56.778402 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-290d6c55-1ee9-4afd-b1d4-5bb4cbf43126 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:56.780188 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-290d6c55-1ee9-4afd-b1d4-5bb4cbf43126 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:56.781262 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-290d6c55-1ee9-4afd-b1d4-5bb4cbf43126 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:56.781865 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-290d6c55-1ee9-4afd-b1d4-5bb4cbf43126 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:56.822636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4350de0e-cdb4-4b81-b856-e2edf2db2065 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:56.823795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4350de0e-cdb4-4b81-b856-e2edf2db2065 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:56.830820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4350de0e-cdb4-4b81-b856-e2edf2db2065 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:56.831606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4350de0e-cdb4-4b81-b856-e2edf2db2065 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:56.832386 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4350de0e-cdb4-4b81-b856-e2edf2db2065 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:56.832809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4350de0e-cdb4-4b81-b856-e2edf2db2065 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:56.992427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4350de0e-cdb4-4b81-b856-e2edf2db2065 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:57.002708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4350de0e-cdb4-4b81-b856-e2edf2db2065 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:57.004622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4350de0e-cdb4-4b81-b856-e2edf2db2065 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:57.005922 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4350de0e-cdb4-4b81-b856-e2edf2db2065 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.187945 Nov 02 23:07:57.006788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 88/179] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:56 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:07:57.013360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a8ea7ef5-6279-45a8-b39b-ec55f136a905 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:57.014531 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a8ea7ef5-6279-45a8-b39b-ec55f136a905 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:57.022478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a8ea7ef5-6279-45a8-b39b-ec55f136a905 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:57.023158 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a8ea7ef5-6279-45a8-b39b-ec55f136a905 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:57.024367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a8ea7ef5-6279-45a8-b39b-ec55f136a905 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:57.025012 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a8ea7ef5-6279-45a8-b39b-ec55f136a905 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:57.183422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a8ea7ef5-6279-45a8-b39b-ec55f136a905 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:57.191422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a8ea7ef5-6279-45a8-b39b-ec55f136a905 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.183139 Nov 02 23:07:57.192367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 89/180] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:57 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:57.234749 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-290d6c55-1ee9-4afd-b1d4-5bb4cbf43126 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:57.243230 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-290d6c55-1ee9-4afd-b1d4-5bb4cbf43126 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.475099 Nov 02 23:07:57.253038 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 92/181] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:56 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:57.362568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bb9fc632-c80b-4c85-8572-3235dd574980 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:57.363449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bb9fc632-c80b-4c85-8572-3235dd574980 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:57.370354 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bb9fc632-c80b-4c85-8572-3235dd574980 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:57.371355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bb9fc632-c80b-4c85-8572-3235dd574980 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:57.372521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bb9fc632-c80b-4c85-8572-3235dd574980 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:57.373334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bb9fc632-c80b-4c85-8572-3235dd574980 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:57.532478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bb9fc632-c80b-4c85-8572-3235dd574980 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:57.541949 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bb9fc632-c80b-4c85-8572-3235dd574980 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.183894 Nov 02 23:07:57.542947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 90/182] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:57 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:58.024803 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-348ef59c-c649-46b9-aad8-da1ae9c8f95b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:58.025480 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-348ef59c-c649-46b9-aad8-da1ae9c8f95b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:58.031469 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-348ef59c-c649-46b9-aad8-da1ae9c8f95b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:58.031908 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-348ef59c-c649-46b9-aad8-da1ae9c8f95b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:58.032694 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-348ef59c-c649-46b9-aad8-da1ae9c8f95b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:58.033763 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-348ef59c-c649-46b9-aad8-da1ae9c8f95b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:58.207364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4ee7d1b6-28f2-488b-9818-9a8bf8c71f57 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:58.208690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4ee7d1b6-28f2-488b-9818-9a8bf8c71f57 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:58.215906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ee7d1b6-28f2-488b-9818-9a8bf8c71f57 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:58.216564 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ee7d1b6-28f2-488b-9818-9a8bf8c71f57 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:58.217338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ee7d1b6-28f2-488b-9818-9a8bf8c71f57 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:58.217760 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ee7d1b6-28f2-488b-9818-9a8bf8c71f57 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:58.264157 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-348ef59c-c649-46b9-aad8-da1ae9c8f95b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:58.272868 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-348ef59c-c649-46b9-aad8-da1ae9c8f95b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:58.274367 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-348ef59c-c649-46b9-aad8-da1ae9c8f95b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:58.275505 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-348ef59c-c649-46b9-aad8-da1ae9c8f95b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.255000 Nov 02 23:07:58.276677 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 93/183] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:58 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:07:58.281605 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-22420f2f-5b13-4926-a59c-3b7810ff3757 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:58.282475 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-22420f2f-5b13-4926-a59c-3b7810ff3757 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:58.288713 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-22420f2f-5b13-4926-a59c-3b7810ff3757 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:58.290274 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-22420f2f-5b13-4926-a59c-3b7810ff3757 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:58.291299 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-22420f2f-5b13-4926-a59c-3b7810ff3757 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:58.292047 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-22420f2f-5b13-4926-a59c-3b7810ff3757 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:58.376826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4ee7d1b6-28f2-488b-9818-9a8bf8c71f57 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:58.386364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4ee7d1b6-28f2-488b-9818-9a8bf8c71f57 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.182770 Nov 02 23:07:58.387299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 91/184] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:58 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:07:58.542580 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-22420f2f-5b13-4926-a59c-3b7810ff3757 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:58.550789 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-22420f2f-5b13-4926-a59c-3b7810ff3757 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.272784 Nov 02 23:07:58.551882 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 94/185] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:58 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:58.564435 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3ed40d0c-5e6c-4092-9796-40324d7de17a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:58.565449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3ed40d0c-5e6c-4092-9796-40324d7de17a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:58.571701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3ed40d0c-5e6c-4092-9796-40324d7de17a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:58.572358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3ed40d0c-5e6c-4092-9796-40324d7de17a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:58.573278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3ed40d0c-5e6c-4092-9796-40324d7de17a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:58.573784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3ed40d0c-5e6c-4092-9796-40324d7de17a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:58.946243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3ed40d0c-5e6c-4092-9796-40324d7de17a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:58.955597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3ed40d0c-5e6c-4092-9796-40324d7de17a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.400063 Nov 02 23:07:58.956803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 92/186] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:58 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:59.293858 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-27fd1404-1e85-43ed-aefe-c648c87cacae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:59.294453 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-27fd1404-1e85-43ed-aefe-c648c87cacae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:59.300670 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-27fd1404-1e85-43ed-aefe-c648c87cacae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:59.301104 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-27fd1404-1e85-43ed-aefe-c648c87cacae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:59.302022 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-27fd1404-1e85-43ed-aefe-c648c87cacae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:59.302473 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-27fd1404-1e85-43ed-aefe-c648c87cacae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:59.404024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c9ca8417-185d-4648-9c04-67122a77c16b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:59.404700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c9ca8417-185d-4648-9c04-67122a77c16b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:59.414213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c9ca8417-185d-4648-9c04-67122a77c16b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:59.416097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c9ca8417-185d-4648-9c04-67122a77c16b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:59.419082 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c9ca8417-185d-4648-9c04-67122a77c16b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:59.420149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c9ca8417-185d-4648-9c04-67122a77c16b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:59.484626 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-27fd1404-1e85-43ed-aefe-c648c87cacae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:59.494869 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-27fd1404-1e85-43ed-aefe-c648c87cacae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:59.498271 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-27fd1404-1e85-43ed-aefe-c648c87cacae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:59.499692 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-27fd1404-1e85-43ed-aefe-c648c87cacae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.209475 Nov 02 23:07:59.500810 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 95/187] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:07:59 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:07:59.567175 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d31d45e9-2ac1-43f8-9a94-f5e8ab7ebdc8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:59.567830 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d31d45e9-2ac1-43f8-9a94-f5e8ab7ebdc8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:59.574639 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d31d45e9-2ac1-43f8-9a94-f5e8ab7ebdc8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:59.575329 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d31d45e9-2ac1-43f8-9a94-f5e8ab7ebdc8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:59.576281 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d31d45e9-2ac1-43f8-9a94-f5e8ab7ebdc8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:59.577487 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d31d45e9-2ac1-43f8-9a94-f5e8ab7ebdc8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:59.587606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c9ca8417-185d-4648-9c04-67122a77c16b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:59.595284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c9ca8417-185d-4648-9c04-67122a77c16b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.195399 Nov 02 23:07:59.595865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 93/188] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:59 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:07:59.714628 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-d31d45e9-2ac1-43f8-9a94-f5e8ab7ebdc8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:07:59.721807 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d31d45e9-2ac1-43f8-9a94-f5e8ab7ebdc8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.158045 Nov 02 23:07:59.722368 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 96/189] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:59 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:07:59.972375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5510f149-85f4-41f0-8bbf-c54128d288c4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:07:59.972984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5510f149-85f4-41f0-8bbf-c54128d288c4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:07:59.979750 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5510f149-85f4-41f0-8bbf-c54128d288c4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:59.980269 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5510f149-85f4-41f0-8bbf-c54128d288c4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:07:59.981066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5510f149-85f4-41f0-8bbf-c54128d288c4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:07:59.981497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5510f149-85f4-41f0-8bbf-c54128d288c4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:00.118858 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5510f149-85f4-41f0-8bbf-c54128d288c4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:00.126128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5510f149-85f4-41f0-8bbf-c54128d288c4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.157892 Nov 02 23:08:00.126759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 94/190] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:07:59 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:00.517841 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-6bf88d86-9a5c-4a8f-b32a-b8c2d5b2a72d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:00.518439 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-6bf88d86-9a5c-4a8f-b32a-b8c2d5b2a72d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:00.524504 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6bf88d86-9a5c-4a8f-b32a-b8c2d5b2a72d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:00.525315 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6bf88d86-9a5c-4a8f-b32a-b8c2d5b2a72d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:00.526107 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6bf88d86-9a5c-4a8f-b32a-b8c2d5b2a72d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:00.526539 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6bf88d86-9a5c-4a8f-b32a-b8c2d5b2a72d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:00.613405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6ce3c3ad-ef09-4bde-a74e-fa55564c80b0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:00.614016 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6ce3c3ad-ef09-4bde-a74e-fa55564c80b0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:00.622423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ce3c3ad-ef09-4bde-a74e-fa55564c80b0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:00.625522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ce3c3ad-ef09-4bde-a74e-fa55564c80b0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:00.626364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ce3c3ad-ef09-4bde-a74e-fa55564c80b0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:00.626808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ce3c3ad-ef09-4bde-a74e-fa55564c80b0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:00.674729 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6bf88d86-9a5c-4a8f-b32a-b8c2d5b2a72d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:00.683618 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6bf88d86-9a5c-4a8f-b32a-b8c2d5b2a72d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:00.685095 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6bf88d86-9a5c-4a8f-b32a-b8c2d5b2a72d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:00.686189 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-6bf88d86-9a5c-4a8f-b32a-b8c2d5b2a72d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.172034 Nov 02 23:08:00.686743 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 97/191] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:08:00 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:08:00.739200 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-7b65ebf7-3d28-46c8-9f2a-77c2e27e21bd tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:00.741720 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-7b65ebf7-3d28-46c8-9f2a-77c2e27e21bd tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:00.747772 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7b65ebf7-3d28-46c8-9f2a-77c2e27e21bd tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:00.748445 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7b65ebf7-3d28-46c8-9f2a-77c2e27e21bd tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:00.749859 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7b65ebf7-3d28-46c8-9f2a-77c2e27e21bd tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:00.750557 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7b65ebf7-3d28-46c8-9f2a-77c2e27e21bd tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:00.839150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6ce3c3ad-ef09-4bde-a74e-fa55564c80b0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:00.852202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6ce3c3ad-ef09-4bde-a74e-fa55564c80b0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.242291 Nov 02 23:08:00.854165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 95/192] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:00 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:00.989123 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-7b65ebf7-3d28-46c8-9f2a-77c2e27e21bd tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:00.998781 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-7b65ebf7-3d28-46c8-9f2a-77c2e27e21bd tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.263530 Nov 02 23:08:00.999864 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 98/193] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:00 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:01.146151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-02c1fdc0-21c5-4103-9bde-e0a184fbefc5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:01.147274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-02c1fdc0-21c5-4103-9bde-e0a184fbefc5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:01.155388 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-02c1fdc0-21c5-4103-9bde-e0a184fbefc5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:01.156457 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-02c1fdc0-21c5-4103-9bde-e0a184fbefc5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:01.157362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-02c1fdc0-21c5-4103-9bde-e0a184fbefc5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:01.158005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-02c1fdc0-21c5-4103-9bde-e0a184fbefc5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:01.305995 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-02c1fdc0-21c5-4103-9bde-e0a184fbefc5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:01.313365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-02c1fdc0-21c5-4103-9bde-e0a184fbefc5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.173612 Nov 02 23:08:01.313946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 96/194] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:01 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:01.703354 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-0272d325-aea0-4aac-9413-7ad9dc40c8a9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:01.703955 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-0272d325-aea0-4aac-9413-7ad9dc40c8a9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:01.710538 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0272d325-aea0-4aac-9413-7ad9dc40c8a9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:01.710992 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0272d325-aea0-4aac-9413-7ad9dc40c8a9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:01.712836 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0272d325-aea0-4aac-9413-7ad9dc40c8a9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:01.713275 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0272d325-aea0-4aac-9413-7ad9dc40c8a9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:01.870451 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-0272d325-aea0-4aac-9413-7ad9dc40c8a9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:01.877400 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1d5db068-8a7f-45f5-a4f1-2038f4b73ca1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:01.878629 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1d5db068-8a7f-45f5-a4f1-2038f4b73ca1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:01.888493 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-0272d325-aea0-4aac-9413-7ad9dc40c8a9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:01.892891 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-0272d325-aea0-4aac-9413-7ad9dc40c8a9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:01.893701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d5db068-8a7f-45f5-a4f1-2038f4b73ca1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:01.894376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d5db068-8a7f-45f5-a4f1-2038f4b73ca1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:01.895391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d5db068-8a7f-45f5-a4f1-2038f4b73ca1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:01.896041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d5db068-8a7f-45f5-a4f1-2038f4b73ca1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:01.900085 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-0272d325-aea0-4aac-9413-7ad9dc40c8a9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.199304 Nov 02 23:08:01.902061 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 99/195] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:08:01 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:08:02.019643 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ff29d844-d459-4468-ad26-e3f2adbe9086 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:02.020335 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ff29d844-d459-4468-ad26-e3f2adbe9086 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:02.028784 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ff29d844-d459-4468-ad26-e3f2adbe9086 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:02.029361 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ff29d844-d459-4468-ad26-e3f2adbe9086 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:02.030381 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ff29d844-d459-4468-ad26-e3f2adbe9086 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:02.031146 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ff29d844-d459-4468-ad26-e3f2adbe9086 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:02.109385 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1d5db068-8a7f-45f5-a4f1-2038f4b73ca1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:02.122777 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1d5db068-8a7f-45f5-a4f1-2038f4b73ca1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.252456 Nov 02 23:08:02.132643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 97/196] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:01 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:02.218729 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-ff29d844-d459-4468-ad26-e3f2adbe9086 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:02.235776 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ff29d844-d459-4468-ad26-e3f2adbe9086 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.219936 Nov 02 23:08:02.247328 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 100/197] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:02 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:02.330246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b6d849b9-a4e6-4b6c-8932-1e1f837bd36c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:02.330846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b6d849b9-a4e6-4b6c-8932-1e1f837bd36c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:02.339980 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6d849b9-a4e6-4b6c-8932-1e1f837bd36c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:02.340909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6d849b9-a4e6-4b6c-8932-1e1f837bd36c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:02.341691 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6d849b9-a4e6-4b6c-8932-1e1f837bd36c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:02.344251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6d849b9-a4e6-4b6c-8932-1e1f837bd36c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:02.534818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b6d849b9-a4e6-4b6c-8932-1e1f837bd36c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:02.546224 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b6d849b9-a4e6-4b6c-8932-1e1f837bd36c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.219517 Nov 02 23:08:02.547552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 98/198] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:02 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:02.918343 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-44a3aae1-733c-495d-88d0-43118ee81b0d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:02.918961 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-44a3aae1-733c-495d-88d0-43118ee81b0d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:02.925662 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-44a3aae1-733c-495d-88d0-43118ee81b0d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:02.926334 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-44a3aae1-733c-495d-88d0-43118ee81b0d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:02.927140 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-44a3aae1-733c-495d-88d0-43118ee81b0d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:02.927620 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-44a3aae1-733c-495d-88d0-43118ee81b0d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:03.077494 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-44a3aae1-733c-495d-88d0-43118ee81b0d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:03.086982 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-44a3aae1-733c-495d-88d0-43118ee81b0d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:03.088477 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-44a3aae1-733c-495d-88d0-43118ee81b0d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:03.089575 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-44a3aae1-733c-495d-88d0-43118ee81b0d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.175164 Nov 02 23:08:03.090128 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 101/199] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:08:02 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:08:03.140933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7176189d-df02-4dca-8e8e-8cdd75b5180b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:03.141653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7176189d-df02-4dca-8e8e-8cdd75b5180b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:03.149620 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7176189d-df02-4dca-8e8e-8cdd75b5180b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:03.150300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7176189d-df02-4dca-8e8e-8cdd75b5180b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:03.151445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7176189d-df02-4dca-8e8e-8cdd75b5180b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:03.151943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7176189d-df02-4dca-8e8e-8cdd75b5180b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:03.253472 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-fec6f2f2-4fdc-48b4-8617-a9a62afbdae3 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:03.254263 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-fec6f2f2-4fdc-48b4-8617-a9a62afbdae3 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:03.261286 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fec6f2f2-4fdc-48b4-8617-a9a62afbdae3 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:03.261899 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fec6f2f2-4fdc-48b4-8617-a9a62afbdae3 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:03.262868 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fec6f2f2-4fdc-48b4-8617-a9a62afbdae3 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:03.263369 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fec6f2f2-4fdc-48b4-8617-a9a62afbdae3 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:03.290867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7176189d-df02-4dca-8e8e-8cdd75b5180b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:03.306960 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7176189d-df02-4dca-8e8e-8cdd75b5180b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.170307 Nov 02 23:08:03.311544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 99/200] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:03 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:03.416356 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-fec6f2f2-4fdc-48b4-8617-a9a62afbdae3 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:03.423520 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-fec6f2f2-4fdc-48b4-8617-a9a62afbdae3 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.173799 Nov 02 23:08:03.424090 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 102/201] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:03 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:03.564216 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a8147a88-ad60-4f3c-ab06-34eca6f84263 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:03.564726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a8147a88-ad60-4f3c-ab06-34eca6f84263 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:03.571094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a8147a88-ad60-4f3c-ab06-34eca6f84263 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:03.571538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a8147a88-ad60-4f3c-ab06-34eca6f84263 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:03.572298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a8147a88-ad60-4f3c-ab06-34eca6f84263 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:03.572729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a8147a88-ad60-4f3c-ab06-34eca6f84263 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:03.704292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a8147a88-ad60-4f3c-ab06-34eca6f84263 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:03.711899 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a8147a88-ad60-4f3c-ab06-34eca6f84263 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.151430 Nov 02 23:08:03.712472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 100/202] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:03 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:04.109789 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f952ce69-df21-4daa-97bf-c8abb60c10b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:04.110237 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f952ce69-df21-4daa-97bf-c8abb60c10b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:04.116093 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f952ce69-df21-4daa-97bf-c8abb60c10b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:04.116456 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f952ce69-df21-4daa-97bf-c8abb60c10b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:04.117227 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f952ce69-df21-4daa-97bf-c8abb60c10b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:04.117651 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f952ce69-df21-4daa-97bf-c8abb60c10b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:04.256780 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-f952ce69-df21-4daa-97bf-c8abb60c10b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:04.264670 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-f952ce69-df21-4daa-97bf-c8abb60c10b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:04.266038 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-f952ce69-df21-4daa-97bf-c8abb60c10b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:04.267151 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f952ce69-df21-4daa-97bf-c8abb60c10b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.161576 Nov 02 23:08:04.267717 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 103/203] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:08:04 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:08:04.327846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bcd59693-4e7f-4eab-ae26-8aec26ca91cf tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:04.328449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bcd59693-4e7f-4eab-ae26-8aec26ca91cf tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:04.335138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcd59693-4e7f-4eab-ae26-8aec26ca91cf tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:04.335585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcd59693-4e7f-4eab-ae26-8aec26ca91cf tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:04.336349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcd59693-4e7f-4eab-ae26-8aec26ca91cf tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:04.336778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcd59693-4e7f-4eab-ae26-8aec26ca91cf tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:04.439847 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ddfc6815-68da-4099-9325-86c0b688661d tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:04.440455 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ddfc6815-68da-4099-9325-86c0b688661d tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:04.446428 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ddfc6815-68da-4099-9325-86c0b688661d tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:04.446871 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ddfc6815-68da-4099-9325-86c0b688661d tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:04.447663 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ddfc6815-68da-4099-9325-86c0b688661d tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:04.448256 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ddfc6815-68da-4099-9325-86c0b688661d tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:04.492564 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bcd59693-4e7f-4eab-ae26-8aec26ca91cf tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:04.502209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bcd59693-4e7f-4eab-ae26-8aec26ca91cf tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.177968 Nov 02 23:08:04.502826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 101/204] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:04 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:04.606647 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-ddfc6815-68da-4099-9325-86c0b688661d tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:04.614354 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ddfc6815-68da-4099-9325-86c0b688661d tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.178061 Nov 02 23:08:04.615229 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 104/205] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:04 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:04.729240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6174cdcb-8dd6-4a37-9c31-2f44937f35c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:04.729868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6174cdcb-8dd6-4a37-9c31-2f44937f35c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:04.735661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6174cdcb-8dd6-4a37-9c31-2f44937f35c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:04.736102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6174cdcb-8dd6-4a37-9c31-2f44937f35c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:04.736864 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6174cdcb-8dd6-4a37-9c31-2f44937f35c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:04.737289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6174cdcb-8dd6-4a37-9c31-2f44937f35c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:04.912170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6174cdcb-8dd6-4a37-9c31-2f44937f35c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:04.920735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6174cdcb-8dd6-4a37-9c31-2f44937f35c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.195037 Nov 02 23:08:04.921308 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 102/206] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:04 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:05.286002 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-1a849f68-5903-4a8f-b9c6-fc741acb1526 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:05.286686 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-1a849f68-5903-4a8f-b9c6-fc741acb1526 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:05.293474 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1a849f68-5903-4a8f-b9c6-fc741acb1526 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:05.294085 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1a849f68-5903-4a8f-b9c6-fc741acb1526 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:05.295010 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1a849f68-5903-4a8f-b9c6-fc741acb1526 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:05.295615 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1a849f68-5903-4a8f-b9c6-fc741acb1526 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:05.471496 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-1a849f68-5903-4a8f-b9c6-fc741acb1526 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:05.480111 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-1a849f68-5903-4a8f-b9c6-fc741acb1526 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:05.481592 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-1a849f68-5903-4a8f-b9c6-fc741acb1526 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:05.482701 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-1a849f68-5903-4a8f-b9c6-fc741acb1526 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.201013 Nov 02 23:08:05.483304 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 105/207] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:08:05 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:08:05.519169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6d021fbf-7f67-4522-bd2b-b57b973732e6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:05.519768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6d021fbf-7f67-4522-bd2b-b57b973732e6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:05.525667 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6d021fbf-7f67-4522-bd2b-b57b973732e6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:05.526110 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6d021fbf-7f67-4522-bd2b-b57b973732e6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:05.526871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6d021fbf-7f67-4522-bd2b-b57b973732e6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:05.527321 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6d021fbf-7f67-4522-bd2b-b57b973732e6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:05.631627 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-41fa2add-c5cf-4dd9-b810-c4fb7b3601de tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:05.632191 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-41fa2add-c5cf-4dd9-b810-c4fb7b3601de tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:05.638148 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-41fa2add-c5cf-4dd9-b810-c4fb7b3601de tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:05.638635 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-41fa2add-c5cf-4dd9-b810-c4fb7b3601de tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:05.639390 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-41fa2add-c5cf-4dd9-b810-c4fb7b3601de tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:05.639815 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-41fa2add-c5cf-4dd9-b810-c4fb7b3601de tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:05.663562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6d021fbf-7f67-4522-bd2b-b57b973732e6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:05.671235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6d021fbf-7f67-4522-bd2b-b57b973732e6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.155690 Nov 02 23:08:05.671869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 103/208] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:05 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:05.781634 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-41fa2add-c5cf-4dd9-b810-c4fb7b3601de tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:05.789719 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-41fa2add-c5cf-4dd9-b810-c4fb7b3601de tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.162217 Nov 02 23:08:05.790321 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 106/209] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:05 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:05.937294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-043e404b-34f9-4a94-a5c7-b2299b661dd2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:05.937849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-043e404b-34f9-4a94-a5c7-b2299b661dd2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:05.943803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-043e404b-34f9-4a94-a5c7-b2299b661dd2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:05.944243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-043e404b-34f9-4a94-a5c7-b2299b661dd2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:05.945044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-043e404b-34f9-4a94-a5c7-b2299b661dd2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:05.945474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-043e404b-34f9-4a94-a5c7-b2299b661dd2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:06.078819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-043e404b-34f9-4a94-a5c7-b2299b661dd2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:06.087506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-043e404b-34f9-4a94-a5c7-b2299b661dd2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.153819 Nov 02 23:08:06.088089 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 104/210] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:05 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:06.500611 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-9d024b3d-ce34-4a2f-9c8a-43c3d6a19282 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:06.501327 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-9d024b3d-ce34-4a2f-9c8a-43c3d6a19282 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:06.512284 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9d024b3d-ce34-4a2f-9c8a-43c3d6a19282 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:06.512732 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9d024b3d-ce34-4a2f-9c8a-43c3d6a19282 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:06.513885 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9d024b3d-ce34-4a2f-9c8a-43c3d6a19282 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:06.514468 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9d024b3d-ce34-4a2f-9c8a-43c3d6a19282 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:06.643707 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-9d024b3d-ce34-4a2f-9c8a-43c3d6a19282 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:06.651877 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-9d024b3d-ce34-4a2f-9c8a-43c3d6a19282 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:06.653395 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-9d024b3d-ce34-4a2f-9c8a-43c3d6a19282 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:06.654489 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-9d024b3d-ce34-4a2f-9c8a-43c3d6a19282 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.157750 Nov 02 23:08:06.655066 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 107/211] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:08:06 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:08:06.687577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-82cf16b8-fe35-4fc8-b8ed-ca301fad0aac tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:06.688260 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-82cf16b8-fe35-4fc8-b8ed-ca301fad0aac tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:06.693982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82cf16b8-fe35-4fc8-b8ed-ca301fad0aac tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:06.694505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82cf16b8-fe35-4fc8-b8ed-ca301fad0aac tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:06.695388 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82cf16b8-fe35-4fc8-b8ed-ca301fad0aac tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:06.695929 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82cf16b8-fe35-4fc8-b8ed-ca301fad0aac tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:06.805567 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-bb9c1844-b4de-4f5a-bae3-7501abee06c8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:06.806236 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-bb9c1844-b4de-4f5a-bae3-7501abee06c8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:06.812400 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bb9c1844-b4de-4f5a-bae3-7501abee06c8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:06.812891 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bb9c1844-b4de-4f5a-bae3-7501abee06c8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:06.813732 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bb9c1844-b4de-4f5a-bae3-7501abee06c8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:06.814219 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bb9c1844-b4de-4f5a-bae3-7501abee06c8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:06.837095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-82cf16b8-fe35-4fc8-b8ed-ca301fad0aac tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:06.844365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-82cf16b8-fe35-4fc8-b8ed-ca301fad0aac tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.160306 Nov 02 23:08:06.845243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 105/212] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:06 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:06.948494 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-bb9c1844-b4de-4f5a-bae3-7501abee06c8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:06.955632 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-bb9c1844-b4de-4f5a-bae3-7501abee06c8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.153946 Nov 02 23:08:06.956454 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 108/213] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:06 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:07.104351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3fe4f663-c4e5-4f55-89bd-ad7f9524e9b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:07.104946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3fe4f663-c4e5-4f55-89bd-ad7f9524e9b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:07.110939 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fe4f663-c4e5-4f55-89bd-ad7f9524e9b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:07.111381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fe4f663-c4e5-4f55-89bd-ad7f9524e9b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:07.112151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fe4f663-c4e5-4f55-89bd-ad7f9524e9b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:07.112576 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fe4f663-c4e5-4f55-89bd-ad7f9524e9b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:07.246615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3fe4f663-c4e5-4f55-89bd-ad7f9524e9b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:07.254551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3fe4f663-c4e5-4f55-89bd-ad7f9524e9b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.153683 Nov 02 23:08:07.256248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 106/214] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:07 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:07.671763 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-0680d1ac-edc5-482e-a774-a1ca95bfa209 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:07.672542 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-0680d1ac-edc5-482e-a774-a1ca95bfa209 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:07.679031 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0680d1ac-edc5-482e-a774-a1ca95bfa209 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:07.679472 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0680d1ac-edc5-482e-a774-a1ca95bfa209 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:07.680235 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0680d1ac-edc5-482e-a774-a1ca95bfa209 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:07.680662 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0680d1ac-edc5-482e-a774-a1ca95bfa209 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:07.816246 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-0680d1ac-edc5-482e-a774-a1ca95bfa209 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:07.824511 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-0680d1ac-edc5-482e-a774-a1ca95bfa209 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:07.825994 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-0680d1ac-edc5-482e-a774-a1ca95bfa209 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:07.827113 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-0680d1ac-edc5-482e-a774-a1ca95bfa209 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.158996 Nov 02 23:08:07.827677 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 109/215] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:08:07 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:08:07.861672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bfe3c88a-89b7-4783-8553-3067f7c02861 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:07.862294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bfe3c88a-89b7-4783-8553-3067f7c02861 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:07.868816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bfe3c88a-89b7-4783-8553-3067f7c02861 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:07.869253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bfe3c88a-89b7-4783-8553-3067f7c02861 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:07.870053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bfe3c88a-89b7-4783-8553-3067f7c02861 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:07.870474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bfe3c88a-89b7-4783-8553-3067f7c02861 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:07.977140 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-71189a31-d372-4556-9128-46f2c7be898c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:07.977746 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-71189a31-d372-4556-9128-46f2c7be898c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:07.994650 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-71189a31-d372-4556-9128-46f2c7be898c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:07.996459 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-71189a31-d372-4556-9128-46f2c7be898c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:07.997511 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-71189a31-d372-4556-9128-46f2c7be898c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:07.997927 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-71189a31-d372-4556-9128-46f2c7be898c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:08.006291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bfe3c88a-89b7-4783-8553-3067f7c02861 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:08.014346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bfe3c88a-89b7-4783-8553-3067f7c02861 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.156338 Nov 02 23:08:08.014957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 107/216] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:07 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:08.143999 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-71189a31-d372-4556-9128-46f2c7be898c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:08.151772 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-71189a31-d372-4556-9128-46f2c7be898c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.181352 Nov 02 23:08:08.152344 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 110/217] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:07 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:08.271595 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fbfb3f1d-8598-4857-a8e2-dd84be8f9b97 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:08.272235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fbfb3f1d-8598-4857-a8e2-dd84be8f9b97 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:08.278085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbfb3f1d-8598-4857-a8e2-dd84be8f9b97 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:08.278535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbfb3f1d-8598-4857-a8e2-dd84be8f9b97 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:08.279365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbfb3f1d-8598-4857-a8e2-dd84be8f9b97 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:08.279800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbfb3f1d-8598-4857-a8e2-dd84be8f9b97 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:08.419458 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fbfb3f1d-8598-4857-a8e2-dd84be8f9b97 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:08.426612 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fbfb3f1d-8598-4857-a8e2-dd84be8f9b97 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.158784 Nov 02 23:08:08.428172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 108/218] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:08 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:08.845441 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e177d4f5-58fa-4fb0-9321-63e4ccb4a0b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:08.846611 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e177d4f5-58fa-4fb0-9321-63e4ccb4a0b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:08.853414 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e177d4f5-58fa-4fb0-9321-63e4ccb4a0b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:08.853855 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e177d4f5-58fa-4fb0-9321-63e4ccb4a0b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:08.854633 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e177d4f5-58fa-4fb0-9321-63e4ccb4a0b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:08.855085 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e177d4f5-58fa-4fb0-9321-63e4ccb4a0b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:08.997343 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e177d4f5-58fa-4fb0-9321-63e4ccb4a0b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:09.006406 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e177d4f5-58fa-4fb0-9321-63e4ccb4a0b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:09.008258 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e177d4f5-58fa-4fb0-9321-63e4ccb4a0b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:09.009536 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e177d4f5-58fa-4fb0-9321-63e4ccb4a0b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.167799 Nov 02 23:08:09.010796 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 111/219] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:08:08 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:08:09.030877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1e200591-f411-4cb3-a24c-5b2a4f01fd72 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:09.032081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1e200591-f411-4cb3-a24c-5b2a4f01fd72 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:09.037958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e200591-f411-4cb3-a24c-5b2a4f01fd72 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:09.038395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e200591-f411-4cb3-a24c-5b2a4f01fd72 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:09.039375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e200591-f411-4cb3-a24c-5b2a4f01fd72 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:09.039938 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e200591-f411-4cb3-a24c-5b2a4f01fd72 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:09.168392 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-970bcc8e-efb2-4518-9fc3-9517dae6fa7e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:09.169246 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-970bcc8e-efb2-4518-9fc3-9517dae6fa7e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:09.175911 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-970bcc8e-efb2-4518-9fc3-9517dae6fa7e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:09.176573 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-970bcc8e-efb2-4518-9fc3-9517dae6fa7e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:09.178119 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-970bcc8e-efb2-4518-9fc3-9517dae6fa7e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:09.178793 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-970bcc8e-efb2-4518-9fc3-9517dae6fa7e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:09.198298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1e200591-f411-4cb3-a24c-5b2a4f01fd72 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:09.214656 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1e200591-f411-4cb3-a24c-5b2a4f01fd72 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.186862 Nov 02 23:08:09.215604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 109/220] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:09 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:09.348948 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-970bcc8e-efb2-4518-9fc3-9517dae6fa7e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:09.356503 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-970bcc8e-efb2-4518-9fc3-9517dae6fa7e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.191889 Nov 02 23:08:09.362965 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 112/221] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:09 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:09.445328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-289ddb19-4e87-40df-8ce5-ff67d982bd71 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:09.446740 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-289ddb19-4e87-40df-8ce5-ff67d982bd71 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:09.453718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-289ddb19-4e87-40df-8ce5-ff67d982bd71 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:09.454157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-289ddb19-4e87-40df-8ce5-ff67d982bd71 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:09.454950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-289ddb19-4e87-40df-8ce5-ff67d982bd71 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:09.455401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-289ddb19-4e87-40df-8ce5-ff67d982bd71 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:09.613580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-289ddb19-4e87-40df-8ce5-ff67d982bd71 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:09.622363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-289ddb19-4e87-40df-8ce5-ff67d982bd71 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.181691 Nov 02 23:08:09.622965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 110/222] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:09 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:10.027337 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-8bd08e24-8beb-43b5-8268-1d8a187708a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:10.028681 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-8bd08e24-8beb-43b5-8268-1d8a187708a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:10.035970 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8bd08e24-8beb-43b5-8268-1d8a187708a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:10.037319 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8bd08e24-8beb-43b5-8268-1d8a187708a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:10.038123 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8bd08e24-8beb-43b5-8268-1d8a187708a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:10.038554 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8bd08e24-8beb-43b5-8268-1d8a187708a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:10.202643 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-8bd08e24-8beb-43b5-8268-1d8a187708a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:10.210861 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-8bd08e24-8beb-43b5-8268-1d8a187708a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:10.212474 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-8bd08e24-8beb-43b5-8268-1d8a187708a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:10.213741 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-8bd08e24-8beb-43b5-8268-1d8a187708a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.189948 Nov 02 23:08:10.214193 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 113/223] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:08:10 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:08:10.231155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-25ae46e9-f39c-49e7-b0a8-c492004eca68 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:10.231761 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-25ae46e9-f39c-49e7-b0a8-c492004eca68 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:10.237822 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25ae46e9-f39c-49e7-b0a8-c492004eca68 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:10.238257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25ae46e9-f39c-49e7-b0a8-c492004eca68 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:10.239033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25ae46e9-f39c-49e7-b0a8-c492004eca68 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:10.239460 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25ae46e9-f39c-49e7-b0a8-c492004eca68 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:10.373429 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-69370d28-89ff-47a3-9dff-bc64b6f8e3c4 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:10.374035 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-69370d28-89ff-47a3-9dff-bc64b6f8e3c4 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:10.379084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-25ae46e9-f39c-49e7-b0a8-c492004eca68 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:10.380034 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-69370d28-89ff-47a3-9dff-bc64b6f8e3c4 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:10.380591 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-69370d28-89ff-47a3-9dff-bc64b6f8e3c4 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:10.381445 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-69370d28-89ff-47a3-9dff-bc64b6f8e3c4 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:10.382074 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-69370d28-89ff-47a3-9dff-bc64b6f8e3c4 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:10.388300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-25ae46e9-f39c-49e7-b0a8-c492004eca68 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.160758 Nov 02 23:08:10.398124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 111/224] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:10 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:10.526347 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-69370d28-89ff-47a3-9dff-bc64b6f8e3c4 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:10.533635 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-69370d28-89ff-47a3-9dff-bc64b6f8e3c4 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.163865 Nov 02 23:08:10.534214 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 114/225] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:10 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:10.640209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-42e04b91-7a22-4d36-bd2f-9ceac133cee7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:10.640900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-42e04b91-7a22-4d36-bd2f-9ceac133cee7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:10.647839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42e04b91-7a22-4d36-bd2f-9ceac133cee7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:10.648462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42e04b91-7a22-4d36-bd2f-9ceac133cee7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:10.649342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42e04b91-7a22-4d36-bd2f-9ceac133cee7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:10.649841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42e04b91-7a22-4d36-bd2f-9ceac133cee7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:10.788829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-42e04b91-7a22-4d36-bd2f-9ceac133cee7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:10.806122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-42e04b91-7a22-4d36-bd2f-9ceac133cee7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.163987 Nov 02 23:08:10.806745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 112/226] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:10 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:11.231451 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-5a5e2461-0c73-49d1-9f4a-f493ca72a56f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:11.232252 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-5a5e2461-0c73-49d1-9f4a-f493ca72a56f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:11.238815 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5a5e2461-0c73-49d1-9f4a-f493ca72a56f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:11.239301 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5a5e2461-0c73-49d1-9f4a-f493ca72a56f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:11.240580 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5a5e2461-0c73-49d1-9f4a-f493ca72a56f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:11.241014 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5a5e2461-0c73-49d1-9f4a-f493ca72a56f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:11.379161 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-5a5e2461-0c73-49d1-9f4a-f493ca72a56f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:11.387242 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-5a5e2461-0c73-49d1-9f4a-f493ca72a56f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:11.388860 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-5a5e2461-0c73-49d1-9f4a-f493ca72a56f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:11.390033 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-5a5e2461-0c73-49d1-9f4a-f493ca72a56f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.162310 Nov 02 23:08:11.390676 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 115/227] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:08:11 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:08:11.405416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b18ef631-5e90-46d0-bb85-8a96698092b0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:11.406023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b18ef631-5e90-46d0-bb85-8a96698092b0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:11.412368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b18ef631-5e90-46d0-bb85-8a96698092b0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:11.412817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b18ef631-5e90-46d0-bb85-8a96698092b0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:11.413587 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b18ef631-5e90-46d0-bb85-8a96698092b0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:11.414013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b18ef631-5e90-46d0-bb85-8a96698092b0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:11.550296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b18ef631-5e90-46d0-bb85-8a96698092b0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:11.550451 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d38f34a2-0db5-41d5-89e6-3977d7289283 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:11.551149 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d38f34a2-0db5-41d5-89e6-3977d7289283 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:11.558421 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d38f34a2-0db5-41d5-89e6-3977d7289283 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:11.558790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b18ef631-5e90-46d0-bb85-8a96698092b0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.156745 Nov 02 23:08:11.559136 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d38f34a2-0db5-41d5-89e6-3977d7289283 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:11.559615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 113/228] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:11 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:11.568915 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d38f34a2-0db5-41d5-89e6-3977d7289283 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:11.568915 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d38f34a2-0db5-41d5-89e6-3977d7289283 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:11.752366 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-d38f34a2-0db5-41d5-89e6-3977d7289283 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:11.760346 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d38f34a2-0db5-41d5-89e6-3977d7289283 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.213836 Nov 02 23:08:11.760931 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 116/229] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:11 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:11.822169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3711d268-4f42-4393-b710-0274d48c20dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:11.822934 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3711d268-4f42-4393-b710-0274d48c20dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:11.830224 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3711d268-4f42-4393-b710-0274d48c20dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:11.830769 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3711d268-4f42-4393-b710-0274d48c20dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:11.831908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3711d268-4f42-4393-b710-0274d48c20dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:11.832407 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3711d268-4f42-4393-b710-0274d48c20dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:12.035254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3711d268-4f42-4393-b710-0274d48c20dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:12.042536 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3711d268-4f42-4393-b710-0274d48c20dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.224014 Nov 02 23:08:12.043144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 114/230] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:11 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:12.408265 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a71a02f5-cbb3-4ede-95a7-7ce0c827ea89 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:12.409194 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a71a02f5-cbb3-4ede-95a7-7ce0c827ea89 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:12.415669 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a71a02f5-cbb3-4ede-95a7-7ce0c827ea89 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:12.416117 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a71a02f5-cbb3-4ede-95a7-7ce0c827ea89 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:12.416902 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a71a02f5-cbb3-4ede-95a7-7ce0c827ea89 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:12.417343 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a71a02f5-cbb3-4ede-95a7-7ce0c827ea89 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:12.557839 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-a71a02f5-cbb3-4ede-95a7-7ce0c827ea89 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:12.566043 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-a71a02f5-cbb3-4ede-95a7-7ce0c827ea89 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:12.567624 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-a71a02f5-cbb3-4ede-95a7-7ce0c827ea89 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:12.569270 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a71a02f5-cbb3-4ede-95a7-7ce0c827ea89 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.164755 Nov 02 23:08:12.570230 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 117/231] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:08:12 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:08:12.576021 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fcd6bce1-7820-4364-bf11-e4e2793109b2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:12.576621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fcd6bce1-7820-4364-bf11-e4e2793109b2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:12.582845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fcd6bce1-7820-4364-bf11-e4e2793109b2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:12.583310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fcd6bce1-7820-4364-bf11-e4e2793109b2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:12.584889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fcd6bce1-7820-4364-bf11-e4e2793109b2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:12.585312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fcd6bce1-7820-4364-bf11-e4e2793109b2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:12.735584 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fcd6bce1-7820-4364-bf11-e4e2793109b2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:12.744563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fcd6bce1-7820-4364-bf11-e4e2793109b2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.171899 Nov 02 23:08:12.745193 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 115/232] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:12 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:12.782336 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a7805096-694d-4cbd-a254-77bc406d6e05 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:12.782336 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a7805096-694d-4cbd-a254-77bc406d6e05 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:12.784102 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a7805096-694d-4cbd-a254-77bc406d6e05 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:12.784616 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a7805096-694d-4cbd-a254-77bc406d6e05 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:12.785459 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a7805096-694d-4cbd-a254-77bc406d6e05 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:12.785951 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a7805096-694d-4cbd-a254-77bc406d6e05 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:12.922394 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-a7805096-694d-4cbd-a254-77bc406d6e05 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:12.929550 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a7805096-694d-4cbd-a254-77bc406d6e05 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.157059 Nov 02 23:08:12.930120 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 118/233] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:12 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:13.059522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-102c5acf-9249-4f6d-8f9d-b59a07d48b10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:13.060132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-102c5acf-9249-4f6d-8f9d-b59a07d48b10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:13.066130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-102c5acf-9249-4f6d-8f9d-b59a07d48b10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:13.066571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-102c5acf-9249-4f6d-8f9d-b59a07d48b10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:13.067371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-102c5acf-9249-4f6d-8f9d-b59a07d48b10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:13.067796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-102c5acf-9249-4f6d-8f9d-b59a07d48b10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:13.198013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-102c5acf-9249-4f6d-8f9d-b59a07d48b10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:13.206480 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-102c5acf-9249-4f6d-8f9d-b59a07d48b10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.150243 Nov 02 23:08:13.207277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 116/234] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:13 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:13.587382 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-15ffa4e4-a2b5-4c42-a9e8-0dcfd365ba73 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:13.587987 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-15ffa4e4-a2b5-4c42-a9e8-0dcfd365ba73 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:13.593915 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-15ffa4e4-a2b5-4c42-a9e8-0dcfd365ba73 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:13.594363 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-15ffa4e4-a2b5-4c42-a9e8-0dcfd365ba73 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:13.595163 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-15ffa4e4-a2b5-4c42-a9e8-0dcfd365ba73 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:13.595598 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-15ffa4e4-a2b5-4c42-a9e8-0dcfd365ba73 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:13.724117 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-15ffa4e4-a2b5-4c42-a9e8-0dcfd365ba73 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:13.732967 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-15ffa4e4-a2b5-4c42-a9e8-0dcfd365ba73 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:13.734525 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-15ffa4e4-a2b5-4c42-a9e8-0dcfd365ba73 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:13.735663 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-15ffa4e4-a2b5-4c42-a9e8-0dcfd365ba73 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.151993 Nov 02 23:08:13.736212 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 119/235] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:08:13 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:08:13.761067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3dfc3b28-93c5-46e6-9aba-f74dacad094b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:13.761676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3dfc3b28-93c5-46e6-9aba-f74dacad094b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:13.767520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dfc3b28-93c5-46e6-9aba-f74dacad094b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:13.767962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dfc3b28-93c5-46e6-9aba-f74dacad094b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:13.768719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dfc3b28-93c5-46e6-9aba-f74dacad094b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:13.769144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dfc3b28-93c5-46e6-9aba-f74dacad094b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:13.896818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3dfc3b28-93c5-46e6-9aba-f74dacad094b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:13.903958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3dfc3b28-93c5-46e6-9aba-f74dacad094b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.146482 Nov 02 23:08:13.904526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 117/236] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:13 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:13.945345 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-59097aff-4298-4427-b79b-684326c13bda tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:13.945947 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-59097aff-4298-4427-b79b-684326c13bda tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:13.951859 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-59097aff-4298-4427-b79b-684326c13bda tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:13.952309 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-59097aff-4298-4427-b79b-684326c13bda tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:13.953080 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-59097aff-4298-4427-b79b-684326c13bda tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:13.953514 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-59097aff-4298-4427-b79b-684326c13bda tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:14.087494 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-59097aff-4298-4427-b79b-684326c13bda tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:14.095044 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-59097aff-4298-4427-b79b-684326c13bda tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.153256 Nov 02 23:08:14.095627 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 120/237] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:13 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:14.223447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4ef154d6-c908-4c22-9c52-4fc5b1776f02 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:14.224050 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4ef154d6-c908-4c22-9c52-4fc5b1776f02 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:14.230103 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ef154d6-c908-4c22-9c52-4fc5b1776f02 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:14.230830 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ef154d6-c908-4c22-9c52-4fc5b1776f02 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:14.231657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ef154d6-c908-4c22-9c52-4fc5b1776f02 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:14.232251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ef154d6-c908-4c22-9c52-4fc5b1776f02 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:14.363521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4ef154d6-c908-4c22-9c52-4fc5b1776f02 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:14.371267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4ef154d6-c908-4c22-9c52-4fc5b1776f02 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.151642 Nov 02 23:08:14.371837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 118/238] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:14 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:14.753258 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-7ca86953-eb15-4439-a664-b05bdec1ba36 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:14.753846 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-7ca86953-eb15-4439-a664-b05bdec1ba36 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:14.759800 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7ca86953-eb15-4439-a664-b05bdec1ba36 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:14.760246 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7ca86953-eb15-4439-a664-b05bdec1ba36 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:14.761041 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7ca86953-eb15-4439-a664-b05bdec1ba36 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:14.761454 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7ca86953-eb15-4439-a664-b05bdec1ba36 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:14.890196 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-7ca86953-eb15-4439-a664-b05bdec1ba36 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:14.898313 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-7ca86953-eb15-4439-a664-b05bdec1ba36 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:14.899858 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-7ca86953-eb15-4439-a664-b05bdec1ba36 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:14.900951 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-7ca86953-eb15-4439-a664-b05bdec1ba36 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.151365 Nov 02 23:08:14.901516 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 121/239] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:08:14 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:08:14.920718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7d87d63e-9070-42e5-8ec5-540c4cc85c14 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:14.921311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7d87d63e-9070-42e5-8ec5-540c4cc85c14 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:14.927040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7d87d63e-9070-42e5-8ec5-540c4cc85c14 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:14.927515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7d87d63e-9070-42e5-8ec5-540c4cc85c14 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:14.928262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7d87d63e-9070-42e5-8ec5-540c4cc85c14 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:14.928684 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7d87d63e-9070-42e5-8ec5-540c4cc85c14 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:15.055534 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7d87d63e-9070-42e5-8ec5-540c4cc85c14 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:15.063085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7d87d63e-9070-42e5-8ec5-540c4cc85c14 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.145864 Nov 02 23:08:15.063667 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 119/240] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:14 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:15.110903 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d8cb5ad3-0a0f-4d39-8d75-8f1993b7d306 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:15.111535 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d8cb5ad3-0a0f-4d39-8d75-8f1993b7d306 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:15.117857 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d8cb5ad3-0a0f-4d39-8d75-8f1993b7d306 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:15.118310 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d8cb5ad3-0a0f-4d39-8d75-8f1993b7d306 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:15.119134 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d8cb5ad3-0a0f-4d39-8d75-8f1993b7d306 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:15.119788 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d8cb5ad3-0a0f-4d39-8d75-8f1993b7d306 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:15.249237 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-d8cb5ad3-0a0f-4d39-8d75-8f1993b7d306 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:15.257412 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d8cb5ad3-0a0f-4d39-8d75-8f1993b7d306 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.150170 Nov 02 23:08:15.257916 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 122/241] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:15 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:15.389187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7376f320-6efc-48c1-9067-bbdd2ad7e44c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:15.389980 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7376f320-6efc-48c1-9067-bbdd2ad7e44c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:15.397026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7376f320-6efc-48c1-9067-bbdd2ad7e44c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:15.397476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7376f320-6efc-48c1-9067-bbdd2ad7e44c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:15.398249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7376f320-6efc-48c1-9067-bbdd2ad7e44c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:15.398695 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7376f320-6efc-48c1-9067-bbdd2ad7e44c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:15.532526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7376f320-6efc-48c1-9067-bbdd2ad7e44c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:15.539718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7376f320-6efc-48c1-9067-bbdd2ad7e44c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.154752 Nov 02 23:08:15.540285 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 120/242] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:15 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:15.924218 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-84aa11f7-a7f8-4529-ac9d-29cb3a1409b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:15.924218 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-84aa11f7-a7f8-4529-ac9d-29cb3a1409b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:15.925498 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-84aa11f7-a7f8-4529-ac9d-29cb3a1409b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:15.925948 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-84aa11f7-a7f8-4529-ac9d-29cb3a1409b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:15.926801 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-84aa11f7-a7f8-4529-ac9d-29cb3a1409b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:15.928185 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-84aa11f7-a7f8-4529-ac9d-29cb3a1409b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:16.077380 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-84aa11f7-a7f8-4529-ac9d-29cb3a1409b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:16.081341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e5606822-e0c2-4fd8-b7c0-35c2dec118e5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:16.081998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e5606822-e0c2-4fd8-b7c0-35c2dec118e5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:16.087700 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-84aa11f7-a7f8-4529-ac9d-29cb3a1409b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:16.088825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e5606822-e0c2-4fd8-b7c0-35c2dec118e5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:16.089200 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-84aa11f7-a7f8-4529-ac9d-29cb3a1409b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:16.089420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e5606822-e0c2-4fd8-b7c0-35c2dec118e5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:16.090411 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e5606822-e0c2-4fd8-b7c0-35c2dec118e5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:16.090555 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-84aa11f7-a7f8-4529-ac9d-29cb3a1409b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.175458 Nov 02 23:08:16.091096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e5606822-e0c2-4fd8-b7c0-35c2dec118e5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:16.098966 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 123/243] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:08:15 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:08:16.261238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e5606822-e0c2-4fd8-b7c0-35c2dec118e5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:16.278788 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-13cd918b-2090-49e0-a496-4a14bad825db tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:16.279596 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-13cd918b-2090-49e0-a496-4a14bad825db tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:16.288325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e5606822-e0c2-4fd8-b7c0-35c2dec118e5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.212140 Nov 02 23:08:16.293578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 121/244] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:16 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:16.293951 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-13cd918b-2090-49e0-a496-4a14bad825db tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:16.295654 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-13cd918b-2090-49e0-a496-4a14bad825db tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:16.296704 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-13cd918b-2090-49e0-a496-4a14bad825db tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:16.297370 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-13cd918b-2090-49e0-a496-4a14bad825db tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:16.511049 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-13cd918b-2090-49e0-a496-4a14bad825db tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:16.520087 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-13cd918b-2090-49e0-a496-4a14bad825db tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.245215 Nov 02 23:08:16.522394 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 124/245] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:16 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:16.566489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6510c2d2-1b34-4dbd-90f7-7fbddbda5b68 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:16.566489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6510c2d2-1b34-4dbd-90f7-7fbddbda5b68 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:16.573970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6510c2d2-1b34-4dbd-90f7-7fbddbda5b68 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:16.575227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6510c2d2-1b34-4dbd-90f7-7fbddbda5b68 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:16.578073 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6510c2d2-1b34-4dbd-90f7-7fbddbda5b68 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:16.580196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6510c2d2-1b34-4dbd-90f7-7fbddbda5b68 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:16.687345 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [req-9e8f12af-e82b-4d6c-a4bb-165bdb14d405 req-29038933-4ae3-4a8e-8789-ac8f3f10ee6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ccc33d-e3f8-467c-9f5f-66238348fa70", "name": "network-vif-plugged", "status": "completed", "tag": "9ee5b124-d818-4612-b44b-e2c1d34e5cf3"}]} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:16.689054 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:08:16.689054 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: warnings.warn(msg) Nov 02 23:08:16.696687 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-9e8f12af-e82b-4d6c-a4bb-165bdb14d405 req-29038933-4ae3-4a8e-8789-ac8f3f10ee6d service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:16.697295 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-9e8f12af-e82b-4d6c-a4bb-165bdb14d405 req-29038933-4ae3-4a8e-8789-ac8f3f10ee6d service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:16.710494 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.compute.server_external_events [req-9e8f12af-e82b-4d6c-a4bb-165bdb14d405 req-29038933-4ae3-4a8e-8789-ac8f3f10ee6d service nova] Creating event network-vif-plugged:9ee5b124-d818-4612-b44b-e2c1d34e5cf3 for instance 84ccc33d-e3f8-467c-9f5f-66238348fa70 on hv-cinder-81584 Nov 02 23:08:16.716193 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [req-9e8f12af-e82b-4d6c-a4bb-165bdb14d405 req-29038933-4ae3-4a8e-8789-ac8f3f10ee6d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103140 Nov 02 23:08:16.716994 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 125/246] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:08:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:08:16.765869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6510c2d2-1b34-4dbd-90f7-7fbddbda5b68 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:16.773662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6510c2d2-1b34-4dbd-90f7-7fbddbda5b68 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.219618 Nov 02 23:08:16.774237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 122/247] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:16 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:17.040234 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-83945ff1-0a5f-46df-b33e-5852663f4def tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-237571841", "imageRef": "4159c567-fd66-4bbb-9bf4-6ce0afd65d88", "flavorRef": "452", "networks": [{"uuid": "f1dc646b-af38-4f41-a8b4-d4830edd2d7e"}]}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:17.103999 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.network.neutron [None req-83945ff1-0a5f-46df-b33e-5852663f4def tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] validate_networks() for [('f1dc646b-af38-4f41-a8b4-d4830edd2d7e', None, None, None, None, None)] {{(pid=115799) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 23:08:17.110687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4667659c-e77c-44e1-bbfc-fbfc5995d909 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:17.111614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4667659c-e77c-44e1-bbfc-fbfc5995d909 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:17.125437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4667659c-e77c-44e1-bbfc-fbfc5995d909 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:17.125913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4667659c-e77c-44e1-bbfc-fbfc5995d909 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:17.126770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4667659c-e77c-44e1-bbfc-fbfc5995d909 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:17.127247 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4667659c-e77c-44e1-bbfc-fbfc5995d909 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:17.291200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4667659c-e77c-44e1-bbfc-fbfc5995d909 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:17.299786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4667659c-e77c-44e1-bbfc-fbfc5995d909 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:17.301341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4667659c-e77c-44e1-bbfc-fbfc5995d909 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:17.302623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4667659c-e77c-44e1-bbfc-fbfc5995d909 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.195983 Nov 02 23:08:17.303440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 123/248] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:08:17 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:08:17.314172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8c092cb2-2e8e-4513-a6e8-a9c9540cc509 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:17.314800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8c092cb2-2e8e-4513-a6e8-a9c9540cc509 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:17.321962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c092cb2-2e8e-4513-a6e8-a9c9540cc509 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:17.322418 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c092cb2-2e8e-4513-a6e8-a9c9540cc509 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:17.323424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c092cb2-2e8e-4513-a6e8-a9c9540cc509 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:17.323862 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c092cb2-2e8e-4513-a6e8-a9c9540cc509 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:17.465232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8c092cb2-2e8e-4513-a6e8-a9c9540cc509 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:17.472439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8c092cb2-2e8e-4513-a6e8-a9c9540cc509 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.165787 Nov 02 23:08:17.473016 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 124/249] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:17 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:17.537382 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6a71a2bc-fd4e-4d14-b3f9-994e7f0bc17d tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:17.537589 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-83945ff1-0a5f-46df-b33e-5852663f4def tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Flavor limits 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 23:08:17.538003 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-83945ff1-0a5f-46df-b33e-5852663f4def tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Image limits 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 23:08:17.538132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6a71a2bc-fd4e-4d14-b3f9-994e7f0bc17d tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:17.538525 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-83945ff1-0a5f-46df-b33e-5852663f4def tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Flavor pref 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 23:08:17.538986 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-83945ff1-0a5f-46df-b33e-5852663f4def tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Image pref 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 23:08:17.539392 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-83945ff1-0a5f-46df-b33e-5852663f4def tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 23:08:17.544120 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a71a2bc-fd4e-4d14-b3f9-994e7f0bc17d tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:17.544925 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a71a2bc-fd4e-4d14-b3f9-994e7f0bc17d tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:17.545734 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a71a2bc-fd4e-4d14-b3f9-994e7f0bc17d tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:17.546166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a71a2bc-fd4e-4d14-b3f9-994e7f0bc17d tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:17.548299 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-83945ff1-0a5f-46df-b33e-5852663f4def tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:17.548746 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-83945ff1-0a5f-46df-b33e-5852663f4def tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:17.549541 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-83945ff1-0a5f-46df-b33e-5852663f4def tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:17.550715 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-83945ff1-0a5f-46df-b33e-5852663f4def tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:17.574335 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.quota [None req-83945ff1-0a5f-46df-b33e-5852663f4def tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Getting quotas for project 597c421223e44586815fe2608b4f1f57. Resources: {'cores', 'instances', 'ram'} {{(pid=115799) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:08:17.579307 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.quota [None req-83945ff1-0a5f-46df-b33e-5852663f4def tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Getting quotas for user 5c8ea0ff3573488eac0a388cd3c97353 and project 597c421223e44586815fe2608b4f1f57. Resources: {'cores', 'instances', 'ram'} {{(pid=115799) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:08:17.608368 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-83945ff1-0a5f-46df-b33e-5852663f4def tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Going to run 1 instances... {{(pid=115799) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 23:08:17.614792 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-83945ff1-0a5f-46df-b33e-5852663f4def tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4159c567-fd66-4bbb-9bf4-6ce0afd65d88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 23:08:17.672634 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-83945ff1-0a5f-46df-b33e-5852663f4def tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637564 Nov 02 23:08:17.674077 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 126/250] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 2 23:08:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 23:08:17.692413 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-6ca43bbe-820e-4671-b0f6-d5d235b11a30 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:17.698418 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-6ca43bbe-820e-4671-b0f6-d5d235b11a30 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:17.718095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6a71a2bc-fd4e-4d14-b3f9-994e7f0bc17d tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:17.730040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6a71a2bc-fd4e-4d14-b3f9-994e7f0bc17d tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.196259 Nov 02 23:08:17.732402 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 125/251] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:17 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:17.785157 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6ca43bbe-820e-4671-b0f6-d5d235b11a30 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:17.791594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dd2b6adb-2b30-49f8-ae13-39bd0a59edab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:17.792563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dd2b6adb-2b30-49f8-ae13-39bd0a59edab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:17.795751 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-6ca43bbe-820e-4671-b0f6-d5d235b11a30 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1213 microversion: 2.1 time: 0.110526 Nov 02 23:08:17.796390 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 127/252] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:17 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:17.810736 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd2b6adb-2b30-49f8-ae13-39bd0a59edab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:17.811311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd2b6adb-2b30-49f8-ae13-39bd0a59edab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:17.813424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd2b6adb-2b30-49f8-ae13-39bd0a59edab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:17.813993 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd2b6adb-2b30-49f8-ae13-39bd0a59edab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:18.006743 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dd2b6adb-2b30-49f8-ae13-39bd0a59edab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:18.014965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dd2b6adb-2b30-49f8-ae13-39bd0a59edab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.228077 Nov 02 23:08:18.015741 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 126/253] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:17 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:18.321174 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-6f366d0f-2e36-4b33-99fe-929a5ddb1860 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:18.322154 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-6f366d0f-2e36-4b33-99fe-929a5ddb1860 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:18.329790 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6f366d0f-2e36-4b33-99fe-929a5ddb1860 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:18.330262 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6f366d0f-2e36-4b33-99fe-929a5ddb1860 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:18.331298 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6f366d0f-2e36-4b33-99fe-929a5ddb1860 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:18.331730 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6f366d0f-2e36-4b33-99fe-929a5ddb1860 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:18.490570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-14e72025-3515-419b-a72b-88e0d19721f1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:18.491227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-14e72025-3515-419b-a72b-88e0d19721f1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:18.497874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14e72025-3515-419b-a72b-88e0d19721f1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:18.498578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14e72025-3515-419b-a72b-88e0d19721f1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:18.499413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14e72025-3515-419b-a72b-88e0d19721f1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:18.499847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14e72025-3515-419b-a72b-88e0d19721f1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:18.502046 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6f366d0f-2e36-4b33-99fe-929a5ddb1860 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:18.510574 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6f366d0f-2e36-4b33-99fe-929a5ddb1860 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:18.512120 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6f366d0f-2e36-4b33-99fe-929a5ddb1860 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:18.513438 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-6f366d0f-2e36-4b33-99fe-929a5ddb1860 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.196401 Nov 02 23:08:18.514013 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 128/254] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:08:18 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:08:18.643644 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-14e72025-3515-419b-a72b-88e0d19721f1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:18.652098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-14e72025-3515-419b-a72b-88e0d19721f1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.166178 Nov 02 23:08:18.652668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 127/255] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:18 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:18.732847 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [req-7d7c4835-7743-497b-abaa-6c7cd359eeec req-2d05ee80-6351-4b4d-acd4-546a28013cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac92ad6f-13c2-4a74-bf07-98d2935a9b26", "name": "network-vif-plugged", "status": "completed", "tag": "cf4d550b-19f6-4434-904e-99469026b6db"}, {"server_uuid": "15750fff-dec6-4bcc-a69c-0f9576f7970e", "name": "network-vif-plugged", "status": "completed", "tag": "1be9ce23-4225-4b98-9740-ed6ade9ebf4a"}, {"server_uuid": "b8f293cf-a963-45dd-aaed-9149bfcfca7e", "name": "network-vif-plugged", "status": "completed", "tag": "4d11da3d-8afb-463d-8fa2-77489cf1ff97"}]} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:18.734848 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:08:18.734848 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: warnings.warn(msg) Nov 02 23:08:18.745987 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-7d7c4835-7743-497b-abaa-6c7cd359eeec req-2d05ee80-6351-4b4d-acd4-546a28013cc6 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:18.746429 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-7d7c4835-7743-497b-abaa-6c7cd359eeec req-2d05ee80-6351-4b4d-acd4-546a28013cc6 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:18.747782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1637ecb6-ee43-4ac8-a9c2-218746d9b00e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:18.748484 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1637ecb6-ee43-4ac8-a9c2-218746d9b00e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:18.754592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1637ecb6-ee43-4ac8-a9c2-218746d9b00e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:18.755181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1637ecb6-ee43-4ac8-a9c2-218746d9b00e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:18.756930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1637ecb6-ee43-4ac8-a9c2-218746d9b00e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:18.757622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1637ecb6-ee43-4ac8-a9c2-218746d9b00e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:18.762516 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.compute.server_external_events [req-7d7c4835-7743-497b-abaa-6c7cd359eeec req-2d05ee80-6351-4b4d-acd4-546a28013cc6 service nova] Creating event network-vif-plugged:cf4d550b-19f6-4434-904e-99469026b6db for instance ac92ad6f-13c2-4a74-bf07-98d2935a9b26 on hv-cinder-81584 Nov 02 23:08:18.763048 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.compute.server_external_events [req-7d7c4835-7743-497b-abaa-6c7cd359eeec req-2d05ee80-6351-4b4d-acd4-546a28013cc6 service nova] Creating event network-vif-plugged:1be9ce23-4225-4b98-9740-ed6ade9ebf4a for instance 15750fff-dec6-4bcc-a69c-0f9576f7970e on hv-cinder-81584 Nov 02 23:08:18.763574 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.compute.server_external_events [req-7d7c4835-7743-497b-abaa-6c7cd359eeec req-2d05ee80-6351-4b4d-acd4-546a28013cc6 service nova] Creating event network-vif-plugged:4d11da3d-8afb-463d-8fa2-77489cf1ff97 for instance b8f293cf-a963-45dd-aaed-9149bfcfca7e on hv-cinder-81584 Nov 02 23:08:18.771855 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [req-7d7c4835-7743-497b-abaa-6c7cd359eeec req-2d05ee80-6351-4b4d-acd4-546a28013cc6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.042885 Nov 02 23:08:18.772525 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 129/256] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:08:18 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:08:18.812734 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e45268ae-7831-460d-86e9-14749317bfc0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:18.813407 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e45268ae-7831-460d-86e9-14749317bfc0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:18.820189 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e45268ae-7831-460d-86e9-14749317bfc0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:18.820625 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e45268ae-7831-460d-86e9-14749317bfc0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:18.821572 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e45268ae-7831-460d-86e9-14749317bfc0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:18.821996 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e45268ae-7831-460d-86e9-14749317bfc0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:18.881943 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e45268ae-7831-460d-86e9-14749317bfc0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:18.891365 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e45268ae-7831-460d-86e9-14749317bfc0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1265 microversion: 2.1 time: 0.082401 Nov 02 23:08:18.891951 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 130/257] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:18 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:18.984487 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1637ecb6-ee43-4ac8-a9c2-218746d9b00e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:18.992864 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1637ecb6-ee43-4ac8-a9c2-218746d9b00e tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1315 microversion: 2.1 time: 0.248800 Nov 02 23:08:18.993537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 128/258] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:18 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:19.032288 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-454099a6-b772-4361-a53f-a64de3a111b6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:19.033897 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-454099a6-b772-4361-a53f-a64de3a111b6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:19.042604 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-454099a6-b772-4361-a53f-a64de3a111b6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:19.043246 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-454099a6-b772-4361-a53f-a64de3a111b6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:19.044206 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-454099a6-b772-4361-a53f-a64de3a111b6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:19.044784 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-454099a6-b772-4361-a53f-a64de3a111b6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:19.451904 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-454099a6-b772-4361-a53f-a64de3a111b6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:19.461380 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-454099a6-b772-4361-a53f-a64de3a111b6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.432827 Nov 02 23:08:19.464162 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 131/259] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:19 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:19.533579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-206cc7e1-c983-4e23-b374-3676052db1fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:19.534171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-206cc7e1-c983-4e23-b374-3676052db1fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:19.548420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-206cc7e1-c983-4e23-b374-3676052db1fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:19.548879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-206cc7e1-c983-4e23-b374-3676052db1fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:19.549762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-206cc7e1-c983-4e23-b374-3676052db1fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:19.550130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-206cc7e1-c983-4e23-b374-3676052db1fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:19.668593 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d8ed05d1-34f5-4400-a469-43f67825206b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:19.669863 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d8ed05d1-34f5-4400-a469-43f67825206b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:19.677732 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d8ed05d1-34f5-4400-a469-43f67825206b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:19.685425 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d8ed05d1-34f5-4400-a469-43f67825206b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:19.690081 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d8ed05d1-34f5-4400-a469-43f67825206b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:19.690849 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d8ed05d1-34f5-4400-a469-43f67825206b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:20.016032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-206cc7e1-c983-4e23-b374-3676052db1fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:20.026324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-206cc7e1-c983-4e23-b374-3676052db1fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:20.028227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-206cc7e1-c983-4e23-b374-3676052db1fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:20.029689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-206cc7e1-c983-4e23-b374-3676052db1fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.500146 Nov 02 23:08:20.030778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 129/260] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:08:19 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:08:20.036352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bce8d888-8161-4ff6-9770-cdd83e468d97 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:20.037831 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bce8d888-8161-4ff6-9770-cdd83e468d97 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:20.045728 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bce8d888-8161-4ff6-9770-cdd83e468d97 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:20.046776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bce8d888-8161-4ff6-9770-cdd83e468d97 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:20.047781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bce8d888-8161-4ff6-9770-cdd83e468d97 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:20.048371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bce8d888-8161-4ff6-9770-cdd83e468d97 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:20.058119 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-d8ed05d1-34f5-4400-a469-43f67825206b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:20.065492 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d8ed05d1-34f5-4400-a469-43f67825206b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.400678 Nov 02 23:08:20.075795 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 132/261] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:19 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:20.075795 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ce73ceb4-3321-44b3-9107-630810e93c66 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:20.075795 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ce73ceb4-3321-44b3-9107-630810e93c66 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:20.089403 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ce73ceb4-3321-44b3-9107-630810e93c66 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:20.089853 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ce73ceb4-3321-44b3-9107-630810e93c66 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:20.093361 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ce73ceb4-3321-44b3-9107-630810e93c66 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:20.096363 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ce73ceb4-3321-44b3-9107-630810e93c66 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:20.141204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bce8d888-8161-4ff6-9770-cdd83e468d97 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:20.149409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bce8d888-8161-4ff6-9770-cdd83e468d97 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1271 microversion: 2.1 time: 0.117360 Nov 02 23:08:20.151610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 130/262] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:20 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1271 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:20.482439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8cc1c1be-ab4a-450d-ac68-5e25c7742424 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:20.483337 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8cc1c1be-ab4a-450d-ac68-5e25c7742424 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:20.492567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8cc1c1be-ab4a-450d-ac68-5e25c7742424 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:20.493138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8cc1c1be-ab4a-450d-ac68-5e25c7742424 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:20.494181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8cc1c1be-ab4a-450d-ac68-5e25c7742424 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:20.495658 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8cc1c1be-ab4a-450d-ac68-5e25c7742424 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:20.546515 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-ce73ceb4-3321-44b3-9107-630810e93c66 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:20.556466 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ce73ceb4-3321-44b3-9107-630810e93c66 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1503 microversion: 2.1 time: 0.486856 Nov 02 23:08:20.564222 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 133/263] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:20 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1503 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:20.693928 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8cc1c1be-ab4a-450d-ac68-5e25c7742424 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:20.704095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8cc1c1be-ab4a-450d-ac68-5e25c7742424 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.226564 Nov 02 23:08:20.708285 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 131/264] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:20 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:21.047461 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-219c53c8-609e-444c-8781-33155bfa2b7e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:21.048295 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-219c53c8-609e-444c-8781-33155bfa2b7e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:21.054733 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-219c53c8-609e-444c-8781-33155bfa2b7e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:21.055387 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-219c53c8-609e-444c-8781-33155bfa2b7e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:21.056163 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-219c53c8-609e-444c-8781-33155bfa2b7e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:21.056745 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-219c53c8-609e-444c-8781-33155bfa2b7e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:21.083855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-877644fa-c57a-465c-9b3c-58f517fe5aa1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:21.084825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-877644fa-c57a-465c-9b3c-58f517fe5aa1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:21.091860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-877644fa-c57a-465c-9b3c-58f517fe5aa1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:21.092476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-877644fa-c57a-465c-9b3c-58f517fe5aa1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:21.093387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-877644fa-c57a-465c-9b3c-58f517fe5aa1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:21.093957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-877644fa-c57a-465c-9b3c-58f517fe5aa1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:21.231713 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-219c53c8-609e-444c-8781-33155bfa2b7e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:21.240501 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-219c53c8-609e-444c-8781-33155bfa2b7e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:21.242329 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-219c53c8-609e-444c-8781-33155bfa2b7e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:21.243508 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-219c53c8-609e-444c-8781-33155bfa2b7e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.200106 Nov 02 23:08:21.244079 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 134/265] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:08:21 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:08:21.248610 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b474c325-b9e3-4a2f-bf61-e93b8523ecc1 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:21.249401 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b474c325-b9e3-4a2f-bf61-e93b8523ecc1 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:21.261318 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b474c325-b9e3-4a2f-bf61-e93b8523ecc1 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:21.261860 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b474c325-b9e3-4a2f-bf61-e93b8523ecc1 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:21.263881 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b474c325-b9e3-4a2f-bf61-e93b8523ecc1 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:21.264524 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b474c325-b9e3-4a2f-bf61-e93b8523ecc1 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:21.277040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-877644fa-c57a-465c-9b3c-58f517fe5aa1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:21.291118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-877644fa-c57a-465c-9b3c-58f517fe5aa1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.211893 Nov 02 23:08:21.292040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 132/266] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:21 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:21.430566 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-b474c325-b9e3-4a2f-bf61-e93b8523ecc1 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:21.439143 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b474c325-b9e3-4a2f-bf61-e93b8523ecc1 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1313 microversion: 2.1 time: 0.193710 Nov 02 23:08:21.439949 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 135/267] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:21 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:21.727962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-113687a9-5e44-46a2-a7db-063bbabf8716 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:21.729490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-113687a9-5e44-46a2-a7db-063bbabf8716 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:21.738364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-113687a9-5e44-46a2-a7db-063bbabf8716 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:21.738798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-113687a9-5e44-46a2-a7db-063bbabf8716 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:21.739774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-113687a9-5e44-46a2-a7db-063bbabf8716 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:21.740338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-113687a9-5e44-46a2-a7db-063bbabf8716 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:21.993871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-113687a9-5e44-46a2-a7db-063bbabf8716 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:22.003976 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-113687a9-5e44-46a2-a7db-063bbabf8716 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.282570 Nov 02 23:08:22.015432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 133/268] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:21 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:22.058435 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d12ee60b-5e7e-4d4b-9689-6120289e25f5 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f30b27c-7e00-4c33-b853-b18dc2e16111"}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:22.060545 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d12ee60b-5e7e-4d4b-9689-6120289e25f5 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:22.067262 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d12ee60b-5e7e-4d4b-9689-6120289e25f5 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:22.069210 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d12ee60b-5e7e-4d4b-9689-6120289e25f5 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:22.070540 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d12ee60b-5e7e-4d4b-9689-6120289e25f5 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:22.071936 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d12ee60b-5e7e-4d4b-9689-6120289e25f5 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:22.263881 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a4136a93-fcdc-46ce-8e65-f1df32877a13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:22.264603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a4136a93-fcdc-46ce-8e65-f1df32877a13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:22.272014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a4136a93-fcdc-46ce-8e65-f1df32877a13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:22.272590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a4136a93-fcdc-46ce-8e65-f1df32877a13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:22.273665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a4136a93-fcdc-46ce-8e65-f1df32877a13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:22.274153 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a4136a93-fcdc-46ce-8e65-f1df32877a13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:22.482405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a4136a93-fcdc-46ce-8e65-f1df32877a13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:22.492871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a4136a93-fcdc-46ce-8e65-f1df32877a13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:22.494632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a4136a93-fcdc-46ce-8e65-f1df32877a13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:22.495778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a4136a93-fcdc-46ce-8e65-f1df32877a13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1406 microversion: 2.20 time: 0.238373 Nov 02 23:08:22.496342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 134/269] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:08:22 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:08:22.510568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c5ea6d97-ede0-4136-b326-506d71fa49c6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:22.511206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c5ea6d97-ede0-4136-b326-506d71fa49c6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:22.517359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c5ea6d97-ede0-4136-b326-506d71fa49c6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:22.517812 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c5ea6d97-ede0-4136-b326-506d71fa49c6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:22.518582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c5ea6d97-ede0-4136-b326-506d71fa49c6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:22.519209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c5ea6d97-ede0-4136-b326-506d71fa49c6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:22.557903 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d12ee60b-5e7e-4d4b-9689-6120289e25f5 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "POST /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.503502 Nov 02 23:08:22.558505 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 136/270] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 2 23:08:22 2021] POST /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70/os-volume_attachments => generated 194 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:08:22.574342 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-10044066-64ec-4a2a-90b5-837072c562fc tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:22.576006 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-10044066-64ec-4a2a-90b5-837072c562fc tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:22.583917 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-10044066-64ec-4a2a-90b5-837072c562fc tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:22.584777 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-10044066-64ec-4a2a-90b5-837072c562fc tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:22.585890 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-10044066-64ec-4a2a-90b5-837072c562fc tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:22.586605 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-10044066-64ec-4a2a-90b5-837072c562fc tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:22.712968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c5ea6d97-ede0-4136-b326-506d71fa49c6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:22.721159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c5ea6d97-ede0-4136-b326-506d71fa49c6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1364 microversion: 2.1 time: 0.223609 Nov 02 23:08:22.722307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 135/271] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:22 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:22.728050 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-fa788aa4-8db1-4192-be03-0f1a13968efc req-148b3014-029e-44d4-b1fa-9a4454693bed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10697196-84a0-45eb-bc4c-ff5e8b059211", "tag": "bcf719f7-14fc-4f88-bb7a-8f0b24e6691c"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:22.730538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:08:22.730538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:08:22.738825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-fa788aa4-8db1-4192-be03-0f1a13968efc req-148b3014-029e-44d4-b1fa-9a4454693bed service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:22.740498 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-fa788aa4-8db1-4192-be03-0f1a13968efc req-148b3014-029e-44d4-b1fa-9a4454693bed service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:22.752799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-fa788aa4-8db1-4192-be03-0f1a13968efc req-148b3014-029e-44d4-b1fa-9a4454693bed service nova] Creating event network-changed:bcf719f7-14fc-4f88-bb7a-8f0b24e6691c for instance 10697196-84a0-45eb-bc4c-ff5e8b059211 on hv-cinder-81584 Nov 02 23:08:22.759703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-fa788aa4-8db1-4192-be03-0f1a13968efc req-148b3014-029e-44d4-b1fa-9a4454693bed service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035765 Nov 02 23:08:22.760559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 136/272] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:08:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:08:22.813610 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-10044066-64ec-4a2a-90b5-837072c562fc tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:22.822688 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-10044066-64ec-4a2a-90b5-837072c562fc tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1313 microversion: 2.1 time: 0.262608 Nov 02 23:08:22.823498 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 137/273] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:22 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:23.022754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-afec780a-7d1e-47bd-80a8-841a5165fff8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:23.023475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-afec780a-7d1e-47bd-80a8-841a5165fff8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:23.029639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-afec780a-7d1e-47bd-80a8-841a5165fff8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:23.030087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-afec780a-7d1e-47bd-80a8-841a5165fff8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:23.030858 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-afec780a-7d1e-47bd-80a8-841a5165fff8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:23.031455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-afec780a-7d1e-47bd-80a8-841a5165fff8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:23.183880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-afec780a-7d1e-47bd-80a8-841a5165fff8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:23.199275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-afec780a-7d1e-47bd-80a8-841a5165fff8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1318 microversion: 2.1 time: 0.180546 Nov 02 23:08:23.215666 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 137/274] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:23 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:23.513661 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e5c91b4a-c3b3-4200-a676-227bb6fe7b80 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:23.514167 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e5c91b4a-c3b3-4200-a676-227bb6fe7b80 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:23.520486 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e5c91b4a-c3b3-4200-a676-227bb6fe7b80 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:23.520934 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e5c91b4a-c3b3-4200-a676-227bb6fe7b80 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:23.521711 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e5c91b4a-c3b3-4200-a676-227bb6fe7b80 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:23.522141 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e5c91b4a-c3b3-4200-a676-227bb6fe7b80 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:23.711939 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e5c91b4a-c3b3-4200-a676-227bb6fe7b80 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:23.719931 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e5c91b4a-c3b3-4200-a676-227bb6fe7b80 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:23.721526 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e5c91b4a-c3b3-4200-a676-227bb6fe7b80 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:23.722798 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e5c91b4a-c3b3-4200-a676-227bb6fe7b80 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1598 microversion: 2.20 time: 0.213077 Nov 02 23:08:23.723479 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 138/275] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:08:23 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1598 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:08:23.737601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d7f5451f-ec02-4d41-9a27-c93a99963f0c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:23.738208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d7f5451f-ec02-4d41-9a27-c93a99963f0c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:23.743096 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a8e0fb37-ee7b-4233-80a0-8435dd19a179 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:23.743588 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a8e0fb37-ee7b-4233-80a0-8435dd19a179 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:23.744706 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d7f5451f-ec02-4d41-9a27-c93a99963f0c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:23.745151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d7f5451f-ec02-4d41-9a27-c93a99963f0c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:23.745919 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d7f5451f-ec02-4d41-9a27-c93a99963f0c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:23.746351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d7f5451f-ec02-4d41-9a27-c93a99963f0c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:23.749320 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a8e0fb37-ee7b-4233-80a0-8435dd19a179 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:23.749771 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a8e0fb37-ee7b-4233-80a0-8435dd19a179 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:23.750557 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a8e0fb37-ee7b-4233-80a0-8435dd19a179 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:23.751021 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a8e0fb37-ee7b-4233-80a0-8435dd19a179 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:23.840396 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a8e0fb37-ee7b-4233-80a0-8435dd19a179 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101664 Nov 02 23:08:23.841176 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 139/276] 10.222.0.41 () {60 vars in 1315 bytes} [Tue Nov 2 23:08:23 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:08:23.846436 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-fab47871-8b3b-4ba4-b145-b456942797fd tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:23.847293 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-fab47871-8b3b-4ba4-b145-b456942797fd tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:23.854615 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fab47871-8b3b-4ba4-b145-b456942797fd tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:23.855133 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fab47871-8b3b-4ba4-b145-b456942797fd tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:23.855930 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fab47871-8b3b-4ba4-b145-b456942797fd tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:23.856365 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fab47871-8b3b-4ba4-b145-b456942797fd tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:23.916216 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d7f5451f-ec02-4d41-9a27-c93a99963f0c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:23.923955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d7f5451f-ec02-4d41-9a27-c93a99963f0c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1550 microversion: 2.1 time: 0.189964 Nov 02 23:08:23.924540 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 138/277] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:23 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1550 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:23.940647 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-66fb5ae5-2cfa-41d7-836f-f5bdd76b654e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:23.941136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-66fb5ae5-2cfa-41d7-836f-f5bdd76b654e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:23.947732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66fb5ae5-2cfa-41d7-836f-f5bdd76b654e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:23.948186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66fb5ae5-2cfa-41d7-836f-f5bdd76b654e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:23.949289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66fb5ae5-2cfa-41d7-836f-f5bdd76b654e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:23.949729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66fb5ae5-2cfa-41d7-836f-f5bdd76b654e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:24.085392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-66fb5ae5-2cfa-41d7-836f-f5bdd76b654e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.148385 Nov 02 23:08:24.092126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 139/278] 10.222.0.41 () {58 vars in 1274 bytes} [Tue Nov 2 23:08:23 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/os-interface => generated 285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:08:24.227126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-58050001-7f8e-42da-854d-2519e5cb6523 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:24.229171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-58050001-7f8e-42da-854d-2519e5cb6523 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:24.244009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58050001-7f8e-42da-854d-2519e5cb6523 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:24.244784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58050001-7f8e-42da-854d-2519e5cb6523 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:24.245886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58050001-7f8e-42da-854d-2519e5cb6523 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:24.246832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58050001-7f8e-42da-854d-2519e5cb6523 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:24.355745 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-fab47871-8b3b-4ba4-b145-b456942797fd tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:24.363290 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-fab47871-8b3b-4ba4-b145-b456942797fd tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1313 microversion: 2.1 time: 0.520240 Nov 02 23:08:24.363879 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 140/279] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:23 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1313 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:24.725952 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-58050001-7f8e-42da-854d-2519e5cb6523 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:24.736025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-58050001-7f8e-42da-854d-2519e5cb6523 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1508 microversion: 2.1 time: 0.520780 Nov 02 23:08:24.737587 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 140/280] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:24 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1508 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:25.379451 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-844f076a-3a68-4d8d-ab89-d615a74abdb2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:25.380098 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-844f076a-3a68-4d8d-ab89-d615a74abdb2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:25.398096 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-844f076a-3a68-4d8d-ab89-d615a74abdb2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:25.400119 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-844f076a-3a68-4d8d-ab89-d615a74abdb2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:25.401088 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-844f076a-3a68-4d8d-ab89-d615a74abdb2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:25.403128 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-844f076a-3a68-4d8d-ab89-d615a74abdb2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:25.445345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-91681b45-f7ac-4ff5-aee4-d5fb0178ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2014687063", "imageRef": "4159c567-fd66-4bbb-9bf4-6ce0afd65d88", "flavorRef": "452", "networks": [{"uuid": "fa6c611e-389b-49dc-91f7-c2d41021d5f6"}]}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:25.520526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.network.neutron [None req-91681b45-f7ac-4ff5-aee4-d5fb0178ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] validate_networks() for [('fa6c611e-389b-49dc-91f7-c2d41021d5f6', None, None, None, None, None)] {{(pid=115800) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 23:08:25.802626 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-844f076a-3a68-4d8d-ab89-d615a74abdb2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:25.810634 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-844f076a-3a68-4d8d-ab89-d615a74abdb2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1313 microversion: 2.1 time: 0.434698 Nov 02 23:08:25.811658 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 141/281] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:25 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:26.151190 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-43900c26-eb9d-46ef-9877-c0b5a688381d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:26.153132 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-43900c26-eb9d-46ef-9877-c0b5a688381d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:26.173816 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-43900c26-eb9d-46ef-9877-c0b5a688381d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:26.174282 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-43900c26-eb9d-46ef-9877-c0b5a688381d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:26.178516 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-43900c26-eb9d-46ef-9877-c0b5a688381d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:26.178975 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-43900c26-eb9d-46ef-9877-c0b5a688381d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:26.297037 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-43900c26-eb9d-46ef-9877-c0b5a688381d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 14 microversion: 2.1 time: 0.151573 Nov 02 23:08:26.298708 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 142/282] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:08:26 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 23:08:26.304504 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [req-769a57fc-96e8-423b-b86d-418b844e55b1 req-6b9eb890-0e40-4549-ab1f-8174577e8f7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8f293cf-a963-45dd-aaed-9149bfcfca7e", "tag": "4d11da3d-8afb-463d-8fa2-77489cf1ff97"}]} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:26.305893 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:08:26.305893 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: warnings.warn(msg) Nov 02 23:08:26.326456 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-769a57fc-96e8-423b-b86d-418b844e55b1 req-6b9eb890-0e40-4549-ab1f-8174577e8f7a service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:26.326677 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-769a57fc-96e8-423b-b86d-418b844e55b1 req-6b9eb890-0e40-4549-ab1f-8174577e8f7a service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:26.342470 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.compute.server_external_events [req-769a57fc-96e8-423b-b86d-418b844e55b1 req-6b9eb890-0e40-4549-ab1f-8174577e8f7a service nova] Creating event network-changed:4d11da3d-8afb-463d-8fa2-77489cf1ff97 for instance b8f293cf-a963-45dd-aaed-9149bfcfca7e on hv-cinder-81584 Nov 02 23:08:26.348466 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [req-769a57fc-96e8-423b-b86d-418b844e55b1 req-6b9eb890-0e40-4549-ab1f-8174577e8f7a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048316 Nov 02 23:08:26.350015 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 143/283] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:08:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:08:26.357169 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-88a69468-5f12-45f9-b60a-b9959f9a5390 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:26.358431 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-88a69468-5f12-45f9-b60a-b9959f9a5390 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:26.365286 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-88a69468-5f12-45f9-b60a-b9959f9a5390 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:26.366020 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-88a69468-5f12-45f9-b60a-b9959f9a5390 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:26.367016 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-88a69468-5f12-45f9-b60a-b9959f9a5390 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:26.367642 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-88a69468-5f12-45f9-b60a-b9959f9a5390 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:26.387463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-91681b45-f7ac-4ff5-aee4-d5fb0178ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Flavor limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 23:08:26.387977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-91681b45-f7ac-4ff5-aee4-d5fb0178ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Image limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 23:08:26.395148 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-91681b45-f7ac-4ff5-aee4-d5fb0178ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Flavor pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 23:08:26.396324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-91681b45-f7ac-4ff5-aee4-d5fb0178ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Image pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 23:08:26.396751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-91681b45-f7ac-4ff5-aee4-d5fb0178ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 23:08:26.416615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-91681b45-f7ac-4ff5-aee4-d5fb0178ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:26.417078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-91681b45-f7ac-4ff5-aee4-d5fb0178ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:26.420392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-91681b45-f7ac-4ff5-aee4-d5fb0178ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:26.420842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-91681b45-f7ac-4ff5-aee4-d5fb0178ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:26.447056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-91681b45-f7ac-4ff5-aee4-d5fb0178ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Getting quotas for project 02de7621570a42e28e06ce65bd3b3000. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:08:26.452448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-91681b45-f7ac-4ff5-aee4-d5fb0178ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Getting quotas for user 6b767694343c4a488f2ba0c19b62947e and project 02de7621570a42e28e06ce65bd3b3000. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:08:26.466806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-91681b45-f7ac-4ff5-aee4-d5fb0178ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Going to run 1 instances... {{(pid=115800) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 23:08:26.469532 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-91681b45-f7ac-4ff5-aee4-d5fb0178ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4159c567-fd66-4bbb-9bf4-6ce0afd65d88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 23:08:26.527885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-91681b45-f7ac-4ff5-aee4-d5fb0178ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.088772 Nov 02 23:08:26.528861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 141/284] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 2 23:08:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 23:08:26.535683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-3fb1d59c-b21e-4346-a9ed-1bbe1bbafaa6 req-a14d1e44-c0c2-4489-80ee-482e98cb9c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15750fff-dec6-4bcc-a69c-0f9576f7970e", "tag": "1be9ce23-4225-4b98-9740-ed6ade9ebf4a"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:26.537721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:08:26.537721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:08:26.542003 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-88a69468-5f12-45f9-b60a-b9959f9a5390 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 14 microversion: 2.20 time: 0.190399 Nov 02 23:08:26.542695 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 144/285] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:08:26 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 14 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:26.546504 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-3fb1d59c-b21e-4346-a9ed-1bbe1bbafaa6 req-a14d1e44-c0c2-4489-80ee-482e98cb9c4f service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:26.547330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-3fb1d59c-b21e-4346-a9ed-1bbe1bbafaa6 req-a14d1e44-c0c2-4489-80ee-482e98cb9c4f service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:26.548493 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-43a55bc4-6528-480d-8812-05a8ec3cfc23 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45fd287b-bc36-4da3-90d9-09d47c4ccc49"}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:26.549703 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-43a55bc4-6528-480d-8812-05a8ec3cfc23 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:26.565208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-3fb1d59c-b21e-4346-a9ed-1bbe1bbafaa6 req-a14d1e44-c0c2-4489-80ee-482e98cb9c4f service nova] Creating event network-changed:1be9ce23-4225-4b98-9740-ed6ade9ebf4a for instance 15750fff-dec6-4bcc-a69c-0f9576f7970e on hv-cinder-81584 Nov 02 23:08:26.572820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-3fb1d59c-b21e-4346-a9ed-1bbe1bbafaa6 req-a14d1e44-c0c2-4489-80ee-482e98cb9c4f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042037 Nov 02 23:08:26.573618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 142/286] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:08:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:08:26.575971 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-43a55bc4-6528-480d-8812-05a8ec3cfc23 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:26.576440 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-43a55bc4-6528-480d-8812-05a8ec3cfc23 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:26.577261 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-43a55bc4-6528-480d-8812-05a8ec3cfc23 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:26.577686 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-43a55bc4-6528-480d-8812-05a8ec3cfc23 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:26.581851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ac461293-57fb-4fa2-ac15-408be5a81376 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:26.582723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ac461293-57fb-4fa2-ac15-408be5a81376 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:26.646890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ac461293-57fb-4fa2-ac15-408be5a81376 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:26.655486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ac461293-57fb-4fa2-ac15-408be5a81376 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 200 len: 1219 microversion: 2.1 time: 0.080482 Nov 02 23:08:26.657104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 143/287] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:26 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:26.829571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6b4d03c8-c61f-4e81-a6c5-cceac145ebfc tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:26.830195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6b4d03c8-c61f-4e81-a6c5-cceac145ebfc tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:26.844733 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6b4d03c8-c61f-4e81-a6c5-cceac145ebfc tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:26.845438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6b4d03c8-c61f-4e81-a6c5-cceac145ebfc tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:26.845993 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6b4d03c8-c61f-4e81-a6c5-cceac145ebfc tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:26.846428 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6b4d03c8-c61f-4e81-a6c5-cceac145ebfc tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:27.125154 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-43a55bc4-6528-480d-8812-05a8ec3cfc23 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "POST /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.580407 Nov 02 23:08:27.125972 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 145/288] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 2 23:08:26 2021] POST /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26/os-volume_attachments => generated 194 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:08:27.311572 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-734e006c-7d72-42fe-948e-1241b8fa28de tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:27.313365 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-734e006c-7d72-42fe-948e-1241b8fa28de tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:27.321708 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-734e006c-7d72-42fe-948e-1241b8fa28de tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:27.322476 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-734e006c-7d72-42fe-948e-1241b8fa28de tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:27.323601 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-734e006c-7d72-42fe-948e-1241b8fa28de tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:27.324787 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-734e006c-7d72-42fe-948e-1241b8fa28de tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:27.450332 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-734e006c-7d72-42fe-948e-1241b8fa28de tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 14 microversion: 2.1 time: 0.143513 Nov 02 23:08:27.452299 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 146/289] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:08:27 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 23:08:27.482629 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6b4d03c8-c61f-4e81-a6c5-cceac145ebfc tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:27.493723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6b4d03c8-c61f-4e81-a6c5-cceac145ebfc tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1313 microversion: 2.1 time: 0.665307 Nov 02 23:08:27.503862 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 144/290] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:26 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1313 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:27.554194 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-dc6bc980-d58f-4e14-9d4f-8c964be4c923 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:27.556384 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-dc6bc980-d58f-4e14-9d4f-8c964be4c923 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:27.571158 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dc6bc980-d58f-4e14-9d4f-8c964be4c923 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:27.571878 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dc6bc980-d58f-4e14-9d4f-8c964be4c923 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:27.572992 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dc6bc980-d58f-4e14-9d4f-8c964be4c923 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:27.573619 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dc6bc980-d58f-4e14-9d4f-8c964be4c923 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:27.674708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-04fd1221-9d0b-4c68-abc7-5f987b8dfe3c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:27.675526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-04fd1221-9d0b-4c68-abc7-5f987b8dfe3c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:27.688950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-04fd1221-9d0b-4c68-abc7-5f987b8dfe3c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:27.689873 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-dc6bc980-d58f-4e14-9d4f-8c964be4c923 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 14 microversion: 2.20 time: 0.140540 Nov 02 23:08:27.690638 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 147/291] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:08:27 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:27.695817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-04fd1221-9d0b-4c68-abc7-5f987b8dfe3c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:27.699041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-04fd1221-9d0b-4c68-abc7-5f987b8dfe3c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:27.699594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-04fd1221-9d0b-4c68-abc7-5f987b8dfe3c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:27.896320 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-04fd1221-9d0b-4c68-abc7-5f987b8dfe3c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:27.907287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-04fd1221-9d0b-4c68-abc7-5f987b8dfe3c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 200 len: 1215 microversion: 2.1 time: 0.237240 Nov 02 23:08:27.934138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 145/292] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:27 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 1215 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:28.467908 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-1a256246-79e4-48a3-bcea-67520abbab60 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:28.469897 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-1a256246-79e4-48a3-bcea-67520abbab60 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:28.492149 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1a256246-79e4-48a3-bcea-67520abbab60 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:28.492598 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1a256246-79e4-48a3-bcea-67520abbab60 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:28.493407 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1a256246-79e4-48a3-bcea-67520abbab60 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:28.493842 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1a256246-79e4-48a3-bcea-67520abbab60 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:28.526286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-38407a4c-b125-413b-a8a3-7dd73208f4e0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:28.526954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-38407a4c-b125-413b-a8a3-7dd73208f4e0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:28.534336 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-38407a4c-b125-413b-a8a3-7dd73208f4e0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:28.538642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-38407a4c-b125-413b-a8a3-7dd73208f4e0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:28.539779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-38407a4c-b125-413b-a8a3-7dd73208f4e0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:28.543574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-38407a4c-b125-413b-a8a3-7dd73208f4e0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:28.660442 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-1a256246-79e4-48a3-bcea-67520abbab60 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 14 microversion: 2.1 time: 0.200849 Nov 02 23:08:28.662064 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 148/293] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:08:28 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 23:08:28.707433 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-dadee6d9-ec7f-4371-85e9-4ee666bf592c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:28.710901 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-dadee6d9-ec7f-4371-85e9-4ee666bf592c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:28.743255 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dadee6d9-ec7f-4371-85e9-4ee666bf592c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:28.744055 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dadee6d9-ec7f-4371-85e9-4ee666bf592c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:28.747724 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dadee6d9-ec7f-4371-85e9-4ee666bf592c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:28.748389 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dadee6d9-ec7f-4371-85e9-4ee666bf592c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:28.893281 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-dadee6d9-ec7f-4371-85e9-4ee666bf592c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 14 microversion: 2.20 time: 0.192842 Nov 02 23:08:28.898425 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 149/294] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:08:28 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 14 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:28.944353 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-2c244121-dfa5-4b1e-8c0d-353e3502a0d3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:28.951566 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-2c244121-dfa5-4b1e-8c0d-353e3502a0d3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:28.962113 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2c244121-dfa5-4b1e-8c0d-353e3502a0d3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:28.962878 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2c244121-dfa5-4b1e-8c0d-353e3502a0d3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:28.964345 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2c244121-dfa5-4b1e-8c0d-353e3502a0d3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:28.964900 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2c244121-dfa5-4b1e-8c0d-353e3502a0d3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:29.040851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-38407a4c-b125-413b-a8a3-7dd73208f4e0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:29.049035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-38407a4c-b125-413b-a8a3-7dd73208f4e0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1313 microversion: 2.1 time: 0.526284 Nov 02 23:08:29.049608 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 146/295] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:28 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1313 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:29.122727 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-2c244121-dfa5-4b1e-8c0d-353e3502a0d3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:29.136632 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-2c244121-dfa5-4b1e-8c0d-353e3502a0d3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 200 len: 1277 microversion: 2.1 time: 0.213052 Nov 02 23:08:29.143881 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 150/296] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:28 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 1277 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:29.677752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1ea8734b-27e7-4aba-b513-b2e5d8ccf92c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:29.679271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1ea8734b-27e7-4aba-b513-b2e5d8ccf92c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:29.688684 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ea8734b-27e7-4aba-b513-b2e5d8ccf92c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:29.689483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ea8734b-27e7-4aba-b513-b2e5d8ccf92c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:29.693387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ea8734b-27e7-4aba-b513-b2e5d8ccf92c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:29.696857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ea8734b-27e7-4aba-b513-b2e5d8ccf92c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:29.860136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1ea8734b-27e7-4aba-b513-b2e5d8ccf92c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 14 microversion: 2.1 time: 0.191586 Nov 02 23:08:29.864220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 147/297] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:08:29 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 23:08:29.906351 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-556c1218-5843-4e79-a45f-fdcc0aca2efb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:29.907553 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-556c1218-5843-4e79-a45f-fdcc0aca2efb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:29.917783 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-556c1218-5843-4e79-a45f-fdcc0aca2efb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:29.918595 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-556c1218-5843-4e79-a45f-fdcc0aca2efb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:29.919704 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-556c1218-5843-4e79-a45f-fdcc0aca2efb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:29.920348 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-556c1218-5843-4e79-a45f-fdcc0aca2efb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:30.040411 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-556c1218-5843-4e79-a45f-fdcc0aca2efb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 14 microversion: 2.20 time: 0.138034 Nov 02 23:08:30.044844 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 151/298] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:08:29 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:30.071457 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3fdfe34c-4f59-439b-bde0-67d5592fb043 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:30.072098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3fdfe34c-4f59-439b-bde0-67d5592fb043 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:30.089425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fdfe34c-4f59-439b-bde0-67d5592fb043 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:30.089872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fdfe34c-4f59-439b-bde0-67d5592fb043 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:30.090682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fdfe34c-4f59-439b-bde0-67d5592fb043 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:30.091397 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fdfe34c-4f59-439b-bde0-67d5592fb043 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:30.163207 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e792aa88-a149-4b55-8373-3686125fba15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:30.164115 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e792aa88-a149-4b55-8373-3686125fba15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:30.173137 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e792aa88-a149-4b55-8373-3686125fba15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:30.173748 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e792aa88-a149-4b55-8373-3686125fba15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:30.174888 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e792aa88-a149-4b55-8373-3686125fba15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:30.175438 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e792aa88-a149-4b55-8373-3686125fba15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:30.347767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3fdfe34c-4f59-439b-bde0-67d5592fb043 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:30.364404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3fdfe34c-4f59-439b-bde0-67d5592fb043 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1313 microversion: 2.1 time: 0.300590 Nov 02 23:08:30.375144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 148/299] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:30 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:30.380688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-703f0965-6176-4592-9989-b39eabd7790a req-52359af8-8950-40fd-8b09-c13e3ccd941b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c38d18d-608e-45d6-b13b-8e25b83023c9", "tag": "5b5cb467-f6ad-4c1b-8089-7b22526c9370"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:30.382613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:08:30.382613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:08:30.393507 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-703f0965-6176-4592-9989-b39eabd7790a req-52359af8-8950-40fd-8b09-c13e3ccd941b service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:30.394179 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-703f0965-6176-4592-9989-b39eabd7790a req-52359af8-8950-40fd-8b09-c13e3ccd941b service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:30.416560 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-703f0965-6176-4592-9989-b39eabd7790a req-52359af8-8950-40fd-8b09-c13e3ccd941b service nova] Creating event network-changed:5b5cb467-f6ad-4c1b-8089-7b22526c9370 for instance 4c38d18d-608e-45d6-b13b-8e25b83023c9 on hv-cinder-81584 Nov 02 23:08:30.421496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-703f0965-6176-4592-9989-b39eabd7790a req-52359af8-8950-40fd-8b09-c13e3ccd941b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044624 Nov 02 23:08:30.422572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 149/300] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:08:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:08:30.452015 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e792aa88-a149-4b55-8373-3686125fba15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:30.462905 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e792aa88-a149-4b55-8373-3686125fba15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 200 len: 1319 microversion: 2.1 time: 0.304514 Nov 02 23:08:30.475921 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 152/301] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:30 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:30.872889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0de34edc-846a-42dc-9221-4bc5f45f1bf9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:30.873904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0de34edc-846a-42dc-9221-4bc5f45f1bf9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:30.881667 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0de34edc-846a-42dc-9221-4bc5f45f1bf9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:30.882123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0de34edc-846a-42dc-9221-4bc5f45f1bf9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:30.883430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0de34edc-846a-42dc-9221-4bc5f45f1bf9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:30.883867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0de34edc-846a-42dc-9221-4bc5f45f1bf9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:31.000568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0de34edc-846a-42dc-9221-4bc5f45f1bf9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 14 microversion: 2.1 time: 0.132303 Nov 02 23:08:31.001198 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 150/302] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:08:30 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 23:08:31.055117 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-c36d66ef-63e7-4c8c-b0ae-9b44cd58a830 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:31.056228 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-c36d66ef-63e7-4c8c-b0ae-9b44cd58a830 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:31.063327 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c36d66ef-63e7-4c8c-b0ae-9b44cd58a830 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:31.064079 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c36d66ef-63e7-4c8c-b0ae-9b44cd58a830 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:31.064860 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c36d66ef-63e7-4c8c-b0ae-9b44cd58a830 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:31.065285 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c36d66ef-63e7-4c8c-b0ae-9b44cd58a830 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:31.177381 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-c36d66ef-63e7-4c8c-b0ae-9b44cd58a830 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 14 microversion: 2.20 time: 0.127128 Nov 02 23:08:31.178023 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 153/303] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:08:31 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:31.383748 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-014715fd-75cd-494d-916c-316a81e3e6c3 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:31.384641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-014715fd-75cd-494d-916c-316a81e3e6c3 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:31.392440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-014715fd-75cd-494d-916c-316a81e3e6c3 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:31.393319 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-014715fd-75cd-494d-916c-316a81e3e6c3 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:31.394106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-014715fd-75cd-494d-916c-316a81e3e6c3 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:31.394571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-014715fd-75cd-494d-916c-316a81e3e6c3 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:31.488289 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b37d16ec-435a-44ab-aff4-b7f07c3b06c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:31.491273 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b37d16ec-435a-44ab-aff4-b7f07c3b06c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:31.499849 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b37d16ec-435a-44ab-aff4-b7f07c3b06c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:31.501254 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b37d16ec-435a-44ab-aff4-b7f07c3b06c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:31.502797 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b37d16ec-435a-44ab-aff4-b7f07c3b06c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:31.503811 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b37d16ec-435a-44ab-aff4-b7f07c3b06c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:31.661127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-014715fd-75cd-494d-916c-316a81e3e6c3 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:31.674489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-014715fd-75cd-494d-916c-316a81e3e6c3 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1313 microversion: 2.1 time: 0.296393 Nov 02 23:08:31.690216 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 151/304] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:31 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:31.776087 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-b37d16ec-435a-44ab-aff4-b7f07c3b06c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:31.783711 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b37d16ec-435a-44ab-aff4-b7f07c3b06c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 200 len: 1319 microversion: 2.1 time: 0.302176 Nov 02 23:08:31.784297 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 154/305] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:31 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:32.011398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c7ac14eb-99db-4b48-9db8-3e04ee40a43e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:32.012492 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c7ac14eb-99db-4b48-9db8-3e04ee40a43e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:32.020177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7ac14eb-99db-4b48-9db8-3e04ee40a43e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:32.020600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7ac14eb-99db-4b48-9db8-3e04ee40a43e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:32.022095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7ac14eb-99db-4b48-9db8-3e04ee40a43e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:32.022605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7ac14eb-99db-4b48-9db8-3e04ee40a43e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:32.134700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c7ac14eb-99db-4b48-9db8-3e04ee40a43e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 14 microversion: 2.1 time: 0.126842 Nov 02 23:08:32.138044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 152/306] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:08:32 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 23:08:32.188601 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-8d8dbe58-6211-40da-b3b4-6f96f799ada0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:32.189536 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-8d8dbe58-6211-40da-b3b4-6f96f799ada0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:32.197531 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8d8dbe58-6211-40da-b3b4-6f96f799ada0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:32.197984 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8d8dbe58-6211-40da-b3b4-6f96f799ada0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:32.198771 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8d8dbe58-6211-40da-b3b4-6f96f799ada0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:32.199248 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8d8dbe58-6211-40da-b3b4-6f96f799ada0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:32.326383 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-8d8dbe58-6211-40da-b3b4-6f96f799ada0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 14 microversion: 2.20 time: 0.141546 Nov 02 23:08:32.329923 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 155/307] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:08:32 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:32.392885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-bd8c5419-5821-4a36-b211-5e6b159269e1 req-982a4aeb-0871-47da-81f0-edcfc009ba88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10697196-84a0-45eb-bc4c-ff5e8b059211", "name": "network-vif-plugged", "status": "completed", "tag": "bcf719f7-14fc-4f88-bb7a-8f0b24e6691c"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:32.394865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:08:32.394865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:08:32.403771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-bd8c5419-5821-4a36-b211-5e6b159269e1 req-982a4aeb-0871-47da-81f0-edcfc009ba88 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:32.405596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-bd8c5419-5821-4a36-b211-5e6b159269e1 req-982a4aeb-0871-47da-81f0-edcfc009ba88 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:32.419800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-bd8c5419-5821-4a36-b211-5e6b159269e1 req-982a4aeb-0871-47da-81f0-edcfc009ba88 service nova] Creating event network-vif-plugged:bcf719f7-14fc-4f88-bb7a-8f0b24e6691c for instance 10697196-84a0-45eb-bc4c-ff5e8b059211 on hv-cinder-81584 Nov 02 23:08:32.428666 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-bd8c5419-5821-4a36-b211-5e6b159269e1 req-982a4aeb-0871-47da-81f0-edcfc009ba88 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039862 Nov 02 23:08:32.429372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 153/308] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:08:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:08:32.696293 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-dbcdce64-b509-4324-8a88-0eb61e3e8eb7 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:32.697327 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-dbcdce64-b509-4324-8a88-0eb61e3e8eb7 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:32.704309 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dbcdce64-b509-4324-8a88-0eb61e3e8eb7 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:32.704793 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dbcdce64-b509-4324-8a88-0eb61e3e8eb7 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:32.705592 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dbcdce64-b509-4324-8a88-0eb61e3e8eb7 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:32.706282 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dbcdce64-b509-4324-8a88-0eb61e3e8eb7 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:32.803586 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c18f83db-12f2-4851-bb71-5395db79c0d5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:32.804975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c18f83db-12f2-4851-bb71-5395db79c0d5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:32.814718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c18f83db-12f2-4851-bb71-5395db79c0d5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:32.815491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c18f83db-12f2-4851-bb71-5395db79c0d5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:32.816260 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c18f83db-12f2-4851-bb71-5395db79c0d5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:32.816842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c18f83db-12f2-4851-bb71-5395db79c0d5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:32.890602 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-dbcdce64-b509-4324-8a88-0eb61e3e8eb7 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:32.899712 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-dbcdce64-b509-4324-8a88-0eb61e3e8eb7 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1313 microversion: 2.1 time: 0.207598 Nov 02 23:08:32.900303 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 156/309] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:32 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:32.969983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c18f83db-12f2-4851-bb71-5395db79c0d5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:32.980929 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c18f83db-12f2-4851-bb71-5395db79c0d5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 200 len: 1319 microversion: 2.1 time: 0.183500 Nov 02 23:08:32.981549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 154/310] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:32 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:33.145446 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e9f74b76-0975-4221-b960-eec991b87004 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:33.146437 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e9f74b76-0975-4221-b960-eec991b87004 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:33.154174 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e9f74b76-0975-4221-b960-eec991b87004 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:33.154970 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e9f74b76-0975-4221-b960-eec991b87004 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:33.156075 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e9f74b76-0975-4221-b960-eec991b87004 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:33.156988 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e9f74b76-0975-4221-b960-eec991b87004 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:33.339047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c6daf1a9-bbc7-4455-b0de-56cd10fea30b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:33.340884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c6daf1a9-bbc7-4455-b0de-56cd10fea30b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:33.351680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6daf1a9-bbc7-4455-b0de-56cd10fea30b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:33.352636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6daf1a9-bbc7-4455-b0de-56cd10fea30b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:33.353367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6daf1a9-bbc7-4455-b0de-56cd10fea30b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:33.354305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6daf1a9-bbc7-4455-b0de-56cd10fea30b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:33.542461 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e9f74b76-0975-4221-b960-eec991b87004 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 14 microversion: 2.1 time: 0.400620 Nov 02 23:08:33.543066 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 157/311] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:08:33 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 14 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 23:08:33.551601 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a5889efd-227a-46b7-bc00-a9581be5a7a7 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:33.552193 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a5889efd-227a-46b7-bc00-a9581be5a7a7 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:33.559904 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a5889efd-227a-46b7-bc00-a9581be5a7a7 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:33.560790 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a5889efd-227a-46b7-bc00-a9581be5a7a7 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:33.561594 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a5889efd-227a-46b7-bc00-a9581be5a7a7 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:33.562035 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a5889efd-227a-46b7-bc00-a9581be5a7a7 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:33.604905 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a5889efd-227a-46b7-bc00-a9581be5a7a7 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Going to try to terminate instance {{(pid=115799) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 23:08:33.656375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c6daf1a9-bbc7-4455-b0de-56cd10fea30b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 14 microversion: 2.20 time: 0.322340 Nov 02 23:08:33.657731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 155/312] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:08:33 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 14 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:33.703122 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a5889efd-227a-46b7-bc00-a9581be5a7a7 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "DELETE /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 204 len: 0 microversion: 2.1 time: 0.158434 Nov 02 23:08:33.704055 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 158/313] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:08:33 2021] DELETE /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 23:08:33.713469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7006f0ac-3cad-4618-9246-c7a42ea31ec9 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:33.714476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7006f0ac-3cad-4618-9246-c7a42ea31ec9 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:33.722257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7006f0ac-3cad-4618-9246-c7a42ea31ec9 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:33.722780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7006f0ac-3cad-4618-9246-c7a42ea31ec9 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:33.723720 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7006f0ac-3cad-4618-9246-c7a42ea31ec9 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:33.724478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7006f0ac-3cad-4618-9246-c7a42ea31ec9 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:33.867208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7006f0ac-3cad-4618-9246-c7a42ea31ec9 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:33.875182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7006f0ac-3cad-4618-9246-c7a42ea31ec9 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1555 microversion: 2.1 time: 0.165604 Nov 02 23:08:33.875774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 156/314] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:33 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:33.917750 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-67de68b4-d1a0-4982-956a-e5d24d4a963a tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:33.918455 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-67de68b4-d1a0-4982-956a-e5d24d4a963a tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:33.925430 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-67de68b4-d1a0-4982-956a-e5d24d4a963a tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:33.925884 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-67de68b4-d1a0-4982-956a-e5d24d4a963a tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:33.926664 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-67de68b4-d1a0-4982-956a-e5d24d4a963a tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:33.927128 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-67de68b4-d1a0-4982-956a-e5d24d4a963a tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:33.998252 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-899a5ff5-ffed-4e18-97ba-8b8b7ac0766d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:33.998997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-899a5ff5-ffed-4e18-97ba-8b8b7ac0766d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:34.006054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-899a5ff5-ffed-4e18-97ba-8b8b7ac0766d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:34.006524 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-899a5ff5-ffed-4e18-97ba-8b8b7ac0766d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:34.013566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-899a5ff5-ffed-4e18-97ba-8b8b7ac0766d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:34.014017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-899a5ff5-ffed-4e18-97ba-8b8b7ac0766d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:34.089336 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-67de68b4-d1a0-4982-956a-e5d24d4a963a tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:34.099463 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-67de68b4-d1a0-4982-956a-e5d24d4a963a tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1313 microversion: 2.1 time: 0.185754 Nov 02 23:08:34.100344 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 159/315] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:33 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:34.157096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-899a5ff5-ffed-4e18-97ba-8b8b7ac0766d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:34.165060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-899a5ff5-ffed-4e18-97ba-8b8b7ac0766d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 200 len: 1319 microversion: 2.1 time: 0.171081 Nov 02 23:08:34.165770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 157/316] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:33 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:34.552859 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-5b5f9ad0-044f-4ea4-a76f-06833cc6f19b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:34.553870 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-5b5f9ad0-044f-4ea4-a76f-06833cc6f19b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:34.560363 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5b5f9ad0-044f-4ea4-a76f-06833cc6f19b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:34.560810 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5b5f9ad0-044f-4ea4-a76f-06833cc6f19b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:34.561625 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5b5f9ad0-044f-4ea4-a76f-06833cc6f19b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:34.562057 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5b5f9ad0-044f-4ea4-a76f-06833cc6f19b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:34.668231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bd355abc-5dd4-4b33-a1fc-fd40ac84bb9b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:34.669190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bd355abc-5dd4-4b33-a1fc-fd40ac84bb9b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:34.675405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bd355abc-5dd4-4b33-a1fc-fd40ac84bb9b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:34.675851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bd355abc-5dd4-4b33-a1fc-fd40ac84bb9b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:34.676613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bd355abc-5dd4-4b33-a1fc-fd40ac84bb9b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:34.677057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bd355abc-5dd4-4b33-a1fc-fd40ac84bb9b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:38.484788 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-5b5f9ad0-044f-4ea4-a76f-06833cc6f19b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 14 microversion: 2.1 time: 3.935427 Nov 02 23:08:38.485408 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 160/317] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:08:34 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 14 bytes in 3937 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 23:08:38.490871 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-3c3b1da4-8f61-47ea-9434-912fb418824c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:38.491595 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-3c3b1da4-8f61-47ea-9434-912fb418824c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:38.498420 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-3c3b1da4-8f61-47ea-9434-912fb418824c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:38.498863 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-3c3b1da4-8f61-47ea-9434-912fb418824c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:38.499754 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-3c3b1da4-8f61-47ea-9434-912fb418824c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:38.500188 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-3c3b1da4-8f61-47ea-9434-912fb418824c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:38.638973 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-3c3b1da4-8f61-47ea-9434-912fb418824c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:38.646675 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-3c3b1da4-8f61-47ea-9434-912fb418824c tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1555 microversion: 2.1 time: 0.160150 Nov 02 23:08:38.647273 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 161/318] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:38 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:38.651551 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-2cc75ac1-ced7-470d-8443-6d0a04d0a609 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:38.652174 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-2cc75ac1-ced7-470d-8443-6d0a04d0a609 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:38.658629 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2cc75ac1-ced7-470d-8443-6d0a04d0a609 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:38.659311 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2cc75ac1-ced7-470d-8443-6d0a04d0a609 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:38.660125 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2cc75ac1-ced7-470d-8443-6d0a04d0a609 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:38.660559 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2cc75ac1-ced7-470d-8443-6d0a04d0a609 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:38.759009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bd355abc-5dd4-4b33-a1fc-fd40ac84bb9b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 14 microversion: 2.20 time: 4.094108 Nov 02 23:08:38.759669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 158/319] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:08:34 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 14 bytes in 4096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:38.765521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c53bf275-a94b-4745-8f44-411b82a5be7e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:38.766275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c53bf275-a94b-4745-8f44-411b82a5be7e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:38.773059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c53bf275-a94b-4745-8f44-411b82a5be7e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:38.773503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c53bf275-a94b-4745-8f44-411b82a5be7e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:38.774274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c53bf275-a94b-4745-8f44-411b82a5be7e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:38.774704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c53bf275-a94b-4745-8f44-411b82a5be7e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:38.790131 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-2cc75ac1-ced7-470d-8443-6d0a04d0a609 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:38.799030 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-2cc75ac1-ced7-470d-8443-6d0a04d0a609 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1313 microversion: 2.1 time: 0.150668 Nov 02 23:08:38.799989 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 162/320] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:38 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:38.908984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c53bf275-a94b-4745-8f44-411b82a5be7e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:38.917469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c53bf275-a94b-4745-8f44-411b82a5be7e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 200 len: 1319 microversion: 2.1 time: 0.155758 Nov 02 23:08:38.918040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 159/321] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:38 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:39.498002 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-57c5a662-a6fd-44fa-890a-a066d5239a0d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:39.498954 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-57c5a662-a6fd-44fa-890a-a066d5239a0d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:39.505789 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-57c5a662-a6fd-44fa-890a-a066d5239a0d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:39.506233 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-57c5a662-a6fd-44fa-890a-a066d5239a0d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:39.507099 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-57c5a662-a6fd-44fa-890a-a066d5239a0d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:39.507432 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-57c5a662-a6fd-44fa-890a-a066d5239a0d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:39.643636 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-57c5a662-a6fd-44fa-890a-a066d5239a0d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 14 microversion: 2.1 time: 0.148945 Nov 02 23:08:39.644342 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 163/322] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:08:39 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 23:08:39.666627 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-27480034-1623-42bb-a374-d62b39c3478a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:39.667276 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-27480034-1623-42bb-a374-d62b39c3478a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:39.674049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27480034-1623-42bb-a374-d62b39c3478a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:39.674475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27480034-1623-42bb-a374-d62b39c3478a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:39.675305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27480034-1623-42bb-a374-d62b39c3478a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:39.675789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27480034-1623-42bb-a374-d62b39c3478a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:39.770458 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-4ffbd0a0-d8b4-4ed4-80fa-31f3075c8c24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:39.771742 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-4ffbd0a0-d8b4-4ed4-80fa-31f3075c8c24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:39.779285 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4ffbd0a0-d8b4-4ed4-80fa-31f3075c8c24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:39.779733 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4ffbd0a0-d8b4-4ed4-80fa-31f3075c8c24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:39.780865 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4ffbd0a0-d8b4-4ed4-80fa-31f3075c8c24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:39.781458 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4ffbd0a0-d8b4-4ed4-80fa-31f3075c8c24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:39.839278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-27480034-1623-42bb-a374-d62b39c3478a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:39.850007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-27480034-1623-42bb-a374-d62b39c3478a tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1555 microversion: 2.1 time: 0.189665 Nov 02 23:08:39.860923 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 160/323] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:39 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1555 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:39.872176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-58eaf8a1-f237-47fe-8e29-aef9977a4c7f tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:39.873446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-58eaf8a1-f237-47fe-8e29-aef9977a4c7f tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:39.880644 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58eaf8a1-f237-47fe-8e29-aef9977a4c7f tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:39.881349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58eaf8a1-f237-47fe-8e29-aef9977a4c7f tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:39.882325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58eaf8a1-f237-47fe-8e29-aef9977a4c7f tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:39.882937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58eaf8a1-f237-47fe-8e29-aef9977a4c7f tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:40.028230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-58eaf8a1-f237-47fe-8e29-aef9977a4c7f tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:40.035692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-58eaf8a1-f237-47fe-8e29-aef9977a4c7f tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1313 microversion: 2.1 time: 0.173011 Nov 02 23:08:40.036786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 161/324] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:39 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:40.041020 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3dad91aa-3cf9-444a-99dd-7cce60f2c531 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:40.041649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3dad91aa-3cf9-444a-99dd-7cce60f2c531 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:40.047477 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dad91aa-3cf9-444a-99dd-7cce60f2c531 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:40.047923 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dad91aa-3cf9-444a-99dd-7cce60f2c531 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:40.048708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dad91aa-3cf9-444a-99dd-7cce60f2c531 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:40.049143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dad91aa-3cf9-444a-99dd-7cce60f2c531 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:40.182603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3dad91aa-3cf9-444a-99dd-7cce60f2c531 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:40.189898 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3dad91aa-3cf9-444a-99dd-7cce60f2c531 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 200 len: 1319 microversion: 2.1 time: 0.152167 Nov 02 23:08:40.190465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 162/325] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:40 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:40.654581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-43890218-5363-416c-a587-62c0f359c4e6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:40.655474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-43890218-5363-416c-a587-62c0f359c4e6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:40.661805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-43890218-5363-416c-a587-62c0f359c4e6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:40.662231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-43890218-5363-416c-a587-62c0f359c4e6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:40.663030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-43890218-5363-416c-a587-62c0f359c4e6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:40.663455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-43890218-5363-416c-a587-62c0f359c4e6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:46.843583 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-4ffbd0a0-d8b4-4ed4-80fa-31f3075c8c24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 18399 microversion: 2.20 time: 7.077274 Nov 02 23:08:46.844213 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 164/326] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:08:39 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 18399 bytes in 7079 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:08:46.848973 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-59a13e56-eb5e-4344-9c6d-6db8e55526b6 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:46.849651 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-59a13e56-eb5e-4344-9c6d-6db8e55526b6 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:46.856426 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-59a13e56-eb5e-4344-9c6d-6db8e55526b6 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:46.856869 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-59a13e56-eb5e-4344-9c6d-6db8e55526b6 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:46.857628 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-59a13e56-eb5e-4344-9c6d-6db8e55526b6 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:46.858059 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-59a13e56-eb5e-4344-9c6d-6db8e55526b6 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:46.993213 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-59a13e56-eb5e-4344-9c6d-6db8e55526b6 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:47.000913 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-59a13e56-eb5e-4344-9c6d-6db8e55526b6 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1555 microversion: 2.1 time: 0.155623 Nov 02 23:08:47.001473 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 165/327] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:46 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:47.006237 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b20c471f-4b8d-499d-88d9-35752b0c2174 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:47.006825 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b20c471f-4b8d-499d-88d9-35752b0c2174 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:47.012479 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b20c471f-4b8d-499d-88d9-35752b0c2174 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:47.012919 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b20c471f-4b8d-499d-88d9-35752b0c2174 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:47.013678 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b20c471f-4b8d-499d-88d9-35752b0c2174 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:47.014101 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b20c471f-4b8d-499d-88d9-35752b0c2174 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:47.145382 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-b20c471f-4b8d-499d-88d9-35752b0c2174 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:47.152794 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b20c471f-4b8d-499d-88d9-35752b0c2174 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1497 microversion: 2.1 time: 0.150361 Nov 02 23:08:47.153405 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 166/328] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:47 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:47.157657 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-64117d1a-dee9-4b9c-8746-d56992f4c96d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:47.158247 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-64117d1a-dee9-4b9c-8746-d56992f4c96d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:47.164045 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-64117d1a-dee9-4b9c-8746-d56992f4c96d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:47.164485 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-64117d1a-dee9-4b9c-8746-d56992f4c96d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:47.165255 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-64117d1a-dee9-4b9c-8746-d56992f4c96d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:47.165675 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-64117d1a-dee9-4b9c-8746-d56992f4c96d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:47.298734 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-64117d1a-dee9-4b9c-8746-d56992f4c96d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:47.302490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-43890218-5363-416c-a587-62c0f359c4e6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 18299 microversion: 2.1 time: 6.650758 Nov 02 23:08:47.304440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 163/329] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:08:40 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 18299 bytes in 6654 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:08:47.309882 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-64117d1a-dee9-4b9c-8746-d56992f4c96d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 200 len: 1319 microversion: 2.1 time: 0.155430 Nov 02 23:08:47.310523 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 167/330] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:47 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:47.855092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d0c88a4a-6f3a-41d9-b11d-b022486bace7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:47.856123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d0c88a4a-6f3a-41d9-b11d-b022486bace7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:47.864845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d0c88a4a-6f3a-41d9-b11d-b022486bace7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:47.865286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d0c88a4a-6f3a-41d9-b11d-b022486bace7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:47.866070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d0c88a4a-6f3a-41d9-b11d-b022486bace7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:47.866494 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d0c88a4a-6f3a-41d9-b11d-b022486bace7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:48.017883 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-27e9d4a0-d20d-4543-8828-ebc718926742 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:48.018479 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-27e9d4a0-d20d-4543-8828-ebc718926742 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:48.025227 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-27e9d4a0-d20d-4543-8828-ebc718926742 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:48.025667 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-27e9d4a0-d20d-4543-8828-ebc718926742 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:48.026425 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-27e9d4a0-d20d-4543-8828-ebc718926742 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:48.026850 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-27e9d4a0-d20d-4543-8828-ebc718926742 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:48.047814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d0c88a4a-6f3a-41d9-b11d-b022486bace7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 19661 microversion: 2.20 time: 0.196639 Nov 02 23:08:48.048522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 164/331] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:08:47 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 19661 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:08:48.168631 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-27e9d4a0-d20d-4543-8828-ebc718926742 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:48.176283 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-27e9d4a0-d20d-4543-8828-ebc718926742 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1555 microversion: 2.1 time: 0.162030 Nov 02 23:08:48.176862 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 168/332] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:48 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:48.212485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d43a77b9-d73d-4e99-8d49-39cf8bdfefe4 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:48.212878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d43a77b9-d73d-4e99-8d49-39cf8bdfefe4 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:48.220170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d43a77b9-d73d-4e99-8d49-39cf8bdfefe4 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:48.220646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d43a77b9-d73d-4e99-8d49-39cf8bdfefe4 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:48.221519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d43a77b9-d73d-4e99-8d49-39cf8bdfefe4 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:48.221889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d43a77b9-d73d-4e99-8d49-39cf8bdfefe4 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:48.246099 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d43a77b9-d73d-4e99-8d49-39cf8bdfefe4 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Going to try to terminate instance {{(pid=115800) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 23:08:48.315480 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-71683f76-14ee-4a8e-8ba4-01b85e40f775 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:48.316463 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-71683f76-14ee-4a8e-8ba4-01b85e40f775 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:48.323290 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-71683f76-14ee-4a8e-8ba4-01b85e40f775 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:48.323746 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-71683f76-14ee-4a8e-8ba4-01b85e40f775 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:48.324525 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-71683f76-14ee-4a8e-8ba4-01b85e40f775 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:48.324962 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-71683f76-14ee-4a8e-8ba4-01b85e40f775 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:48.359241 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d43a77b9-d73d-4e99-8d49-39cf8bdfefe4 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "DELETE /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 204 len: 0 microversion: 2.1 time: 0.151037 Nov 02 23:08:48.359901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 165/333] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:08:48 2021] DELETE /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 23:08:48.364802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-74a7683a-d88f-46db-a881-b7c29998261d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:48.365497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-74a7683a-d88f-46db-a881-b7c29998261d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:48.371329 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74a7683a-d88f-46db-a881-b7c29998261d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:48.371772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74a7683a-d88f-46db-a881-b7c29998261d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:48.372533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74a7683a-d88f-46db-a881-b7c29998261d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:48.372959 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74a7683a-d88f-46db-a881-b7c29998261d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:48.506510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-74a7683a-d88f-46db-a881-b7c29998261d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:48.513666 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-74a7683a-d88f-46db-a881-b7c29998261d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 200 len: 1319 microversion: 2.1 time: 0.152632 Nov 02 23:08:48.514221 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 166/334] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:48 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:48.518417 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d9d79490-4f4e-4c27-83aa-00351314c53e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:48.519031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d9d79490-4f4e-4c27-83aa-00351314c53e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:48.525064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9d79490-4f4e-4c27-83aa-00351314c53e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:48.525445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9d79490-4f4e-4c27-83aa-00351314c53e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:48.526599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9d79490-4f4e-4c27-83aa-00351314c53e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:48.527068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9d79490-4f4e-4c27-83aa-00351314c53e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:48.660654 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d9d79490-4f4e-4c27-83aa-00351314c53e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:48.669154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d9d79490-4f4e-4c27-83aa-00351314c53e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1503 microversion: 2.1 time: 0.153598 Nov 02 23:08:48.669776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 167/335] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:48 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:48.759826 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-71683f76-14ee-4a8e-8ba4-01b85e40f775 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 20997 microversion: 2.1 time: 0.447682 Nov 02 23:08:48.760688 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 169/336] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:08:48 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 20997 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:08:49.059789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c212f44f-499a-4d01-9cd1-e56cd7d588ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:49.060707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c212f44f-499a-4d01-9cd1-e56cd7d588ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:49.067343 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c212f44f-499a-4d01-9cd1-e56cd7d588ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:49.067793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c212f44f-499a-4d01-9cd1-e56cd7d588ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:49.068628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c212f44f-499a-4d01-9cd1-e56cd7d588ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:49.069067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c212f44f-499a-4d01-9cd1-e56cd7d588ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:49.193531 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-863e7a72-be83-432a-aeec-9b290a47ce73 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:49.194238 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-863e7a72-be83-432a-aeec-9b290a47ce73 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:49.201600 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-863e7a72-be83-432a-aeec-9b290a47ce73 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:49.202048 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-863e7a72-be83-432a-aeec-9b290a47ce73 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:49.203027 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-863e7a72-be83-432a-aeec-9b290a47ce73 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:49.203469 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-863e7a72-be83-432a-aeec-9b290a47ce73 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:49.304174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c212f44f-499a-4d01-9cd1-e56cd7d588ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 21890 microversion: 2.20 time: 0.247794 Nov 02 23:08:49.304824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 168/337] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:08:49 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 21890 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:08:49.450201 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-863e7a72-be83-432a-aeec-9b290a47ce73 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:49.459045 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-863e7a72-be83-432a-aeec-9b290a47ce73 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1555 microversion: 2.1 time: 0.269959 Nov 02 23:08:49.459624 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 170/338] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:49 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1555 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:49.531510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-713424f9-dde2-42e7-a0f8-bf41d90ab315 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:49.532203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-713424f9-dde2-42e7-a0f8-bf41d90ab315 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:49.539582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-713424f9-dde2-42e7-a0f8-bf41d90ab315 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:49.540037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-713424f9-dde2-42e7-a0f8-bf41d90ab315 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:49.540810 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-713424f9-dde2-42e7-a0f8-bf41d90ab315 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:49.541239 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-713424f9-dde2-42e7-a0f8-bf41d90ab315 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:49.678840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-713424f9-dde2-42e7-a0f8-bf41d90ab315 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:49.686873 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-87f95431-f40b-4bcd-8651-83fb29091be5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:49.687508 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-87f95431-f40b-4bcd-8651-83fb29091be5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:49.694788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-713424f9-dde2-42e7-a0f8-bf41d90ab315 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 200 len: 1319 microversion: 2.1 time: 0.167506 Nov 02 23:08:49.695420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 169/339] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:49 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:49.698861 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-87f95431-f40b-4bcd-8651-83fb29091be5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:49.699510 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-87f95431-f40b-4bcd-8651-83fb29091be5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:49.700305 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-87f95431-f40b-4bcd-8651-83fb29091be5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:49.700849 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-87f95431-f40b-4bcd-8651-83fb29091be5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:49.773211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-edbba580-f91f-4808-a4d8-9b334012b088 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:49.774132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-edbba580-f91f-4808-a4d8-9b334012b088 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:49.781080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-edbba580-f91f-4808-a4d8-9b334012b088 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:49.781611 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-edbba580-f91f-4808-a4d8-9b334012b088 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:49.782954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-edbba580-f91f-4808-a4d8-9b334012b088 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:49.782954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-edbba580-f91f-4808-a4d8-9b334012b088 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:49.950398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-edbba580-f91f-4808-a4d8-9b334012b088 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 22217 microversion: 2.1 time: 0.181920 Nov 02 23:08:49.951275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 170/340] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:08:49 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 22217 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:08:49.955803 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-87f95431-f40b-4bcd-8651-83fb29091be5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:49.961087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-2696bf74-833f-42f6-bdd6-7387be9900ce req-b30157e3-7ffa-4d2b-8896-4964b1d1305b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ccc33d-e3f8-467c-9f5f-66238348fa70", "name": "network-vif-deleted", "tag": "9ee5b124-d818-4612-b44b-e2c1d34e5cf3"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:49.962869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:08:49.962869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:08:49.964319 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-87f95431-f40b-4bcd-8651-83fb29091be5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1503 microversion: 2.1 time: 0.280699 Nov 02 23:08:49.973812 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 171/341] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:49 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1503 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:49.974023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-2696bf74-833f-42f6-bdd6-7387be9900ce req-b30157e3-7ffa-4d2b-8896-4964b1d1305b service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:49.974023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-2696bf74-833f-42f6-bdd6-7387be9900ce req-b30157e3-7ffa-4d2b-8896-4964b1d1305b service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:49.984277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-2696bf74-833f-42f6-bdd6-7387be9900ce req-b30157e3-7ffa-4d2b-8896-4964b1d1305b service nova] Creating event network-vif-deleted:9ee5b124-d818-4612-b44b-e2c1d34e5cf3 for instance 84ccc33d-e3f8-467c-9f5f-66238348fa70 on hv-cinder-81584 Nov 02 23:08:49.989594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-2696bf74-833f-42f6-bdd6-7387be9900ce req-b30157e3-7ffa-4d2b-8896-4964b1d1305b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036308 Nov 02 23:08:49.990362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 171/342] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:08:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:08:50.316339 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-fe148bd3-fdd9-4a78-85bf-e111821ddf4d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:50.317340 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-fe148bd3-fdd9-4a78-85bf-e111821ddf4d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:50.324122 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fe148bd3-fdd9-4a78-85bf-e111821ddf4d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:50.324598 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fe148bd3-fdd9-4a78-85bf-e111821ddf4d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:50.325772 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fe148bd3-fdd9-4a78-85bf-e111821ddf4d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:50.326325 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fe148bd3-fdd9-4a78-85bf-e111821ddf4d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:50.477215 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-fe148bd3-fdd9-4a78-85bf-e111821ddf4d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 22897 microversion: 2.20 time: 0.164703 Nov 02 23:08:50.477448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0256218e-c7da-424e-aaf7-6a1e39f49bd8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:50.480924 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 172/343] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:08:50 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 22897 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:08:50.481055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0256218e-c7da-424e-aaf7-6a1e39f49bd8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:50.484645 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0256218e-c7da-424e-aaf7-6a1e39f49bd8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:50.485097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0256218e-c7da-424e-aaf7-6a1e39f49bd8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:50.485874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0256218e-c7da-424e-aaf7-6a1e39f49bd8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:50.486311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0256218e-c7da-424e-aaf7-6a1e39f49bd8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:50.549310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0256218e-c7da-424e-aaf7-6a1e39f49bd8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129ecb0ff30d461e9ce6727cd4d6839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8273a7a71541c19aa61c501250b84a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:50.557980 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0256218e-c7da-424e-aaf7-6a1e39f49bd8 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 200 len: 1346 microversion: 2.1 time: 0.085632 Nov 02 23:08:50.558551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 172/344] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:50 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 1346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:50.712634 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-bb4c8bd9-b2bf-49e5-8a05-850d0987c7c2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:50.713265 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-bb4c8bd9-b2bf-49e5-8a05-850d0987c7c2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:50.720654 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bb4c8bd9-b2bf-49e5-8a05-850d0987c7c2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:50.721098 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bb4c8bd9-b2bf-49e5-8a05-850d0987c7c2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:50.721875 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bb4c8bd9-b2bf-49e5-8a05-850d0987c7c2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:50.722304 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bb4c8bd9-b2bf-49e5-8a05-850d0987c7c2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:50.858570 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-bb4c8bd9-b2bf-49e5-8a05-850d0987c7c2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:50.866698 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-bb4c8bd9-b2bf-49e5-8a05-850d0987c7c2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 200 len: 1319 microversion: 2.1 time: 0.158166 Nov 02 23:08:50.867663 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 173/345] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:50 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:50.962561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1af91dd3-e3a3-4f6c-b6a8-73815eaf07c8 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:50.964013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1af91dd3-e3a3-4f6c-b6a8-73815eaf07c8 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:50.970657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1af91dd3-e3a3-4f6c-b6a8-73815eaf07c8 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:50.971145 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1af91dd3-e3a3-4f6c-b6a8-73815eaf07c8 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:50.971933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1af91dd3-e3a3-4f6c-b6a8-73815eaf07c8 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:50.972362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1af91dd3-e3a3-4f6c-b6a8-73815eaf07c8 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:50.983148 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-230e0c4e-b29f-46d9-a9ce-170fa50c99c5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:50.983148 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-230e0c4e-b29f-46d9-a9ce-170fa50c99c5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:50.988653 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-230e0c4e-b29f-46d9-a9ce-170fa50c99c5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:50.989137 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-230e0c4e-b29f-46d9-a9ce-170fa50c99c5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:50.990001 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-230e0c4e-b29f-46d9-a9ce-170fa50c99c5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:50.990444 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-230e0c4e-b29f-46d9-a9ce-170fa50c99c5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:51.139252 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-230e0c4e-b29f-46d9-a9ce-170fa50c99c5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:51.148171 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-230e0c4e-b29f-46d9-a9ce-170fa50c99c5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1503 microversion: 2.1 time: 0.170362 Nov 02 23:08:51.149116 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 174/346] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:50 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:51.153825 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [req-b2875c1a-1a68-4f2b-bba2-d4441bb7a7a8 req-54e0e73d-4af9-4239-9600-3ff25c24dd5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c38d18d-608e-45d6-b13b-8e25b83023c9", "name": "network-vif-plugged", "status": "completed", "tag": "5b5cb467-f6ad-4c1b-8089-7b22526c9370"}]} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:51.155472 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:08:51.155472 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: warnings.warn(msg) Nov 02 23:08:51.162961 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-b2875c1a-1a68-4f2b-bba2-d4441bb7a7a8 req-54e0e73d-4af9-4239-9600-3ff25c24dd5d service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:51.163407 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-b2875c1a-1a68-4f2b-bba2-d4441bb7a7a8 req-54e0e73d-4af9-4239-9600-3ff25c24dd5d service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:51.174007 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.compute.server_external_events [req-b2875c1a-1a68-4f2b-bba2-d4441bb7a7a8 req-54e0e73d-4af9-4239-9600-3ff25c24dd5d service nova] Creating event network-vif-plugged:5b5cb467-f6ad-4c1b-8089-7b22526c9370 for instance 4c38d18d-608e-45d6-b13b-8e25b83023c9 on hv-cinder-81584 Nov 02 23:08:51.178810 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [req-b2875c1a-1a68-4f2b-bba2-d4441bb7a7a8 req-54e0e73d-4af9-4239-9600-3ff25c24dd5d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028464 Nov 02 23:08:51.179456 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 175/347] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:08:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:08:51.184519 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ca06ccaf-9959-464f-851f-2b302192e383 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1846678698", "imageRef": "4159c567-fd66-4bbb-9bf4-6ce0afd65d88", "flavorRef": "452", "networks": [{"uuid": "a641b2e8-96fc-4d47-b974-970483d44042"}]}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:51.217355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1af91dd3-e3a3-4f6c-b6a8-73815eaf07c8 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 23175 microversion: 2.1 time: 0.258266 Nov 02 23:08:51.221124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 173/348] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:08:50 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 23175 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:08:51.236383 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.network.neutron [None req-ca06ccaf-9959-464f-851f-2b302192e383 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] validate_networks() for [('a641b2e8-96fc-4d47-b974-970483d44042', None, None, None, None, None)] {{(pid=115799) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 23:08:51.489537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-71e7d525-9202-40ee-8a48-d8c4e0ece7ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:51.490550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-71e7d525-9202-40ee-8a48-d8c4e0ece7ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:51.499133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-71e7d525-9202-40ee-8a48-d8c4e0ece7ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:51.500054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-71e7d525-9202-40ee-8a48-d8c4e0ece7ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:51.501004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-71e7d525-9202-40ee-8a48-d8c4e0ece7ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:51.501430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-71e7d525-9202-40ee-8a48-d8c4e0ece7ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:51.632637 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-71e7d525-9202-40ee-8a48-d8c4e0ece7ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 23372 microversion: 2.20 time: 0.147214 Nov 02 23:08:51.636520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 174/349] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:08:51 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 23372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:08:51.638607 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8e872a73-004e-471a-aaa4-2efd6f63a266 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:51.639334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8e872a73-004e-471a-aaa4-2efd6f63a266 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:51.647071 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e872a73-004e-471a-aaa4-2efd6f63a266 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:51.647529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e872a73-004e-471a-aaa4-2efd6f63a266 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:51.648330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e872a73-004e-471a-aaa4-2efd6f63a266 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:51.648768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e872a73-004e-471a-aaa4-2efd6f63a266 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:51.667300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-8e872a73-004e-471a-aaa4-2efd6f63a266 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] HTTP exception thrown: Instance 84ccc33d-e3f8-467c-9f5f-66238348fa70 could not be found. Nov 02 23:08:51.667903 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8e872a73-004e-471a-aaa4-2efd6f63a266 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Returning 404 to user: Instance 84ccc33d-e3f8-467c-9f5f-66238348fa70 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:08:51.668741 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8e872a73-004e-471a-aaa4-2efd6f63a266 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 404 len: 111 microversion: 2.1 time: 0.034045 Nov 02 23:08:51.669312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 175/350] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:51 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 23:08:51.772520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4935fb67-0919-42dc-97a2-113b09701f3b tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:51.773624 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4935fb67-0919-42dc-97a2-113b09701f3b tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:51.779948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4935fb67-0919-42dc-97a2-113b09701f3b tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:51.780393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4935fb67-0919-42dc-97a2-113b09701f3b tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:51.781172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4935fb67-0919-42dc-97a2-113b09701f3b tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:51.781601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4935fb67-0919-42dc-97a2-113b09701f3b tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:51.805155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-4935fb67-0919-42dc-97a2-113b09701f3b tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] HTTP exception thrown: Instance 84ccc33d-e3f8-467c-9f5f-66238348fa70 could not be found. Nov 02 23:08:51.805753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4935fb67-0919-42dc-97a2-113b09701f3b tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Returning 404 to user: Instance 84ccc33d-e3f8-467c-9f5f-66238348fa70 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:08:51.806591 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4935fb67-0919-42dc-97a2-113b09701f3b tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038575 Nov 02 23:08:51.807207 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 176/351] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:08:51 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 23:08:51.883347 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e4920480-77d7-4155-9c65-8d4123133472 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:51.883949 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e4920480-77d7-4155-9c65-8d4123133472 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:51.890780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4920480-77d7-4155-9c65-8d4123133472 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:51.891263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4920480-77d7-4155-9c65-8d4123133472 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:51.892063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4920480-77d7-4155-9c65-8d4123133472 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:51.892639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4920480-77d7-4155-9c65-8d4123133472 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:51.923242 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-ca06ccaf-9959-464f-851f-2b302192e383 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Flavor limits 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 23:08:51.923795 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-ca06ccaf-9959-464f-851f-2b302192e383 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Image limits 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 23:08:51.924279 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-ca06ccaf-9959-464f-851f-2b302192e383 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Flavor pref 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 23:08:51.924686 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-ca06ccaf-9959-464f-851f-2b302192e383 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Image pref 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 23:08:51.925093 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-ca06ccaf-9959-464f-851f-2b302192e383 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 23:08:51.938629 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ca06ccaf-9959-464f-851f-2b302192e383 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:51.939180 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ca06ccaf-9959-464f-851f-2b302192e383 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:51.939995 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ca06ccaf-9959-464f-851f-2b302192e383 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:51.940435 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ca06ccaf-9959-464f-851f-2b302192e383 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:51.967558 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.quota [None req-ca06ccaf-9959-464f-851f-2b302192e383 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Getting quotas for project 0f70e69ec3db4f378ac856e1e93b45e5. Resources: {'cores', 'instances', 'ram'} {{(pid=115799) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:08:51.971857 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.quota [None req-ca06ccaf-9959-464f-851f-2b302192e383 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Getting quotas for user 81a16c3887f94b4d825e21e2fe34e26b and project 0f70e69ec3db4f378ac856e1e93b45e5. Resources: {'cores', 'instances', 'ram'} {{(pid=115799) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:08:51.985243 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ca06ccaf-9959-464f-851f-2b302192e383 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Going to run 1 instances... {{(pid=115799) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 23:08:51.987820 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ca06ccaf-9959-464f-851f-2b302192e383 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4159c567-fd66-4bbb-9bf4-6ce0afd65d88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 23:08:52.040016 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e4920480-77d7-4155-9c65-8d4123133472 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:52.041061 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ca06ccaf-9959-464f-851f-2b302192e383 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.860336 Nov 02 23:08:52.042033 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 176/352] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 2 23:08:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 23:08:52.049760 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e4920480-77d7-4155-9c65-8d4123133472 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 200 len: 1319 microversion: 2.1 time: 0.170025 Nov 02 23:08:52.050617 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 177/353] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:51 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:52.052272 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-9fcf9f15-3d5c-4bf7-aeed-261b8fb4bf22 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:52.052954 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-9fcf9f15-3d5c-4bf7-aeed-261b8fb4bf22 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:52.105434 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-9fcf9f15-3d5c-4bf7-aeed-261b8fb4bf22 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:52.112546 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-9fcf9f15-3d5c-4bf7-aeed-261b8fb4bf22 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5" status: 200 len: 1218 microversion: 2.1 time: 0.064770 Nov 02 23:08:52.113107 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 177/354] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:52 2021] GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:52.165756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3a5285ce-5353-4a44-99da-3da5b11722db tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:52.166819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3a5285ce-5353-4a44-99da-3da5b11722db tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:52.174596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a5285ce-5353-4a44-99da-3da5b11722db tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:52.175204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a5285ce-5353-4a44-99da-3da5b11722db tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:52.176052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a5285ce-5353-4a44-99da-3da5b11722db tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:52.177098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a5285ce-5353-4a44-99da-3da5b11722db tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:52.235333 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ff5bcef3-5bc5-49a4-afd9-8328ffcc1e75 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:52.236386 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ff5bcef3-5bc5-49a4-afd9-8328ffcc1e75 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:52.243921 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ff5bcef3-5bc5-49a4-afd9-8328ffcc1e75 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:52.245094 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ff5bcef3-5bc5-49a4-afd9-8328ffcc1e75 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:52.246054 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ff5bcef3-5bc5-49a4-afd9-8328ffcc1e75 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:52.246668 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ff5bcef3-5bc5-49a4-afd9-8328ffcc1e75 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:52.323855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3a5285ce-5353-4a44-99da-3da5b11722db tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:52.332201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3a5285ce-5353-4a44-99da-3da5b11722db tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1503 microversion: 2.1 time: 0.171221 Nov 02 23:08:52.333522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 178/355] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:52 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:52.596074 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ff5bcef3-5bc5-49a4-afd9-8328ffcc1e75 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 24004 microversion: 2.1 time: 0.370018 Nov 02 23:08:52.598772 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 178/356] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:08:52 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 24004 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:08:52.655417 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c2ee80b6-127f-4fbb-9687-958eb79d6c91 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:52.656348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c2ee80b6-127f-4fbb-9687-958eb79d6c91 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:52.663578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2ee80b6-127f-4fbb-9687-958eb79d6c91 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:52.664036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2ee80b6-127f-4fbb-9687-958eb79d6c91 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:52.664837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2ee80b6-127f-4fbb-9687-958eb79d6c91 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:52.665273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2ee80b6-127f-4fbb-9687-958eb79d6c91 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:52.864549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c2ee80b6-127f-4fbb-9687-958eb79d6c91 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 24204 microversion: 2.20 time: 0.223814 Nov 02 23:08:52.865199 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 179/357] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:08:52 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 24204 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:08:53.013496 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-5788c746-3bd4-4748-8860-46c128a52faa tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:53.014174 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-5788c746-3bd4-4748-8860-46c128a52faa tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:53.021526 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5788c746-3bd4-4748-8860-46c128a52faa tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:53.021975 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5788c746-3bd4-4748-8860-46c128a52faa tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:53.022753 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5788c746-3bd4-4748-8860-46c128a52faa tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:53.023217 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5788c746-3bd4-4748-8860-46c128a52faa tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:53.038844 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.wsgi [None req-5788c746-3bd4-4748-8860-46c128a52faa tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] HTTP exception thrown: Instance 84ccc33d-e3f8-467c-9f5f-66238348fa70 could not be found. Nov 02 23:08:53.039494 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-5788c746-3bd4-4748-8860-46c128a52faa tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Returning 404 to user: Instance 84ccc33d-e3f8-467c-9f5f-66238348fa70 could not be found. {{(pid=115799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:08:53.040325 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-5788c746-3bd4-4748-8860-46c128a52faa tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "DELETE /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 404 len: 111 microversion: 2.1 time: 0.030941 Nov 02 23:08:53.040868 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 179/358] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:08:53 2021] DELETE /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 23:08:53.049108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1066ec4b-86f0-49fe-8566-e68bd2818398 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:53.049803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1066ec4b-86f0-49fe-8566-e68bd2818398 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] [instance: 84ccc33d-e3f8-467c-9f5f-66238348fa70] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:53.056945 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1066ec4b-86f0-49fe-8566-e68bd2818398 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:53.057386 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1066ec4b-86f0-49fe-8566-e68bd2818398 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:53.058147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1066ec4b-86f0-49fe-8566-e68bd2818398 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:53.058571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1066ec4b-86f0-49fe-8566-e68bd2818398 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:53.066686 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b3c1c47f-9306-4f19-a813-980f6b73b71d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:53.067910 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b3c1c47f-9306-4f19-a813-980f6b73b71d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:53.073229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-1066ec4b-86f0-49fe-8566-e68bd2818398 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] HTTP exception thrown: Instance 84ccc33d-e3f8-467c-9f5f-66238348fa70 could not be found. Nov 02 23:08:53.073840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1066ec4b-86f0-49fe-8566-e68bd2818398 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] Returning 404 to user: Instance 84ccc33d-e3f8-467c-9f5f-66238348fa70 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:08:53.074306 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b3c1c47f-9306-4f19-a813-980f6b73b71d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:53.074649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1066ec4b-86f0-49fe-8566-e68bd2818398 tempest-DeleteServersTestJSON-341515536 tempest-DeleteServersTestJSON-341515536-project] 10.222.0.41 "GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70" status: 404 len: 111 microversion: 2.1 time: 0.029492 Nov 02 23:08:53.074749 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b3c1c47f-9306-4f19-a813-980f6b73b71d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:53.075227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 180/359] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:53 2021] GET /compute/v2.1/servers/84ccc33d-e3f8-467c-9f5f-66238348fa70 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 23:08:53.075684 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b3c1c47f-9306-4f19-a813-980f6b73b71d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:53.076192 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b3c1c47f-9306-4f19-a813-980f6b73b71d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:53.130109 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d46b5fd6-4f12-4f65-8d4e-a27912cbe4a6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:53.130868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d46b5fd6-4f12-4f65-8d4e-a27912cbe4a6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:53.136966 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d46b5fd6-4f12-4f65-8d4e-a27912cbe4a6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:53.137410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d46b5fd6-4f12-4f65-8d4e-a27912cbe4a6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:53.138175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d46b5fd6-4f12-4f65-8d4e-a27912cbe4a6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:53.138599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d46b5fd6-4f12-4f65-8d4e-a27912cbe4a6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:53.201953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d46b5fd6-4f12-4f65-8d4e-a27912cbe4a6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:53.210878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d46b5fd6-4f12-4f65-8d4e-a27912cbe4a6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5" status: 200 len: 1270 microversion: 2.1 time: 0.084924 Nov 02 23:08:53.211483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 181/360] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:53 2021] GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5 => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:53.292847 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-b3c1c47f-9306-4f19-a813-980f6b73b71d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:53.300406 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b3c1c47f-9306-4f19-a813-980f6b73b71d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 200 len: 1319 microversion: 2.1 time: 0.237315 Nov 02 23:08:53.300976 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 180/361] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:53 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:08:53.349446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5fe5c264-666d-4d7a-8592-0e4564ad4342 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:53.350219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5fe5c264-666d-4d7a-8592-0e4564ad4342 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:53.356459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5fe5c264-666d-4d7a-8592-0e4564ad4342 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:53.356909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5fe5c264-666d-4d7a-8592-0e4564ad4342 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:53.357687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5fe5c264-666d-4d7a-8592-0e4564ad4342 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:53.358118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5fe5c264-666d-4d7a-8592-0e4564ad4342 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:53.493347 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5fe5c264-666d-4d7a-8592-0e4564ad4342 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:53.500776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5fe5c264-666d-4d7a-8592-0e4564ad4342 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1503 microversion: 2.1 time: 0.155073 Nov 02 23:08:53.501338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 182/362] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:53 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:53.609618 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f6b3c347-9552-4367-9221-f41ea32b6ca6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:53.610445 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f6b3c347-9552-4367-9221-f41ea32b6ca6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:53.616851 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f6b3c347-9552-4367-9221-f41ea32b6ca6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:53.617291 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f6b3c347-9552-4367-9221-f41ea32b6ca6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:53.618057 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f6b3c347-9552-4367-9221-f41ea32b6ca6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:53.618484 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f6b3c347-9552-4367-9221-f41ea32b6ca6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:53.876052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-98c1f43b-15e9-4469-9195-a99490ee14f1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:53.877019 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-98c1f43b-15e9-4469-9195-a99490ee14f1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:53.883817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98c1f43b-15e9-4469-9195-a99490ee14f1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:53.884258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98c1f43b-15e9-4469-9195-a99490ee14f1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:53.885025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98c1f43b-15e9-4469-9195-a99490ee14f1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:53.885445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98c1f43b-15e9-4469-9195-a99490ee14f1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:59.314139 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f6b3c347-9552-4367-9221-f41ea32b6ca6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 27560 microversion: 2.1 time: 5.707170 Nov 02 23:08:59.314139 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 181/363] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:08:53 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 27560 bytes in 5709 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:08:59.320081 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-dfa61893-0ba4-41d0-8390-1ee3a5dbc331 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:59.320791 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-dfa61893-0ba4-41d0-8390-1ee3a5dbc331 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:59.328967 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dfa61893-0ba4-41d0-8390-1ee3a5dbc331 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:59.329418 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dfa61893-0ba4-41d0-8390-1ee3a5dbc331 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:59.330201 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dfa61893-0ba4-41d0-8390-1ee3a5dbc331 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:59.330894 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dfa61893-0ba4-41d0-8390-1ee3a5dbc331 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:59.406632 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-dfa61893-0ba4-41d0-8390-1ee3a5dbc331 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:59.414219 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-dfa61893-0ba4-41d0-8390-1ee3a5dbc331 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5" status: 200 len: 1270 microversion: 2.1 time: 0.099028 Nov 02 23:08:59.414796 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 182/364] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:59 2021] GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5 => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:59.421441 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-c126e12f-3ced-46f8-ab08-10d7ba43475d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:59.422278 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-c126e12f-3ced-46f8-ab08-10d7ba43475d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:59.428985 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c126e12f-3ced-46f8-ab08-10d7ba43475d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:59.429949 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c126e12f-3ced-46f8-ab08-10d7ba43475d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:59.430898 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c126e12f-3ced-46f8-ab08-10d7ba43475d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:59.431558 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c126e12f-3ced-46f8-ab08-10d7ba43475d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:59.647289 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-c126e12f-3ced-46f8-ab08-10d7ba43475d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:59.654647 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-c126e12f-3ced-46f8-ab08-10d7ba43475d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 200 len: 1319 microversion: 2.1 time: 0.238684 Nov 02 23:08:59.655251 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 183/365] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:59 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:59.659472 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-aed24cf8-c957-4cc4-ada1-11dcf5761e5f tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:08:59.660917 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-aed24cf8-c957-4cc4-ada1-11dcf5761e5f tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:08:59.673018 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-aed24cf8-c957-4cc4-ada1-11dcf5761e5f tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:59.673815 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-aed24cf8-c957-4cc4-ada1-11dcf5761e5f tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:59.674714 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-aed24cf8-c957-4cc4-ada1-11dcf5761e5f tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:59.675613 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-aed24cf8-c957-4cc4-ada1-11dcf5761e5f tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:59.752634 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-aed24cf8-c957-4cc4-ada1-11dcf5761e5f tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:08:59.761634 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-aed24cf8-c957-4cc4-ada1-11dcf5761e5f tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1461 microversion: 2.1 time: 0.105349 Nov 02 23:08:59.764794 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 184/366] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:08:59 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1461 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:08:59.877284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-98c1f43b-15e9-4469-9195-a99490ee14f1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 27699 microversion: 2.20 time: 6.004504 Nov 02 23:08:59.878258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 183/367] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:08:53 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 27699 bytes in 6007 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:08:59.885695 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-e50e073e-df93-4d25-9a46-afb375530bbc req-b90cb69a-96c9-4a15-9b09-2507ad1635d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10697196-84a0-45eb-bc4c-ff5e8b059211", "name": "network-vif-unplugged", "status": "completed", "tag": "bcf719f7-14fc-4f88-bb7a-8f0b24e6691c"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:59.887188 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:08:59.887188 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:08:59.898528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-e50e073e-df93-4d25-9a46-afb375530bbc req-b90cb69a-96c9-4a15-9b09-2507ad1635d5 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:59.899162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-e50e073e-df93-4d25-9a46-afb375530bbc req-b90cb69a-96c9-4a15-9b09-2507ad1635d5 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:59.912102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-e50e073e-df93-4d25-9a46-afb375530bbc req-b90cb69a-96c9-4a15-9b09-2507ad1635d5 service nova] Creating event network-vif-unplugged:bcf719f7-14fc-4f88-bb7a-8f0b24e6691c for instance 10697196-84a0-45eb-bc4c-ff5e8b059211 on hv-cinder-81584 Nov 02 23:08:59.917315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-e50e073e-df93-4d25-9a46-afb375530bbc req-b90cb69a-96c9-4a15-9b09-2507ad1635d5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037361 Nov 02 23:08:59.917627 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e9d76f81-ba16-4bbd-952a-f5619bb2f1f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1620345796", "imageRef": "4159c567-fd66-4bbb-9bf4-6ce0afd65d88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e43c2ec1-2803-4aed-ad66-1f6eb6fd754d"}]}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:59.918635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 184/368] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:08:59 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:08:59.923897 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-71f4a343-0e03-412c-acc1-39ae26adf31a req-2ab10cff-ac5a-4b9a-8b33-e3249d75246a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10697196-84a0-45eb-bc4c-ff5e8b059211", "name": "network-vif-deleted", "tag": "bcf719f7-14fc-4f88-bb7a-8f0b24e6691c"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:08:59.925876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:08:59.925876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:08:59.933880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-71f4a343-0e03-412c-acc1-39ae26adf31a req-2ab10cff-ac5a-4b9a-8b33-e3249d75246a service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:08:59.934720 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-71f4a343-0e03-412c-acc1-39ae26adf31a req-2ab10cff-ac5a-4b9a-8b33-e3249d75246a service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:08:59.946755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-71f4a343-0e03-412c-acc1-39ae26adf31a req-2ab10cff-ac5a-4b9a-8b33-e3249d75246a service nova] Creating event network-vif-deleted:bcf719f7-14fc-4f88-bb7a-8f0b24e6691c for instance 10697196-84a0-45eb-bc4c-ff5e8b059211 on hv-cinder-81584 Nov 02 23:08:59.952075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-71f4a343-0e03-412c-acc1-39ae26adf31a req-2ab10cff-ac5a-4b9a-8b33-e3249d75246a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031972 Nov 02 23:08:59.952888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 185/369] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:08:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:09:00.021847 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.network.neutron [None req-e9d76f81-ba16-4bbd-952a-f5619bb2f1f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] validate_networks() for [('e43c2ec1-2803-4aed-ad66-1f6eb6fd754d', None, None, None, None, None)] {{(pid=115799) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 23:09:00.326405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ced71c7f-e88d-45a8-bf0f-4edaf41c5148 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:00.327909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ced71c7f-e88d-45a8-bf0f-4edaf41c5148 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:00.336620 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ced71c7f-e88d-45a8-bf0f-4edaf41c5148 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:00.337278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ced71c7f-e88d-45a8-bf0f-4edaf41c5148 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:00.338239 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ced71c7f-e88d-45a8-bf0f-4edaf41c5148 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:00.338911 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ced71c7f-e88d-45a8-bf0f-4edaf41c5148 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:00.500787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ced71c7f-e88d-45a8-bf0f-4edaf41c5148 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 27802 microversion: 2.1 time: 0.178424 Nov 02 23:09:00.501504 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 186/370] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:00 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 27802 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:09:00.507624 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-50db2983-bee8-4243-8c5f-d87635f021cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:00.508385 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-50db2983-bee8-4243-8c5f-d87635f021cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:00.515391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50db2983-bee8-4243-8c5f-d87635f021cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:00.515917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50db2983-bee8-4243-8c5f-d87635f021cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:00.516933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50db2983-bee8-4243-8c5f-d87635f021cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:00.517445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50db2983-bee8-4243-8c5f-d87635f021cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:00.592420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-50db2983-bee8-4243-8c5f-d87635f021cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:00.600688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-50db2983-bee8-4243-8c5f-d87635f021cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5" status: 200 len: 1276 microversion: 2.1 time: 0.097493 Nov 02 23:09:00.610324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 187/371] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:00 2021] GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5 => generated 1276 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:00.674814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e9ef0fb0-4499-4c91-81cb-a534d86cdf1a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:00.675714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e9ef0fb0-4499-4c91-81cb-a534d86cdf1a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:00.683717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9ef0fb0-4499-4c91-81cb-a534d86cdf1a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:00.684380 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9ef0fb0-4499-4c91-81cb-a534d86cdf1a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:00.685826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9ef0fb0-4499-4c91-81cb-a534d86cdf1a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:00.686456 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9ef0fb0-4499-4c91-81cb-a534d86cdf1a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:00.752591 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-e9d76f81-ba16-4bbd-952a-f5619bb2f1f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Flavor limits 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 23:09:00.753072 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-e9d76f81-ba16-4bbd-952a-f5619bb2f1f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Image limits 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 23:09:00.753526 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-e9d76f81-ba16-4bbd-952a-f5619bb2f1f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Flavor pref 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 23:09:00.755366 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-e9d76f81-ba16-4bbd-952a-f5619bb2f1f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Image pref 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 23:09:00.755814 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-e9d76f81-ba16-4bbd-952a-f5619bb2f1f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 23:09:00.768337 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e9d76f81-ba16-4bbd-952a-f5619bb2f1f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:00.769073 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e9d76f81-ba16-4bbd-952a-f5619bb2f1f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:00.770955 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e9d76f81-ba16-4bbd-952a-f5619bb2f1f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:00.771622 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e9d76f81-ba16-4bbd-952a-f5619bb2f1f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:00.804637 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.quota [None req-e9d76f81-ba16-4bbd-952a-f5619bb2f1f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Getting quotas for project a186c3447bfc4c1f984007590ba27d87. Resources: {'cores', 'instances', 'ram'} {{(pid=115799) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:09:00.811531 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.quota [None req-e9d76f81-ba16-4bbd-952a-f5619bb2f1f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Getting quotas for user 5267e5616db14207a6b998f39a2dd8d7 and project a186c3447bfc4c1f984007590ba27d87. Resources: {'cores', 'instances', 'ram'} {{(pid=115799) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:09:00.849670 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e9d76f81-ba16-4bbd-952a-f5619bb2f1f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Going to run 1 instances... {{(pid=115799) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 23:09:00.852071 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e9d76f81-ba16-4bbd-952a-f5619bb2f1f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4159c567-fd66-4bbb-9bf4-6ce0afd65d88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 23:09:00.887227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e9ef0fb0-4499-4c91-81cb-a534d86cdf1a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:00.896165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e9ef0fb0-4499-4c91-81cb-a534d86cdf1a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 200 len: 1319 microversion: 2.1 time: 0.224874 Nov 02 23:09:00.897191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 188/372] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:00 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:00.911217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9ebbaba2-9169-41aa-8fcb-07a682a496a2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:00.912589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9ebbaba2-9169-41aa-8fcb-07a682a496a2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:00.920572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ebbaba2-9169-41aa-8fcb-07a682a496a2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:00.921992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ebbaba2-9169-41aa-8fcb-07a682a496a2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:00.923052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ebbaba2-9169-41aa-8fcb-07a682a496a2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:00.923674 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ebbaba2-9169-41aa-8fcb-07a682a496a2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:00.924066 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e9d76f81-ba16-4bbd-952a-f5619bb2f1f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.156264 Nov 02 23:09:00.930807 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 185/373] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 2 23:08:59 2021] POST /compute/v2.1/servers => generated 383 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 23:09:00.937387 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-68aab810-caf0-4f70-92cc-dbca41ea34a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:00.938380 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-68aab810-caf0-4f70-92cc-dbca41ea34a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:00.952785 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-68aab810-caf0-4f70-92cc-dbca41ea34a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:00.957210 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-68aab810-caf0-4f70-92cc-dbca41ea34a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:00.962128 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-68aab810-caf0-4f70-92cc-dbca41ea34a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:00.963164 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-68aab810-caf0-4f70-92cc-dbca41ea34a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:00.987438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ebbaba2-9169-41aa-8fcb-07a682a496a2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:00.987888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ebbaba2-9169-41aa-8fcb-07a682a496a2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:00.992587 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.objects.instance [None req-9ebbaba2-9169-41aa-8fcb-07a682a496a2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lazy-loading 'fault' on Instance uuid 10697196-84a0-45eb-bc4c-ff5e8b059211 {{(pid=115800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 23:09:01.074945 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9ebbaba2-9169-41aa-8fcb-07a682a496a2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:01.098422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9ebbaba2-9169-41aa-8fcb-07a682a496a2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 200 len: 1303 microversion: 2.1 time: 0.195853 Nov 02 23:09:01.099997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 189/374] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:00 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 1303 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:01.105638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7ce90fcf-ebdb-49fc-b774-d37463eb8cd8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:01.106600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7ce90fcf-ebdb-49fc-b774-d37463eb8cd8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:01.182554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7ce90fcf-ebdb-49fc-b774-d37463eb8cd8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:01.193100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7ce90fcf-ebdb-49fc-b774-d37463eb8cd8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1222 microversion: 2.1 time: 0.091513 Nov 02 23:09:01.199343 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 190/375] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:01 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:01.215690 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-68aab810-caf0-4f70-92cc-dbca41ea34a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 27814 microversion: 2.20 time: 0.278839 Nov 02 23:09:01.218341 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 186/376] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:00 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 27814 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:09:01.268503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d7792d10-8825-4ec5-935b-d621ac527780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-351867185", "imageRef": "4159c567-fd66-4bbb-9bf4-6ce0afd65d88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e43c2ec1-2803-4aed-ad66-1f6eb6fd754d"}]}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:01.355132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.network.neutron [None req-d7792d10-8825-4ec5-935b-d621ac527780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] validate_networks() for [('e43c2ec1-2803-4aed-ad66-1f6eb6fd754d', None, None, None, None, None)] {{(pid=115800) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 23:09:01.515288 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-8d87c81d-3327-4e1e-bb3d-21191901adae tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:01.516735 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-8d87c81d-3327-4e1e-bb3d-21191901adae tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:01.543883 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8d87c81d-3327-4e1e-bb3d-21191901adae tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:01.547955 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8d87c81d-3327-4e1e-bb3d-21191901adae tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:01.548881 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8d87c81d-3327-4e1e-bb3d-21191901adae tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:01.549366 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8d87c81d-3327-4e1e-bb3d-21191901adae tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:01.815336 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-8d87c81d-3327-4e1e-bb3d-21191901adae tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 27893 microversion: 2.1 time: 0.304626 Nov 02 23:09:01.817537 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 187/377] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:01 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 27893 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:09:01.824034 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f6bc05bb-15e8-49e0-a958-5a87132de329 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:01.825656 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f6bc05bb-15e8-49e0-a958-5a87132de329 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:01.837566 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f6bc05bb-15e8-49e0-a958-5a87132de329 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:01.838019 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f6bc05bb-15e8-49e0-a958-5a87132de329 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:01.838809 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f6bc05bb-15e8-49e0-a958-5a87132de329 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:01.840686 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f6bc05bb-15e8-49e0-a958-5a87132de329 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:02.103603 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-f6bc05bb-15e8-49e0-a958-5a87132de329 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:02.111362 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f6bc05bb-15e8-49e0-a958-5a87132de329 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5" status: 200 len: 1318 microversion: 2.1 time: 0.292404 Nov 02 23:09:02.111934 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 188/378] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:01 2021] GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:02.121692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-d7792d10-8825-4ec5-935b-d621ac527780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Flavor limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 23:09:02.122714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-d7792d10-8825-4ec5-935b-d621ac527780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Image limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 23:09:02.123374 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-d7792d10-8825-4ec5-935b-d621ac527780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Flavor pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 23:09:02.123934 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-d7792d10-8825-4ec5-935b-d621ac527780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Image pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 23:09:02.124526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-d7792d10-8825-4ec5-935b-d621ac527780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 23:09:02.131241 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-56cf787d-0c94-4536-b735-66c839140f70 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:02.131845 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-56cf787d-0c94-4536-b735-66c839140f70 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:02.140625 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d7792d10-8825-4ec5-935b-d621ac527780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:02.141070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d7792d10-8825-4ec5-935b-d621ac527780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:02.141873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d7792d10-8825-4ec5-935b-d621ac527780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:02.142298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d7792d10-8825-4ec5-935b-d621ac527780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:02.152969 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-56cf787d-0c94-4536-b735-66c839140f70 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:02.157837 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-56cf787d-0c94-4536-b735-66c839140f70 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:02.157837 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-56cf787d-0c94-4536-b735-66c839140f70 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:02.157837 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-56cf787d-0c94-4536-b735-66c839140f70 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:02.194862 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-d7792d10-8825-4ec5-935b-d621ac527780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Getting quotas for project a186c3447bfc4c1f984007590ba27d87. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:09:02.201347 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-d7792d10-8825-4ec5-935b-d621ac527780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Getting quotas for user 5267e5616db14207a6b998f39a2dd8d7 and project a186c3447bfc4c1f984007590ba27d87. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:09:02.216578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d7792d10-8825-4ec5-935b-d621ac527780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Going to run 1 instances... {{(pid=115800) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 23:09:02.219022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d7792d10-8825-4ec5-935b-d621ac527780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4159c567-fd66-4bbb-9bf4-6ce0afd65d88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 23:09:02.274638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d7792d10-8825-4ec5-935b-d621ac527780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.010392 Nov 02 23:09:02.279994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 191/379] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 2 23:09:01 2021] POST /compute/v2.1/servers => generated 383 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 23:09:02.280805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-16387922-4b6e-4606-b60f-f0d8fed11dd2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:02.281412 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-16387922-4b6e-4606-b60f-f0d8fed11dd2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 10697196-84a0-45eb-bc4c-ff5e8b059211] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:02.288962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-16387922-4b6e-4606-b60f-f0d8fed11dd2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:02.289843 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-16387922-4b6e-4606-b60f-f0d8fed11dd2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:02.290807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-16387922-4b6e-4606-b60f-f0d8fed11dd2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:02.291265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-16387922-4b6e-4606-b60f-f0d8fed11dd2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:02.324830 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-16387922-4b6e-4606-b60f-f0d8fed11dd2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] HTTP exception thrown: Instance 10697196-84a0-45eb-bc4c-ff5e8b059211 could not be found. Nov 02 23:09:02.325822 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-16387922-4b6e-4606-b60f-f0d8fed11dd2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Returning 404 to user: Instance 10697196-84a0-45eb-bc4c-ff5e8b059211 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:09:02.327487 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-16387922-4b6e-4606-b60f-f0d8fed11dd2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211" status: 404 len: 111 microversion: 2.1 time: 0.049667 Nov 02 23:09:02.328063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 192/380] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:02 2021] GET /compute/v2.1/servers/10697196-84a0-45eb-bc4c-ff5e8b059211 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 23:09:02.335021 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-480a76e6-7ef2-4213-9bb2-ef0256a0c551 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:02.336322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-480a76e6-7ef2-4213-9bb2-ef0256a0c551 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:02.344735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-480a76e6-7ef2-4213-9bb2-ef0256a0c551 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:02.346840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-480a76e6-7ef2-4213-9bb2-ef0256a0c551 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:02.351093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-480a76e6-7ef2-4213-9bb2-ef0256a0c551 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:02.352611 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-480a76e6-7ef2-4213-9bb2-ef0256a0c551 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:02.502039 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-480a76e6-7ef2-4213-9bb2-ef0256a0c551 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 27941 microversion: 2.20 time: 0.172533 Nov 02 23:09:02.506890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 193/381] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:02 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 27941 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:09:02.513262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5e91f579-6369-4df7-be98-9d9137704571 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:02.513973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5e91f579-6369-4df7-be98-9d9137704571 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:02.522357 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-56cf787d-0c94-4536-b735-66c839140f70 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:02.551915 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-56cf787d-0c94-4536-b735-66c839140f70 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 200 len: 1508 microversion: 2.1 time: 0.435625 Nov 02 23:09:02.557114 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 189/382] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:02 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 1508 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:02.565462 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d1a350d0-7ffd-4e65-9ef2-64e1b60ef05e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1394030231", "imageRef": "4159c567-fd66-4bbb-9bf4-6ce0afd65d88", "flavorRef": "452", "networks": [{"uuid": "f1dc646b-af38-4f41-a8b4-d4830edd2d7e"}]}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:02.657220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5e91f579-6369-4df7-be98-9d9137704571 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:02.664779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5e91f579-6369-4df7-be98-9d9137704571 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1221 microversion: 2.1 time: 0.156126 Nov 02 23:09:02.666486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 194/383] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:02 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1221 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:02.758907 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.network.neutron [None req-d1a350d0-7ffd-4e65-9ef2-64e1b60ef05e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] validate_networks() for [('f1dc646b-af38-4f41-a8b4-d4830edd2d7e', None, None, None, None, None)] {{(pid=115799) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 23:09:02.830895 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8ec58dde-9098-42ef-ac0d-620a9d825e25 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:02.832106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8ec58dde-9098-42ef-ac0d-620a9d825e25 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:02.868321 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8ec58dde-9098-42ef-ac0d-620a9d825e25 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:02.883373 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8ec58dde-9098-42ef-ac0d-620a9d825e25 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:02.884641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8ec58dde-9098-42ef-ac0d-620a9d825e25 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:02.885179 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8ec58dde-9098-42ef-ac0d-620a9d825e25 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:03.400729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8ec58dde-9098-42ef-ac0d-620a9d825e25 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28046 microversion: 2.1 time: 0.575421 Nov 02 23:09:03.401826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 195/384] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:02 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28046 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:09:03.407460 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-d16e065b-f6ab-433e-a711-bdf1937ab701 req-53c1928f-ab17-44b4-83ab-91bcc696b8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec965ba6-7484-49dc-9efe-4accdc1361e5", "tag": "5acdb4c8-a941-4571-a8ba-636f73738cee"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:03.413595 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:09:03.413595 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:09:03.435797 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-d16e065b-f6ab-433e-a711-bdf1937ab701 req-53c1928f-ab17-44b4-83ab-91bcc696b8e5 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:03.435958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-d16e065b-f6ab-433e-a711-bdf1937ab701 req-53c1928f-ab17-44b4-83ab-91bcc696b8e5 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:03.455011 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-d16e065b-f6ab-433e-a711-bdf1937ab701 req-53c1928f-ab17-44b4-83ab-91bcc696b8e5 service nova] Creating event network-changed:5acdb4c8-a941-4571-a8ba-636f73738cee for instance ec965ba6-7484-49dc-9efe-4accdc1361e5 on hv-cinder-81584 Nov 02 23:09:03.463850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-d16e065b-f6ab-433e-a711-bdf1937ab701 req-53c1928f-ab17-44b4-83ab-91bcc696b8e5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059035 Nov 02 23:09:03.465889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 196/385] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:09:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:09:03.481472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d85797c9-c515-467a-97d3-61784322156f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:03.482944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d85797c9-c515-467a-97d3-61784322156f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:03.493281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d85797c9-c515-467a-97d3-61784322156f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:03.493783 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d85797c9-c515-467a-97d3-61784322156f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:03.495261 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d85797c9-c515-467a-97d3-61784322156f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:03.495893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d85797c9-c515-467a-97d3-61784322156f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:03.748405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d85797c9-c515-467a-97d3-61784322156f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:03.771780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d85797c9-c515-467a-97d3-61784322156f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5" status: 200 len: 1318 microversion: 2.1 time: 0.299371 Nov 02 23:09:03.777735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 197/386] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:03 2021] GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:03.782457 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-d1a350d0-7ffd-4e65-9ef2-64e1b60ef05e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Flavor limits 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 23:09:03.783652 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-d1a350d0-7ffd-4e65-9ef2-64e1b60ef05e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Image limits 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 23:09:03.784337 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-d1a350d0-7ffd-4e65-9ef2-64e1b60ef05e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Flavor pref 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 23:09:03.784744 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-d1a350d0-7ffd-4e65-9ef2-64e1b60ef05e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Image pref 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 23:09:03.785407 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-d1a350d0-7ffd-4e65-9ef2-64e1b60ef05e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 23:09:03.801239 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fc2da531-ba66-459e-8502-863a418fa82b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:03.802198 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fc2da531-ba66-459e-8502-863a418fa82b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:03.809167 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d1a350d0-7ffd-4e65-9ef2-64e1b60ef05e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:03.809731 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d1a350d0-7ffd-4e65-9ef2-64e1b60ef05e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:03.810693 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d1a350d0-7ffd-4e65-9ef2-64e1b60ef05e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:03.811179 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d1a350d0-7ffd-4e65-9ef2-64e1b60ef05e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:03.815448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc2da531-ba66-459e-8502-863a418fa82b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:03.815833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc2da531-ba66-459e-8502-863a418fa82b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:03.816756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc2da531-ba66-459e-8502-863a418fa82b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:03.817195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc2da531-ba66-459e-8502-863a418fa82b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:03.857029 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.quota [None req-d1a350d0-7ffd-4e65-9ef2-64e1b60ef05e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Getting quotas for project 597c421223e44586815fe2608b4f1f57. Resources: {'cores', 'instances', 'ram'} {{(pid=115799) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:09:03.861503 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.quota [None req-d1a350d0-7ffd-4e65-9ef2-64e1b60ef05e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Getting quotas for user 5c8ea0ff3573488eac0a388cd3c97353 and project 597c421223e44586815fe2608b4f1f57. Resources: {'cores', 'instances', 'ram'} {{(pid=115799) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:09:03.875311 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d1a350d0-7ffd-4e65-9ef2-64e1b60ef05e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Going to run 1 instances... {{(pid=115799) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 23:09:03.877680 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d1a350d0-7ffd-4e65-9ef2-64e1b60ef05e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4159c567-fd66-4bbb-9bf4-6ce0afd65d88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 23:09:03.944589 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d1a350d0-7ffd-4e65-9ef2-64e1b60ef05e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.385875 Nov 02 23:09:03.945218 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 190/387] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 2 23:09:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 1387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 23:09:03.955752 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a9a60e48-043b-4658-841d-7921192696d2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:03.967232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fc2da531-ba66-459e-8502-863a418fa82b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28114 microversion: 2.20 time: 0.188021 Nov 02 23:09:03.972638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 198/388] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:03 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28114 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:09:03.972895 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a9a60e48-043b-4658-841d-7921192696d2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:03.981756 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a9a60e48-043b-4658-841d-7921192696d2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:03.982223 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a9a60e48-043b-4658-841d-7921192696d2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:03.983026 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a9a60e48-043b-4658-841d-7921192696d2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:03.983464 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a9a60e48-043b-4658-841d-7921192696d2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:03.990402 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d058f60b-ccc9-4487-96d6-361224036bbb tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:03.991417 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d058f60b-ccc9-4487-96d6-361224036bbb tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:04.084554 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-a9a60e48-043b-4658-841d-7921192696d2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:04.098885 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a9a60e48-043b-4658-841d-7921192696d2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1273 microversion: 2.1 time: 0.146747 Nov 02 23:09:04.114480 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 191/389] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:03 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:04.116317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d058f60b-ccc9-4487-96d6-361224036bbb tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:04.123659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d058f60b-ccc9-4487-96d6-361224036bbb tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1214 microversion: 2.1 time: 0.151153 Nov 02 23:09:04.124378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 199/390] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:03 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1214 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:04.412519 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-21e28ba9-4f1d-464f-a2d4-9b1a1115736e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:04.413494 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-21e28ba9-4f1d-464f-a2d4-9b1a1115736e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:04.419750 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-21e28ba9-4f1d-464f-a2d4-9b1a1115736e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:04.420195 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-21e28ba9-4f1d-464f-a2d4-9b1a1115736e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:04.420970 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-21e28ba9-4f1d-464f-a2d4-9b1a1115736e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:04.421429 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-21e28ba9-4f1d-464f-a2d4-9b1a1115736e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:04.789791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d90d7348-785b-4f3a-b4e9-99048782ce1b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:04.792990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d90d7348-785b-4f3a-b4e9-99048782ce1b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:04.801295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d90d7348-785b-4f3a-b4e9-99048782ce1b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:04.802037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d90d7348-785b-4f3a-b4e9-99048782ce1b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:04.802815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d90d7348-785b-4f3a-b4e9-99048782ce1b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:04.803596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d90d7348-785b-4f3a-b4e9-99048782ce1b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:04.911125 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-21e28ba9-4f1d-464f-a2d4-9b1a1115736e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28163 microversion: 2.1 time: 0.501255 Nov 02 23:09:04.917879 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 192/391] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:04 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28163 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:09:04.984529 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-6542a345-6031-4cca-bd65-0450e504c9f9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:04.985568 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-6542a345-6031-4cca-bd65-0450e504c9f9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:04.993068 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6542a345-6031-4cca-bd65-0450e504c9f9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:04.993799 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6542a345-6031-4cca-bd65-0450e504c9f9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:04.994782 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6542a345-6031-4cca-bd65-0450e504c9f9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:04.995400 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6542a345-6031-4cca-bd65-0450e504c9f9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:05.152595 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d90d7348-785b-4f3a-b4e9-99048782ce1b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:05.160899 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d90d7348-785b-4f3a-b4e9-99048782ce1b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5" status: 200 len: 1318 microversion: 2.1 time: 0.374591 Nov 02 23:09:05.161552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 200/392] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:04 2021] GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5 => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:05.166283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fad3ed6e-ec77-4653-91ec-3e3ca0464695 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:05.167143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fad3ed6e-ec77-4653-91ec-3e3ca0464695 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:05.173204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fad3ed6e-ec77-4653-91ec-3e3ca0464695 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:05.173653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fad3ed6e-ec77-4653-91ec-3e3ca0464695 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:05.174447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fad3ed6e-ec77-4653-91ec-3e3ca0464695 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:05.174874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fad3ed6e-ec77-4653-91ec-3e3ca0464695 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:05.196940 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-6542a345-6031-4cca-bd65-0450e504c9f9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28174 microversion: 2.20 time: 0.219110 Nov 02 23:09:05.197599 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 193/393] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:04 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28174 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:09:05.203757 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-8673824b-cb0c-4df9-93e6-0ea76f5c9298 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:05.204747 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-8673824b-cb0c-4df9-93e6-0ea76f5c9298 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:05.216089 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8673824b-cb0c-4df9-93e6-0ea76f5c9298 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:05.216759 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8673824b-cb0c-4df9-93e6-0ea76f5c9298 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:05.217543 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8673824b-cb0c-4df9-93e6-0ea76f5c9298 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:05.218055 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8673824b-cb0c-4df9-93e6-0ea76f5c9298 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:05.282096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fad3ed6e-ec77-4653-91ec-3e3ca0464695 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:05.291653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fad3ed6e-ec77-4653-91ec-3e3ca0464695 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1279 microversion: 2.1 time: 0.128871 Nov 02 23:09:05.292483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 201/394] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:05 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1279 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:05.314332 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-8673824b-cb0c-4df9-93e6-0ea76f5c9298 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:05.322491 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-8673824b-cb0c-4df9-93e6-0ea76f5c9298 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1266 microversion: 2.1 time: 0.122808 Nov 02 23:09:05.323479 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 194/395] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:05 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1266 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:05.925166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5dc0318c-e4aa-43a5-82c8-47fb392dabdc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:05.928258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5dc0318c-e4aa-43a5-82c8-47fb392dabdc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:05.941200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5dc0318c-e4aa-43a5-82c8-47fb392dabdc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:05.942895 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5dc0318c-e4aa-43a5-82c8-47fb392dabdc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:05.954093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5dc0318c-e4aa-43a5-82c8-47fb392dabdc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:05.956302 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5dc0318c-e4aa-43a5-82c8-47fb392dabdc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:06.058606 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [req-f643d85d-e8c2-4e07-be2b-4199643bd9d7 req-111641e6-64a5-4831-bc48-f5e303522109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7bf8316-893d-4fad-b5f0-4ecad89120b3", "tag": "9393cccd-7a26-4491-b2a8-fc394dd1ec6c"}]} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:06.061098 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:09:06.061098 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: warnings.warn(msg) Nov 02 23:09:06.074397 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-f643d85d-e8c2-4e07-be2b-4199643bd9d7 req-111641e6-64a5-4831-bc48-f5e303522109 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:06.075372 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-f643d85d-e8c2-4e07-be2b-4199643bd9d7 req-111641e6-64a5-4831-bc48-f5e303522109 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:06.097807 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.compute.server_external_events [req-f643d85d-e8c2-4e07-be2b-4199643bd9d7 req-111641e6-64a5-4831-bc48-f5e303522109 service nova] Creating event network-changed:9393cccd-7a26-4491-b2a8-fc394dd1ec6c for instance e7bf8316-893d-4fad-b5f0-4ecad89120b3 on hv-cinder-81584 Nov 02 23:09:06.105439 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [req-f643d85d-e8c2-4e07-be2b-4199643bd9d7 req-111641e6-64a5-4831-bc48-f5e303522109 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050851 Nov 02 23:09:06.106834 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 195/396] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:09:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:09:06.181336 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-9f4485fd-9e85-43ea-bd89-0ede9f27fcd9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:06.182151 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-9f4485fd-9e85-43ea-bd89-0ede9f27fcd9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:06.197809 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9f4485fd-9e85-43ea-bd89-0ede9f27fcd9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:06.199112 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9f4485fd-9e85-43ea-bd89-0ede9f27fcd9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:06.206618 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9f4485fd-9e85-43ea-bd89-0ede9f27fcd9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:06.207162 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9f4485fd-9e85-43ea-bd89-0ede9f27fcd9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:06.216705 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5dc0318c-e4aa-43a5-82c8-47fb392dabdc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28163 microversion: 2.1 time: 0.295059 Nov 02 23:09:06.220587 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 202/397] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:05 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28163 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:09:06.227501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9a2b8b96-e23a-47c1-a5db-2a27f7c3507e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:06.229381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9a2b8b96-e23a-47c1-a5db-2a27f7c3507e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:06.241186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a2b8b96-e23a-47c1-a5db-2a27f7c3507e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:06.241737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a2b8b96-e23a-47c1-a5db-2a27f7c3507e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:06.242587 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a2b8b96-e23a-47c1-a5db-2a27f7c3507e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:06.243132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a2b8b96-e23a-47c1-a5db-2a27f7c3507e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:06.427104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9a2b8b96-e23a-47c1-a5db-2a27f7c3507e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28174 microversion: 2.20 time: 0.205615 Nov 02 23:09:06.428226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 203/398] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:06 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28174 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:09:06.436067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e0c07647-363b-4c42-81d6-c1bc1ef774e0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:06.437399 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e0c07647-363b-4c42-81d6-c1bc1ef774e0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:06.446377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0c07647-363b-4c42-81d6-c1bc1ef774e0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:06.447289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0c07647-363b-4c42-81d6-c1bc1ef774e0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:06.448788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0c07647-363b-4c42-81d6-c1bc1ef774e0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:06.449343 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0c07647-363b-4c42-81d6-c1bc1ef774e0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:06.537319 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-9f4485fd-9e85-43ea-bd89-0ede9f27fcd9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:06.562056 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-9f4485fd-9e85-43ea-bd89-0ede9f27fcd9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5" status: 200 len: 1318 microversion: 2.1 time: 0.384634 Nov 02 23:09:06.562992 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 196/399] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:06 2021] GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5 => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:06.579573 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-521d12aa-c769-4aad-b011-8bd35b7ab09c tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:06.581310 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-521d12aa-c769-4aad-b011-8bd35b7ab09c tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:06.589676 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-521d12aa-c769-4aad-b011-8bd35b7ab09c tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:06.591234 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-521d12aa-c769-4aad-b011-8bd35b7ab09c tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:06.592815 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-521d12aa-c769-4aad-b011-8bd35b7ab09c tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:06.593659 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-521d12aa-c769-4aad-b011-8bd35b7ab09c tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:06.677462 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-521d12aa-c769-4aad-b011-8bd35b7ab09c tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:06.686234 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-521d12aa-c769-4aad-b011-8bd35b7ab09c tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1272 microversion: 2.1 time: 0.120518 Nov 02 23:09:06.696353 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 197/400] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:06 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1272 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:06.941810 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e0c07647-363b-4c42-81d6-c1bc1ef774e0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:06.952478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e0c07647-363b-4c42-81d6-c1bc1ef774e0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1321 microversion: 2.1 time: 0.520819 Nov 02 23:09:06.953088 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 204/401] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:06 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1321 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:07.229980 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-defa0e80-904e-499a-9806-379ee656fb12 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:07.231096 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-defa0e80-904e-499a-9806-379ee656fb12 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:07.239756 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-defa0e80-904e-499a-9806-379ee656fb12 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:07.240668 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-defa0e80-904e-499a-9806-379ee656fb12 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:07.242175 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-defa0e80-904e-499a-9806-379ee656fb12 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:07.243512 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-defa0e80-904e-499a-9806-379ee656fb12 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:07.386662 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-defa0e80-904e-499a-9806-379ee656fb12 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28163 microversion: 2.1 time: 0.160628 Nov 02 23:09:07.392325 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 198/402] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:07 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28163 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:09:07.440129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d3e8070b-904f-4dbf-a9ba-67bcb9ecafa0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:07.441258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d3e8070b-904f-4dbf-a9ba-67bcb9ecafa0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:07.451886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3e8070b-904f-4dbf-a9ba-67bcb9ecafa0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:07.452883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3e8070b-904f-4dbf-a9ba-67bcb9ecafa0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:07.456501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3e8070b-904f-4dbf-a9ba-67bcb9ecafa0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:07.458235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3e8070b-904f-4dbf-a9ba-67bcb9ecafa0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:07.585361 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-17f92e2b-7344-4958-9843-65edf48abb97 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:07.587014 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-17f92e2b-7344-4958-9843-65edf48abb97 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:07.596634 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-17f92e2b-7344-4958-9843-65edf48abb97 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:07.597344 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-17f92e2b-7344-4958-9843-65edf48abb97 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:07.599026 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-17f92e2b-7344-4958-9843-65edf48abb97 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:07.599676 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-17f92e2b-7344-4958-9843-65edf48abb97 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:07.616565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d3e8070b-904f-4dbf-a9ba-67bcb9ecafa0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28174 microversion: 2.20 time: 0.180467 Nov 02 23:09:07.617814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 205/403] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:07 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28174 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:09:07.704196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c612379e-8822-4bde-8fc7-6297d10ca1e5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:07.705846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c612379e-8822-4bde-8fc7-6297d10ca1e5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:07.716056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c612379e-8822-4bde-8fc7-6297d10ca1e5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:07.716757 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c612379e-8822-4bde-8fc7-6297d10ca1e5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:07.719264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c612379e-8822-4bde-8fc7-6297d10ca1e5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:07.722294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c612379e-8822-4bde-8fc7-6297d10ca1e5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:07.892008 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-17f92e2b-7344-4958-9843-65edf48abb97 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:07.900968 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-17f92e2b-7344-4958-9843-65edf48abb97 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5" status: 200 len: 1318 microversion: 2.1 time: 0.324744 Nov 02 23:09:07.910431 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 199/404] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:07 2021] GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:07.910431 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [req-e518722d-1f39-4f2b-ac90-02b95a58db1b req-c89e4860-dcf7-4fc9-aa4d-24564e486926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "796da481-6150-4e95-86f5-1e0732bce021", "tag": "abf458ed-eb32-434b-b82d-37b87b8d8d25"}]} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:07.910431 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:09:07.910431 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: warnings.warn(msg) Nov 02 23:09:07.923598 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-e518722d-1f39-4f2b-ac90-02b95a58db1b req-c89e4860-dcf7-4fc9-aa4d-24564e486926 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:07.924637 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-e518722d-1f39-4f2b-ac90-02b95a58db1b req-c89e4860-dcf7-4fc9-aa4d-24564e486926 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:07.939401 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.compute.server_external_events [req-e518722d-1f39-4f2b-ac90-02b95a58db1b req-c89e4860-dcf7-4fc9-aa4d-24564e486926 service nova] Creating event network-changed:abf458ed-eb32-434b-b82d-37b87b8d8d25 for instance 796da481-6150-4e95-86f5-1e0732bce021 on hv-cinder-81584 Nov 02 23:09:07.946286 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [req-e518722d-1f39-4f2b-ac90-02b95a58db1b req-c89e4860-dcf7-4fc9-aa4d-24564e486926 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042276 Nov 02 23:09:07.947157 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 200/405] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:09:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:09:07.973505 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-4b098cb2-5371-49f1-a595-7af547f35d93 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:07.974765 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-4b098cb2-5371-49f1-a595-7af547f35d93 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:07.987694 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4b098cb2-5371-49f1-a595-7af547f35d93 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:07.988654 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4b098cb2-5371-49f1-a595-7af547f35d93 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:07.989653 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4b098cb2-5371-49f1-a595-7af547f35d93 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:07.990358 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4b098cb2-5371-49f1-a595-7af547f35d93 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:07.997843 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c612379e-8822-4bde-8fc7-6297d10ca1e5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:08.044467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c612379e-8822-4bde-8fc7-6297d10ca1e5 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1314 microversion: 2.1 time: 0.330676 Nov 02 23:09:08.048421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 206/406] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:07 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:08.140042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-857f6130-70fa-452c-a190-9582b8ecc233 req-691ace79-a32f-4a95-a27e-c655e82e3224 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "128302f3-f7c5-4789-a766-c426046c9d16", "tag": "6970655b-4ce0-4ff1-84c7-8e4ac80b49ab"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:08.141581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:09:08.141581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:09:08.149998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-857f6130-70fa-452c-a190-9582b8ecc233 req-691ace79-a32f-4a95-a27e-c655e82e3224 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:08.150462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-857f6130-70fa-452c-a190-9582b8ecc233 req-691ace79-a32f-4a95-a27e-c655e82e3224 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:08.162430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-857f6130-70fa-452c-a190-9582b8ecc233 req-691ace79-a32f-4a95-a27e-c655e82e3224 service nova] Creating event network-changed:6970655b-4ce0-4ff1-84c7-8e4ac80b49ab for instance 128302f3-f7c5-4789-a766-c426046c9d16 on hv-cinder-81584 Nov 02 23:09:08.167491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-857f6130-70fa-452c-a190-9582b8ecc233 req-691ace79-a32f-4a95-a27e-c655e82e3224 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031135 Nov 02 23:09:08.168291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 207/407] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:09:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:09:08.265323 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-4b098cb2-5371-49f1-a595-7af547f35d93 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:08.273164 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-4b098cb2-5371-49f1-a595-7af547f35d93 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1321 microversion: 2.1 time: 0.306571 Nov 02 23:09:08.274074 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 201/408] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:07 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:08.400312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4fea92d2-e287-4a10-8774-774ec9ceec56 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:08.401312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4fea92d2-e287-4a10-8774-774ec9ceec56 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:08.407700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4fea92d2-e287-4a10-8774-774ec9ceec56 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:08.408151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4fea92d2-e287-4a10-8774-774ec9ceec56 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:08.408920 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4fea92d2-e287-4a10-8774-774ec9ceec56 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:08.409351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4fea92d2-e287-4a10-8774-774ec9ceec56 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:08.628471 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-8908c771-42b0-4e7d-b8e9-50bc1c290f2a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:08.629421 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-8908c771-42b0-4e7d-b8e9-50bc1c290f2a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:08.635226 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8908c771-42b0-4e7d-b8e9-50bc1c290f2a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:08.635703 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8908c771-42b0-4e7d-b8e9-50bc1c290f2a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:08.636472 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8908c771-42b0-4e7d-b8e9-50bc1c290f2a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:08.636902 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8908c771-42b0-4e7d-b8e9-50bc1c290f2a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:09.983203 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-8908c771-42b0-4e7d-b8e9-50bc1c290f2a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28174 microversion: 2.20 time: 1.358228 Nov 02 23:09:09.984209 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 202/409] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:08 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28174 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:09:09.989649 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-18a7da83-d9ee-49a3-b86d-9da0552e9ca7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:09.990340 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-18a7da83-d9ee-49a3-b86d-9da0552e9ca7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:09.997170 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-18a7da83-d9ee-49a3-b86d-9da0552e9ca7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:09.997613 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-18a7da83-d9ee-49a3-b86d-9da0552e9ca7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:09.998383 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-18a7da83-d9ee-49a3-b86d-9da0552e9ca7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:09.998843 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-18a7da83-d9ee-49a3-b86d-9da0552e9ca7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:10.056391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4fea92d2-e287-4a10-8774-774ec9ceec56 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28163 microversion: 2.1 time: 1.660087 Nov 02 23:09:10.057952 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 208/410] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:08 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28163 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:09:10.062502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-25f04699-2cb4-4a57-9201-7daf524887be tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:10.063306 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-25f04699-2cb4-4a57-9201-7daf524887be tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:10.069877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25f04699-2cb4-4a57-9201-7daf524887be tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:10.070322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25f04699-2cb4-4a57-9201-7daf524887be tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:10.071180 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25f04699-2cb4-4a57-9201-7daf524887be tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:10.071555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25f04699-2cb4-4a57-9201-7daf524887be tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:10.139134 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-18a7da83-d9ee-49a3-b86d-9da0552e9ca7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:10.146559 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-18a7da83-d9ee-49a3-b86d-9da0552e9ca7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5" status: 200 len: 1318 microversion: 2.1 time: 0.161136 Nov 02 23:09:10.147325 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 203/411] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:09 2021] GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:10.151894 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-6c1414c7-03a7-4899-8ac7-fee88034b584 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:10.152525 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-6c1414c7-03a7-4899-8ac7-fee88034b584 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:10.159208 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6c1414c7-03a7-4899-8ac7-fee88034b584 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:10.159827 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6c1414c7-03a7-4899-8ac7-fee88034b584 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:10.160959 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6c1414c7-03a7-4899-8ac7-fee88034b584 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:10.161397 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6c1414c7-03a7-4899-8ac7-fee88034b584 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:10.242844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-25f04699-2cb4-4a57-9201-7daf524887be tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:10.250095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-25f04699-2cb4-4a57-9201-7daf524887be tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1314 microversion: 2.1 time: 0.191482 Nov 02 23:09:10.250666 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 209/412] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:10 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:10.309142 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6c1414c7-03a7-4899-8ac7-fee88034b584 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:10.316939 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-6c1414c7-03a7-4899-8ac7-fee88034b584 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1321 microversion: 2.1 time: 0.168126 Nov 02 23:09:10.317501 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 204/413] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:10 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:10.995776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-433627ee-a45a-482b-8c73-3675b811a82d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:10.996763 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-433627ee-a45a-482b-8c73-3675b811a82d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:11.002886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-433627ee-a45a-482b-8c73-3675b811a82d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:11.003363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-433627ee-a45a-482b-8c73-3675b811a82d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:11.004124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-433627ee-a45a-482b-8c73-3675b811a82d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:11.004544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-433627ee-a45a-482b-8c73-3675b811a82d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:11.068095 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a84e50bc-680d-4afd-bfd1-9cbba2e4912b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:11.068999 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a84e50bc-680d-4afd-bfd1-9cbba2e4912b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:11.075387 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a84e50bc-680d-4afd-bfd1-9cbba2e4912b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:11.075824 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a84e50bc-680d-4afd-bfd1-9cbba2e4912b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:11.076590 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a84e50bc-680d-4afd-bfd1-9cbba2e4912b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:11.077015 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a84e50bc-680d-4afd-bfd1-9cbba2e4912b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:11.389369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-433627ee-a45a-482b-8c73-3675b811a82d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28174 microversion: 2.20 time: 0.397380 Nov 02 23:09:11.393246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 210/414] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:10 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28174 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:09:11.398324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c21d0858-5d57-4521-8374-ab279fc6cde9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:11.399369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c21d0858-5d57-4521-8374-ab279fc6cde9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:11.410250 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c21d0858-5d57-4521-8374-ab279fc6cde9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:11.410703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c21d0858-5d57-4521-8374-ab279fc6cde9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:11.411515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c21d0858-5d57-4521-8374-ab279fc6cde9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:11.411948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c21d0858-5d57-4521-8374-ab279fc6cde9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:11.420530 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a84e50bc-680d-4afd-bfd1-9cbba2e4912b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28163 microversion: 2.1 time: 0.355865 Nov 02 23:09:11.425266 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 205/415] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:11 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28163 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:09:11.433829 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-4086ee0f-740e-4fa8-9e55-52964257c619 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:11.434771 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-4086ee0f-740e-4fa8-9e55-52964257c619 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:11.442156 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4086ee0f-740e-4fa8-9e55-52964257c619 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:11.442965 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4086ee0f-740e-4fa8-9e55-52964257c619 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:11.443957 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4086ee0f-740e-4fa8-9e55-52964257c619 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:11.444768 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4086ee0f-740e-4fa8-9e55-52964257c619 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:11.582903 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c21d0858-5d57-4521-8374-ab279fc6cde9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:11.591009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c21d0858-5d57-4521-8374-ab279fc6cde9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5" status: 200 len: 1318 microversion: 2.1 time: 0.198703 Nov 02 23:09:11.591580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 211/416] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:11 2021] GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:11.596755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-082e984d-77a7-4fc8-9dc3-8aad072ea93f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:11.598248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-082e984d-77a7-4fc8-9dc3-8aad072ea93f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:11.605164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-082e984d-77a7-4fc8-9dc3-8aad072ea93f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:11.605550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-082e984d-77a7-4fc8-9dc3-8aad072ea93f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:11.606329 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-082e984d-77a7-4fc8-9dc3-8aad072ea93f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:11.606763 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-082e984d-77a7-4fc8-9dc3-8aad072ea93f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:11.608557 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-4086ee0f-740e-4fa8-9e55-52964257c619 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:11.617292 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-4086ee0f-740e-4fa8-9e55-52964257c619 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1314 microversion: 2.1 time: 0.189879 Nov 02 23:09:11.617903 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 206/417] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:11 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:11.753566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-082e984d-77a7-4fc8-9dc3-8aad072ea93f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:11.764516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-082e984d-77a7-4fc8-9dc3-8aad072ea93f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1321 microversion: 2.1 time: 0.171387 Nov 02 23:09:11.765100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 212/418] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:11 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:12.400316 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-fbe8e495-e1c6-4d62-9960-b28a58f69bc4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:12.401287 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-fbe8e495-e1c6-4d62-9960-b28a58f69bc4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:12.407611 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fbe8e495-e1c6-4d62-9960-b28a58f69bc4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:12.408052 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fbe8e495-e1c6-4d62-9960-b28a58f69bc4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:12.408819 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fbe8e495-e1c6-4d62-9960-b28a58f69bc4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:12.409245 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fbe8e495-e1c6-4d62-9960-b28a58f69bc4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:12.433686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a0834d1c-cdd8-4a5b-b4a9-3ab5d1197d60 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:12.434853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a0834d1c-cdd8-4a5b-b4a9-3ab5d1197d60 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:12.443581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0834d1c-cdd8-4a5b-b4a9-3ab5d1197d60 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:12.444024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0834d1c-cdd8-4a5b-b4a9-3ab5d1197d60 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:12.446856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0834d1c-cdd8-4a5b-b4a9-3ab5d1197d60 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:12.446856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0834d1c-cdd8-4a5b-b4a9-3ab5d1197d60 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:12.686619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a0834d1c-cdd8-4a5b-b4a9-3ab5d1197d60 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28163 microversion: 2.1 time: 0.256218 Nov 02 23:09:12.690454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 213/419] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:12 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28163 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:09:12.692221 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9163f642-0962-499f-b48b-e98f5a0d0747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:12.692982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9163f642-0962-499f-b48b-e98f5a0d0747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:12.699437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9163f642-0962-499f-b48b-e98f5a0d0747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:12.699881 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9163f642-0962-499f-b48b-e98f5a0d0747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:12.700654 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9163f642-0962-499f-b48b-e98f5a0d0747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:12.701077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9163f642-0962-499f-b48b-e98f5a0d0747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:12.709336 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-fbe8e495-e1c6-4d62-9960-b28a58f69bc4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28174 microversion: 2.20 time: 0.312294 Nov 02 23:09:12.713818 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 207/420] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:12 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28174 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:09:12.716701 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-72500eb7-c9b6-4ea5-9904-2552d07b0051 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:12.717398 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-72500eb7-c9b6-4ea5-9904-2552d07b0051 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:12.725314 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-72500eb7-c9b6-4ea5-9904-2552d07b0051 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:12.725749 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-72500eb7-c9b6-4ea5-9904-2552d07b0051 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:12.727756 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-72500eb7-c9b6-4ea5-9904-2552d07b0051 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:12.727756 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-72500eb7-c9b6-4ea5-9904-2552d07b0051 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:12.843791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9163f642-0962-499f-b48b-e98f5a0d0747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:12.851504 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9163f642-0962-499f-b48b-e98f5a0d0747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5" status: 200 len: 1318 microversion: 2.1 time: 0.163008 Nov 02 23:09:12.852086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 214/421] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:12 2021] GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:12.856708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4d718e54-bbc7-4140-8881-eac8bd2e23c0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:12.857570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4d718e54-bbc7-4140-8881-eac8bd2e23c0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:12.861259 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-72500eb7-c9b6-4ea5-9904-2552d07b0051 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:12.863471 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d718e54-bbc7-4140-8881-eac8bd2e23c0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:12.863950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d718e54-bbc7-4140-8881-eac8bd2e23c0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:12.864767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d718e54-bbc7-4140-8881-eac8bd2e23c0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:12.865211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d718e54-bbc7-4140-8881-eac8bd2e23c0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:12.869012 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-72500eb7-c9b6-4ea5-9904-2552d07b0051 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1314 microversion: 2.1 time: 0.157287 Nov 02 23:09:12.869771 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 208/422] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:12 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:13.007059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4d718e54-bbc7-4140-8881-eac8bd2e23c0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:13.014416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4d718e54-bbc7-4140-8881-eac8bd2e23c0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1321 microversion: 2.1 time: 0.161295 Nov 02 23:09:13.015026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 215/423] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:12 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:13.698187 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-2b50e771-23ee-4c67-a2cc-dc72a51c0eb3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:13.699310 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-2b50e771-23ee-4c67-a2cc-dc72a51c0eb3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:13.705816 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2b50e771-23ee-4c67-a2cc-dc72a51c0eb3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:13.706258 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2b50e771-23ee-4c67-a2cc-dc72a51c0eb3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:13.707097 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2b50e771-23ee-4c67-a2cc-dc72a51c0eb3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:13.707527 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2b50e771-23ee-4c67-a2cc-dc72a51c0eb3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:13.721664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c059a1e1-22ca-4b90-bd79-330579de2c7d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:13.724139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c059a1e1-22ca-4b90-bd79-330579de2c7d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:13.734440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c059a1e1-22ca-4b90-bd79-330579de2c7d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:13.735173 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c059a1e1-22ca-4b90-bd79-330579de2c7d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:13.735959 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c059a1e1-22ca-4b90-bd79-330579de2c7d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:13.736388 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c059a1e1-22ca-4b90-bd79-330579de2c7d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:13.838214 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-2b50e771-23ee-4c67-a2cc-dc72a51c0eb3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28163 microversion: 2.1 time: 0.143645 Nov 02 23:09:13.839253 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 209/424] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:13 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28163 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:09:13.869459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c059a1e1-22ca-4b90-bd79-330579de2c7d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28174 microversion: 2.20 time: 0.150636 Nov 02 23:09:13.870423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 216/425] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:13 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28174 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:09:13.874993 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-324eab39-b640-4f3d-b910-38efe3527de3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:13.875697 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-324eab39-b640-4f3d-b910-38efe3527de3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:13.883979 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-324eab39-b640-4f3d-b910-38efe3527de3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:13.884556 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-324eab39-b640-4f3d-b910-38efe3527de3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:13.885793 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-324eab39-b640-4f3d-b910-38efe3527de3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:13.886263 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-324eab39-b640-4f3d-b910-38efe3527de3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:13.887275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-604f7ccf-16ee-45fa-ba93-0241b5d77058 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:13.888043 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-604f7ccf-16ee-45fa-ba93-0241b5d77058 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:13.895565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-604f7ccf-16ee-45fa-ba93-0241b5d77058 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:13.896014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-604f7ccf-16ee-45fa-ba93-0241b5d77058 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:13.896969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-604f7ccf-16ee-45fa-ba93-0241b5d77058 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:13.897415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-604f7ccf-16ee-45fa-ba93-0241b5d77058 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:14.047261 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-324eab39-b640-4f3d-b910-38efe3527de3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:14.055364 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-324eab39-b640-4f3d-b910-38efe3527de3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5" status: 200 len: 1318 microversion: 2.1 time: 0.189778 Nov 02 23:09:14.055934 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 210/426] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:13 2021] GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:14.057225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-604f7ccf-16ee-45fa-ba93-0241b5d77058 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:14.062834 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-6788aeff-469c-4f2e-a803-942ce9a527a1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:14.063623 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-6788aeff-469c-4f2e-a803-942ce9a527a1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:14.075629 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6788aeff-469c-4f2e-a803-942ce9a527a1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:14.075870 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-604f7ccf-16ee-45fa-ba93-0241b5d77058 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1314 microversion: 2.1 time: 0.192609 Nov 02 23:09:14.076022 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6788aeff-469c-4f2e-a803-942ce9a527a1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:14.077005 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6788aeff-469c-4f2e-a803-942ce9a527a1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:14.078976 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6788aeff-469c-4f2e-a803-942ce9a527a1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:14.079210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 217/427] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:13 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:14.226229 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6788aeff-469c-4f2e-a803-942ce9a527a1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:14.235915 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-6788aeff-469c-4f2e-a803-942ce9a527a1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1321 microversion: 2.1 time: 0.178419 Nov 02 23:09:14.236507 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 211/428] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:14 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:14.849580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-83bfe893-7e99-49b1-91c8-590290d603e7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:14.850443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-83bfe893-7e99-49b1-91c8-590290d603e7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:14.856743 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83bfe893-7e99-49b1-91c8-590290d603e7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:14.857190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83bfe893-7e99-49b1-91c8-590290d603e7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:14.857943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83bfe893-7e99-49b1-91c8-590290d603e7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:14.858370 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83bfe893-7e99-49b1-91c8-590290d603e7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:14.881150 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-4af15112-4ee9-491b-873d-3f1140908170 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:14.882155 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-4af15112-4ee9-491b-873d-3f1140908170 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:14.888552 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4af15112-4ee9-491b-873d-3f1140908170 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:14.889000 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4af15112-4ee9-491b-873d-3f1140908170 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:14.889779 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4af15112-4ee9-491b-873d-3f1140908170 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:14.890209 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4af15112-4ee9-491b-873d-3f1140908170 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:14.984936 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-83bfe893-7e99-49b1-91c8-590290d603e7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28163 microversion: 2.1 time: 0.138864 Nov 02 23:09:14.985831 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 218/429] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:14 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28163 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:09:15.008998 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-4af15112-4ee9-491b-873d-3f1140908170 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28174 microversion: 2.20 time: 0.131883 Nov 02 23:09:15.009672 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 212/430] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:14 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28174 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:09:15.077637 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9dabeeb3-f0cc-4cb1-8c81-28766da7ba2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:15.078939 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9dabeeb3-f0cc-4cb1-8c81-28766da7ba2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:15.089733 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9dabeeb3-f0cc-4cb1-8c81-28766da7ba2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:15.090169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9dabeeb3-f0cc-4cb1-8c81-28766da7ba2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:15.090969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9dabeeb3-f0cc-4cb1-8c81-28766da7ba2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:15.091399 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9dabeeb3-f0cc-4cb1-8c81-28766da7ba2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:15.093697 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-28ac4b68-2ce2-4d15-a9e1-1cc56221afe1 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:15.094406 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-28ac4b68-2ce2-4d15-a9e1-1cc56221afe1 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:15.101471 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-28ac4b68-2ce2-4d15-a9e1-1cc56221afe1 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:15.101832 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-28ac4b68-2ce2-4d15-a9e1-1cc56221afe1 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:15.102620 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-28ac4b68-2ce2-4d15-a9e1-1cc56221afe1 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:15.103079 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-28ac4b68-2ce2-4d15-a9e1-1cc56221afe1 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:15.228049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9dabeeb3-f0cc-4cb1-8c81-28766da7ba2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:15.236258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9dabeeb3-f0cc-4cb1-8c81-28766da7ba2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5" status: 200 len: 1318 microversion: 2.1 time: 0.165782 Nov 02 23:09:15.236903 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 219/431] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:15 2021] GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:15.245704 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-28ac4b68-2ce2-4d15-a9e1-1cc56221afe1 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:15.252427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ecef889f-2dad-429b-98f8-c65755c296e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:15.253030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ecef889f-2dad-429b-98f8-c65755c296e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:15.255220 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-28ac4b68-2ce2-4d15-a9e1-1cc56221afe1 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1314 microversion: 2.1 time: 0.165363 Nov 02 23:09:15.256055 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 213/432] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:15 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:15.259694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ecef889f-2dad-429b-98f8-c65755c296e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:15.260144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ecef889f-2dad-429b-98f8-c65755c296e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:15.260915 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ecef889f-2dad-429b-98f8-c65755c296e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:15.261348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ecef889f-2dad-429b-98f8-c65755c296e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:15.394522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ecef889f-2dad-429b-98f8-c65755c296e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:15.402243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ecef889f-2dad-429b-98f8-c65755c296e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1321 microversion: 2.1 time: 0.153309 Nov 02 23:09:15.403198 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 220/433] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:15 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:15.735065 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [req-7ab7deff-134f-4e35-9692-b9cdeba83060 req-1ce12074-193f-40a1-a008-5c9ff7f49aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec965ba6-7484-49dc-9efe-4accdc1361e5", "name": "network-vif-plugged", "status": "completed", "tag": "5acdb4c8-a941-4571-a8ba-636f73738cee"}]} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:15.736589 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:09:15.736589 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: warnings.warn(msg) Nov 02 23:09:15.745547 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-7ab7deff-134f-4e35-9692-b9cdeba83060 req-1ce12074-193f-40a1-a008-5c9ff7f49aba service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:15.745994 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-7ab7deff-134f-4e35-9692-b9cdeba83060 req-1ce12074-193f-40a1-a008-5c9ff7f49aba service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:15.759116 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.compute.server_external_events [req-7ab7deff-134f-4e35-9692-b9cdeba83060 req-1ce12074-193f-40a1-a008-5c9ff7f49aba service nova] Creating event network-vif-plugged:5acdb4c8-a941-4571-a8ba-636f73738cee for instance ec965ba6-7484-49dc-9efe-4accdc1361e5 on hv-cinder-81584 Nov 02 23:09:15.764066 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [req-7ab7deff-134f-4e35-9692-b9cdeba83060 req-1ce12074-193f-40a1-a008-5c9ff7f49aba service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033027 Nov 02 23:09:15.770055 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 214/434] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:09:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:09:15.998366 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-14f0ad1f-3987-4a07-8be5-2ffa2b0cacc4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:16.000055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-14f0ad1f-3987-4a07-8be5-2ffa2b0cacc4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:16.008340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14f0ad1f-3987-4a07-8be5-2ffa2b0cacc4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:16.009058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14f0ad1f-3987-4a07-8be5-2ffa2b0cacc4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:16.010096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14f0ad1f-3987-4a07-8be5-2ffa2b0cacc4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:16.011309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14f0ad1f-3987-4a07-8be5-2ffa2b0cacc4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:16.023533 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-7b4c26c6-7ea4-45fd-97b8-a3690741e039 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:16.024556 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-7b4c26c6-7ea4-45fd-97b8-a3690741e039 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:16.039839 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7b4c26c6-7ea4-45fd-97b8-a3690741e039 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:16.040402 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7b4c26c6-7ea4-45fd-97b8-a3690741e039 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:16.041261 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7b4c26c6-7ea4-45fd-97b8-a3690741e039 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:16.045151 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7b4c26c6-7ea4-45fd-97b8-a3690741e039 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:16.786512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-14f0ad1f-3987-4a07-8be5-2ffa2b0cacc4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28163 microversion: 2.1 time: 0.792940 Nov 02 23:09:16.787715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 221/435] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:15 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28163 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:09:16.793080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f3e9edae-ee58-4c6c-909b-37e3216a14a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:16.793762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f3e9edae-ee58-4c6c-909b-37e3216a14a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:16.801744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3e9edae-ee58-4c6c-909b-37e3216a14a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:16.802164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3e9edae-ee58-4c6c-909b-37e3216a14a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:16.802838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3e9edae-ee58-4c6c-909b-37e3216a14a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:16.803290 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3e9edae-ee58-4c6c-909b-37e3216a14a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:16.943777 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f3e9edae-ee58-4c6c-909b-37e3216a14a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:16.953703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f3e9edae-ee58-4c6c-909b-37e3216a14a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5" status: 200 len: 1318 microversion: 2.1 time: 0.164616 Nov 02 23:09:16.954283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 222/436] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:16 2021] GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:16.958927 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a05856cf-443d-49c9-ba3e-ad150a4b0781 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:16.959541 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a05856cf-443d-49c9-ba3e-ad150a4b0781 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:16.965388 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a05856cf-443d-49c9-ba3e-ad150a4b0781 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:16.965829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a05856cf-443d-49c9-ba3e-ad150a4b0781 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:16.966595 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a05856cf-443d-49c9-ba3e-ad150a4b0781 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:16.967050 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a05856cf-443d-49c9-ba3e-ad150a4b0781 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:16.975218 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-7b4c26c6-7ea4-45fd-97b8-a3690741e039 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28174 microversion: 2.20 time: 0.956910 Nov 02 23:09:16.976002 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 215/437] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:16 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28174 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:09:16.983278 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-251cbbc5-93fc-4cf1-8ef0-e8c5f781ec33 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:16.984043 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-251cbbc5-93fc-4cf1-8ef0-e8c5f781ec33 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:16.992647 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-251cbbc5-93fc-4cf1-8ef0-e8c5f781ec33 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:16.993092 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-251cbbc5-93fc-4cf1-8ef0-e8c5f781ec33 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:16.993870 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-251cbbc5-93fc-4cf1-8ef0-e8c5f781ec33 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:16.994355 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-251cbbc5-93fc-4cf1-8ef0-e8c5f781ec33 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:17.126257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a05856cf-443d-49c9-ba3e-ad150a4b0781 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:17.134154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a05856cf-443d-49c9-ba3e-ad150a4b0781 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1314 microversion: 2.1 time: 0.178876 Nov 02 23:09:17.134730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 223/438] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:16 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:17.143087 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-251cbbc5-93fc-4cf1-8ef0-e8c5f781ec33 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:17.152407 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-251cbbc5-93fc-4cf1-8ef0-e8c5f781ec33 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1321 microversion: 2.1 time: 0.173739 Nov 02 23:09:17.153008 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 216/439] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:16 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:17.799043 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-81787b3c-7cea-405a-b1f4-45a53050155c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:17.800036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-81787b3c-7cea-405a-b1f4-45a53050155c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:17.807096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81787b3c-7cea-405a-b1f4-45a53050155c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:17.807551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81787b3c-7cea-405a-b1f4-45a53050155c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:17.808342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81787b3c-7cea-405a-b1f4-45a53050155c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:17.808774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81787b3c-7cea-405a-b1f4-45a53050155c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:17.940796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-81787b3c-7cea-405a-b1f4-45a53050155c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28163 microversion: 2.1 time: 0.145590 Nov 02 23:09:17.942059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 224/440] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:17 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28163 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:09:17.970061 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ef4ac8d6-240c-4d8d-99ee-afa284cc7938 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:17.970665 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ef4ac8d6-240c-4d8d-99ee-afa284cc7938 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:17.977127 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ef4ac8d6-240c-4d8d-99ee-afa284cc7938 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:17.977571 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ef4ac8d6-240c-4d8d-99ee-afa284cc7938 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:17.978367 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ef4ac8d6-240c-4d8d-99ee-afa284cc7938 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:17.979021 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ef4ac8d6-240c-4d8d-99ee-afa284cc7938 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:17.988803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a43d76be-7529-480d-9491-8082b5224d95 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:17.989807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a43d76be-7529-480d-9491-8082b5224d95 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:17.996967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a43d76be-7529-480d-9491-8082b5224d95 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:17.997412 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a43d76be-7529-480d-9491-8082b5224d95 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:17.998222 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a43d76be-7529-480d-9491-8082b5224d95 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:17.998652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a43d76be-7529-480d-9491-8082b5224d95 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:18.112931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a43d76be-7529-480d-9491-8082b5224d95 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28174 microversion: 2.20 time: 0.128468 Nov 02 23:09:18.114658 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 225/441] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:17 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28174 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:09:18.117220 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-ef4ac8d6-240c-4d8d-99ee-afa284cc7938 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:18.125521 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ef4ac8d6-240c-4d8d-99ee-afa284cc7938 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5" status: 200 len: 1318 microversion: 2.1 time: 0.158990 Nov 02 23:09:18.126106 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 217/442] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:17 2021] GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:18.156738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-346143b5-b718-4c1b-b002-3efdc5d0f109 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:18.157431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-346143b5-b718-4c1b-b002-3efdc5d0f109 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:18.164699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-346143b5-b718-4c1b-b002-3efdc5d0f109 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:18.165143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-346143b5-b718-4c1b-b002-3efdc5d0f109 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:18.165930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-346143b5-b718-4c1b-b002-3efdc5d0f109 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:18.166357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-346143b5-b718-4c1b-b002-3efdc5d0f109 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:18.179042 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f2c65a34-79b9-43c3-b61e-cc9d599a9223 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:18.179645 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f2c65a34-79b9-43c3-b61e-cc9d599a9223 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:18.185887 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f2c65a34-79b9-43c3-b61e-cc9d599a9223 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:18.186338 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f2c65a34-79b9-43c3-b61e-cc9d599a9223 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:18.187152 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f2c65a34-79b9-43c3-b61e-cc9d599a9223 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:18.187621 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f2c65a34-79b9-43c3-b61e-cc9d599a9223 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:18.318769 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-346143b5-b718-4c1b-b002-3efdc5d0f109 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:18.326336 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-346143b5-b718-4c1b-b002-3efdc5d0f109 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1314 microversion: 2.1 time: 0.173455 Nov 02 23:09:18.327055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 226/443] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:18 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:18.329903 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-f2c65a34-79b9-43c3-b61e-cc9d599a9223 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:18.338667 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f2c65a34-79b9-43c3-b61e-cc9d599a9223 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1321 microversion: 2.1 time: 0.163871 Nov 02 23:09:18.339951 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 218/444] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:18 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:18.953348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a3cd0a81-7060-4061-9b3a-1cbf50b9624d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:18.954561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a3cd0a81-7060-4061-9b3a-1cbf50b9624d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:18.961999 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3cd0a81-7060-4061-9b3a-1cbf50b9624d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:18.962659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3cd0a81-7060-4061-9b3a-1cbf50b9624d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:18.963657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3cd0a81-7060-4061-9b3a-1cbf50b9624d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:18.964270 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3cd0a81-7060-4061-9b3a-1cbf50b9624d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:19.110709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a3cd0a81-7060-4061-9b3a-1cbf50b9624d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28163 microversion: 2.1 time: 0.160890 Nov 02 23:09:19.111429 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 227/445] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:18 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28163 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:09:19.125385 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-be5d4953-eb07-4298-8995-ae31461d0d59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:19.126367 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-be5d4953-eb07-4298-8995-ae31461d0d59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:19.133347 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-be5d4953-eb07-4298-8995-ae31461d0d59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:19.134167 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-be5d4953-eb07-4298-8995-ae31461d0d59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:19.135277 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-be5d4953-eb07-4298-8995-ae31461d0d59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:19.135887 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-be5d4953-eb07-4298-8995-ae31461d0d59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:19.145127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a0a92f2e-3664-43e4-9fed-903512dca579 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:19.145821 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a0a92f2e-3664-43e4-9fed-903512dca579 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:19.152784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0a92f2e-3664-43e4-9fed-903512dca579 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:19.153361 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0a92f2e-3664-43e4-9fed-903512dca579 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:19.154591 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0a92f2e-3664-43e4-9fed-903512dca579 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:19.155165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0a92f2e-3664-43e4-9fed-903512dca579 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:19.327138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a0a92f2e-3664-43e4-9fed-903512dca579 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:19.335785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a0a92f2e-3664-43e4-9fed-903512dca579 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5" status: 200 len: 1507 microversion: 2.1 time: 0.196170 Nov 02 23:09:19.336369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 228/446] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:19 2021] GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5 => generated 1507 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:19.342340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-513b5d48-4d37-4a10-b88e-99f7eb45444b tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:19.342874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-513b5d48-4d37-4a10-b88e-99f7eb45444b tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:19.349350 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-513b5d48-4d37-4a10-b88e-99f7eb45444b tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:19.349825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-513b5d48-4d37-4a10-b88e-99f7eb45444b tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:19.350672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-513b5d48-4d37-4a10-b88e-99f7eb45444b tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:19.351142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-513b5d48-4d37-4a10-b88e-99f7eb45444b tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:19.408281 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-be5d4953-eb07-4298-8995-ae31461d0d59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28174 microversion: 2.20 time: 0.286424 Nov 02 23:09:19.408934 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 219/447] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:19 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28174 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:09:19.414734 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-2240e8d5-8e73-4cbd-b9ff-81fd3a6036dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45fd287b-bc36-4da3-90d9-09d47c4ccc49"}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:19.416476 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-2240e8d5-8e73-4cbd-b9ff-81fd3a6036dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:19.424050 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2240e8d5-8e73-4cbd-b9ff-81fd3a6036dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:19.424952 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2240e8d5-8e73-4cbd-b9ff-81fd3a6036dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:19.425952 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2240e8d5-8e73-4cbd-b9ff-81fd3a6036dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:19.427381 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2240e8d5-8e73-4cbd-b9ff-81fd3a6036dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:19.512989 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.wsgi [None req-2240e8d5-8e73-4cbd-b9ff-81fd3a6036dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] HTTP exception thrown: Invalid volume: volume 45fd287b-bc36-4da3-90d9-09d47c4ccc49 is already attached to instances: ac92ad6f-13c2-4a74-bf07-98d2935a9b26 Nov 02 23:09:19.513589 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-2240e8d5-8e73-4cbd-b9ff-81fd3a6036dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Returning 400 to user: Invalid volume: volume 45fd287b-bc36-4da3-90d9-09d47c4ccc49 is already attached to instances: ac92ad6f-13c2-4a74-bf07-98d2935a9b26 {{(pid=115799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:09:19.514625 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-2240e8d5-8e73-4cbd-b9ff-81fd3a6036dc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "POST /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104396 Nov 02 23:09:19.515681 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 220/448] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 2 23:09:19 2021] POST /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 23:09:19.522322 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d12e7526-c2ec-462f-bc14-018bd0ac7a2b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:19.522697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-513b5d48-4d37-4a10-b88e-99f7eb45444b tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:19.523369 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d12e7526-c2ec-462f-bc14-018bd0ac7a2b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:19.531339 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d12e7526-c2ec-462f-bc14-018bd0ac7a2b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:19.531824 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d12e7526-c2ec-462f-bc14-018bd0ac7a2b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:19.532125 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-513b5d48-4d37-4a10-b88e-99f7eb45444b tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1314 microversion: 2.1 time: 0.192808 Nov 02 23:09:19.532780 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d12e7526-c2ec-462f-bc14-018bd0ac7a2b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:19.533565 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d12e7526-c2ec-462f-bc14-018bd0ac7a2b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:19.533696 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 229/449] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:19 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:19.581818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-846b2ade-9bfc-4c13-877c-af582559ffd3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:19.582560 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-846b2ade-9bfc-4c13-877c-af582559ffd3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:19.589088 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-846b2ade-9bfc-4c13-877c-af582559ffd3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:19.589706 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-846b2ade-9bfc-4c13-877c-af582559ffd3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:19.590650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-846b2ade-9bfc-4c13-877c-af582559ffd3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:19.591320 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-846b2ade-9bfc-4c13-877c-af582559ffd3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:19.699188 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-d12e7526-c2ec-462f-bc14-018bd0ac7a2b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:19.707471 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d12e7526-c2ec-462f-bc14-018bd0ac7a2b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1321 microversion: 2.1 time: 0.190545 Nov 02 23:09:19.708058 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 221/450] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:19 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:19.749731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.objects.instance [None req-846b2ade-9bfc-4c13-877c-af582559ffd3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lazy-loading 'services' on Instance uuid ac92ad6f-13c2-4a74-bf07-98d2935a9b26 {{(pid=115800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 23:09:19.862862 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-846b2ade-9bfc-4c13-877c-af582559ffd3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26/os-volume_attachments/45fd287b-bc36-4da3-90d9-09d47c4ccc49" status: 202 len: 0 microversion: 2.1 time: 0.285039 Nov 02 23:09:19.864199 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 230/451] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 2 23:09:19 2021] DELETE /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26/os-volume_attachments/45fd287b-bc36-4da3-90d9-09d47c4ccc49 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:09:19.872502 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-8eb2cc5c-ba77-4fe7-a6fc-b12b1b7f1119 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:19.873959 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-8eb2cc5c-ba77-4fe7-a6fc-b12b1b7f1119 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:19.881603 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8eb2cc5c-ba77-4fe7-a6fc-b12b1b7f1119 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:19.882143 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8eb2cc5c-ba77-4fe7-a6fc-b12b1b7f1119 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:19.883374 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8eb2cc5c-ba77-4fe7-a6fc-b12b1b7f1119 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:19.884416 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8eb2cc5c-ba77-4fe7-a6fc-b12b1b7f1119 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:19.921549 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-8eb2cc5c-ba77-4fe7-a6fc-b12b1b7f1119 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052273 Nov 02 23:09:19.921770 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 222/452] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:09:19 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:09:20.123421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-13462ae7-222c-43ba-864a-81d67a271bd0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:20.124403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-13462ae7-222c-43ba-864a-81d67a271bd0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:20.131166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-13462ae7-222c-43ba-864a-81d67a271bd0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:20.131610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-13462ae7-222c-43ba-864a-81d67a271bd0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:20.132370 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-13462ae7-222c-43ba-864a-81d67a271bd0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:20.132793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-13462ae7-222c-43ba-864a-81d67a271bd0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:20.255476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-13462ae7-222c-43ba-864a-81d67a271bd0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28163 microversion: 2.1 time: 0.136015 Nov 02 23:09:20.256133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 231/453] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:20 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28163 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:09:20.419732 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f11e33ee-53eb-429e-a2b7-43f90d565c2f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:20.420645 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f11e33ee-53eb-429e-a2b7-43f90d565c2f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:20.427864 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f11e33ee-53eb-429e-a2b7-43f90d565c2f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:20.428331 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f11e33ee-53eb-429e-a2b7-43f90d565c2f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:20.429159 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f11e33ee-53eb-429e-a2b7-43f90d565c2f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:20.429582 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f11e33ee-53eb-429e-a2b7-43f90d565c2f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:20.549905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e0cb0954-7541-4b17-9fd8-95d547231825 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:20.551322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e0cb0954-7541-4b17-9fd8-95d547231825 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:20.558736 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0cb0954-7541-4b17-9fd8-95d547231825 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:20.559266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0cb0954-7541-4b17-9fd8-95d547231825 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:20.560069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0cb0954-7541-4b17-9fd8-95d547231825 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:20.560507 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0cb0954-7541-4b17-9fd8-95d547231825 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:20.587045 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f11e33ee-53eb-429e-a2b7-43f90d565c2f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28174 microversion: 2.20 time: 0.170745 Nov 02 23:09:20.591105 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 223/454] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:20 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28174 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:09:20.695787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e0cb0954-7541-4b17-9fd8-95d547231825 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:20.705850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e0cb0954-7541-4b17-9fd8-95d547231825 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1314 microversion: 2.1 time: 0.159564 Nov 02 23:09:20.706616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 232/455] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:20 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:20.725599 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-5df8b1f7-4b15-494e-bc63-02484e2dd2c2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:20.726344 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-5df8b1f7-4b15-494e-bc63-02484e2dd2c2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:20.733054 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5df8b1f7-4b15-494e-bc63-02484e2dd2c2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:20.733494 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5df8b1f7-4b15-494e-bc63-02484e2dd2c2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:20.734263 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5df8b1f7-4b15-494e-bc63-02484e2dd2c2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:20.734691 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5df8b1f7-4b15-494e-bc63-02484e2dd2c2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:20.872602 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-5df8b1f7-4b15-494e-bc63-02484e2dd2c2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:20.880203 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-5df8b1f7-4b15-494e-bc63-02484e2dd2c2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1321 microversion: 2.1 time: 0.159135 Nov 02 23:09:20.880773 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 224/456] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:20 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:20.932453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-47807d7f-44f9-4271-84a5-85d4669514c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:20.933314 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-47807d7f-44f9-4271-84a5-85d4669514c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:20.939636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47807d7f-44f9-4271-84a5-85d4669514c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:20.940095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47807d7f-44f9-4271-84a5-85d4669514c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:20.940856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47807d7f-44f9-4271-84a5-85d4669514c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:20.941281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47807d7f-44f9-4271-84a5-85d4669514c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:20.974637 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-47807d7f-44f9-4271-84a5-85d4669514c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045947 Nov 02 23:09:20.975229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 233/457] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:09:20 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:09:21.267163 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-0f599793-35d6-4122-818b-100b5df4e436 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:21.268273 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-0f599793-35d6-4122-818b-100b5df4e436 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:21.275865 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0f599793-35d6-4122-818b-100b5df4e436 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:21.276311 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0f599793-35d6-4122-818b-100b5df4e436 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:21.277132 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0f599793-35d6-4122-818b-100b5df4e436 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:21.277596 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0f599793-35d6-4122-818b-100b5df4e436 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:21.414198 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-0f599793-35d6-4122-818b-100b5df4e436 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28163 microversion: 2.1 time: 0.150873 Nov 02 23:09:21.414950 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 225/458] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:21 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28163 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:09:21.599296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-46f77dd6-50a6-4986-9271-d89bfcd11b79 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:21.600230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-46f77dd6-50a6-4986-9271-d89bfcd11b79 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:21.607390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-46f77dd6-50a6-4986-9271-d89bfcd11b79 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:21.608143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-46f77dd6-50a6-4986-9271-d89bfcd11b79 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:21.609163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-46f77dd6-50a6-4986-9271-d89bfcd11b79 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:21.609860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-46f77dd6-50a6-4986-9271-d89bfcd11b79 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:21.619746 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [req-1b3ec65b-b81c-4bf2-9502-3949836d4bed req-c9c7b4b8-4242-450f-b299-f3ef2af8a3cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "128302f3-f7c5-4789-a766-c426046c9d16", "name": "network-vif-plugged", "status": "completed", "tag": "6970655b-4ce0-4ff1-84c7-8e4ac80b49ab"}]} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:21.621496 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:09:21.621496 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: warnings.warn(msg) Nov 02 23:09:21.632812 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-1b3ec65b-b81c-4bf2-9502-3949836d4bed req-c9c7b4b8-4242-450f-b299-f3ef2af8a3cc service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:21.633669 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-1b3ec65b-b81c-4bf2-9502-3949836d4bed req-c9c7b4b8-4242-450f-b299-f3ef2af8a3cc service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:21.651638 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.compute.server_external_events [req-1b3ec65b-b81c-4bf2-9502-3949836d4bed req-c9c7b4b8-4242-450f-b299-f3ef2af8a3cc service nova] Creating event network-vif-plugged:6970655b-4ce0-4ff1-84c7-8e4ac80b49ab for instance 128302f3-f7c5-4789-a766-c426046c9d16 on hv-cinder-81584 Nov 02 23:09:21.657537 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [req-1b3ec65b-b81c-4bf2-9502-3949836d4bed req-c9c7b4b8-4242-450f-b299-f3ef2af8a3cc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045884 Nov 02 23:09:21.661274 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 226/459] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:09:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:09:21.724753 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-4bca804b-e524-4ed0-919f-184bca1ce1d8 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:21.725509 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-4bca804b-e524-4ed0-919f-184bca1ce1d8 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:21.734204 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4bca804b-e524-4ed0-919f-184bca1ce1d8 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:21.734651 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4bca804b-e524-4ed0-919f-184bca1ce1d8 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:21.735457 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4bca804b-e524-4ed0-919f-184bca1ce1d8 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:21.736294 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4bca804b-e524-4ed0-919f-184bca1ce1d8 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:21.753062 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-46f77dd6-50a6-4986-9271-d89bfcd11b79 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28174 microversion: 2.20 time: 0.157870 Nov 02 23:09:21.755021 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 234/460] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:21 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28174 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:09:21.901123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5825ac87-5706-47ff-bf0f-48a70e59b148 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:21.902349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5825ac87-5706-47ff-bf0f-48a70e59b148 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:21.914489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5825ac87-5706-47ff-bf0f-48a70e59b148 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:21.915264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5825ac87-5706-47ff-bf0f-48a70e59b148 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:21.918070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5825ac87-5706-47ff-bf0f-48a70e59b148 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:21.919090 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5825ac87-5706-47ff-bf0f-48a70e59b148 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:21.956362 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-4bca804b-e524-4ed0-919f-184bca1ce1d8 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:21.966769 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-4bca804b-e524-4ed0-919f-184bca1ce1d8 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1314 microversion: 2.1 time: 0.246802 Nov 02 23:09:21.969116 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 227/461] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:21 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:21.989235 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-262f38ce-d074-4cd3-97b9-cf3a70bb92fb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:21.990642 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-262f38ce-d074-4cd3-97b9-cf3a70bb92fb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:22.005834 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-262f38ce-d074-4cd3-97b9-cf3a70bb92fb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:22.006819 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-262f38ce-d074-4cd3-97b9-cf3a70bb92fb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:22.007907 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-262f38ce-d074-4cd3-97b9-cf3a70bb92fb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:22.008572 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-262f38ce-d074-4cd3-97b9-cf3a70bb92fb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:22.063846 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-262f38ce-d074-4cd3-97b9-cf3a70bb92fb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081628 Nov 02 23:09:22.065025 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 228/462] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:09:21 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 23:09:22.260720 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5825ac87-5706-47ff-bf0f-48a70e59b148 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:22.270718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5825ac87-5706-47ff-bf0f-48a70e59b148 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1321 microversion: 2.1 time: 0.376912 Nov 02 23:09:22.272230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 235/463] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:21 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1321 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:22.328141 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f2771889-65bb-49fa-a42c-0e3c07002db6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1140715619", "imageRef": "4159c567-fd66-4bbb-9bf4-6ce0afd65d88", "flavorRef": "452", "networks": [{"uuid": "a641b2e8-96fc-4d47-b974-970483d44042"}]}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:22.389634 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.network.neutron [None req-f2771889-65bb-49fa-a42c-0e3c07002db6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] validate_networks() for [('a641b2e8-96fc-4d47-b974-970483d44042', None, None, None, None, None)] {{(pid=115799) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 23:09:22.425568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0b2af86f-94f8-4d93-9a84-c0a94e31eddc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:22.426575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0b2af86f-94f8-4d93-9a84-c0a94e31eddc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:22.432978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b2af86f-94f8-4d93-9a84-c0a94e31eddc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:22.432978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b2af86f-94f8-4d93-9a84-c0a94e31eddc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:22.433599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b2af86f-94f8-4d93-9a84-c0a94e31eddc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:22.436607 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b2af86f-94f8-4d93-9a84-c0a94e31eddc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:22.788790 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-f2771889-65bb-49fa-a42c-0e3c07002db6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Flavor limits 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 23:09:22.789289 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-f2771889-65bb-49fa-a42c-0e3c07002db6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Image limits 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 23:09:22.789766 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-f2771889-65bb-49fa-a42c-0e3c07002db6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Flavor pref 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 23:09:22.790168 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-f2771889-65bb-49fa-a42c-0e3c07002db6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Image pref 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 23:09:22.790571 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-f2771889-65bb-49fa-a42c-0e3c07002db6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 23:09:22.799409 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f2771889-65bb-49fa-a42c-0e3c07002db6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:22.799871 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f2771889-65bb-49fa-a42c-0e3c07002db6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:22.800838 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f2771889-65bb-49fa-a42c-0e3c07002db6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:22.801376 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f2771889-65bb-49fa-a42c-0e3c07002db6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:22.818528 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.quota [None req-f2771889-65bb-49fa-a42c-0e3c07002db6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Getting quotas for project 0f70e69ec3db4f378ac856e1e93b45e5. Resources: {'cores', 'instances', 'ram'} {{(pid=115799) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:09:22.822439 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.quota [None req-f2771889-65bb-49fa-a42c-0e3c07002db6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Getting quotas for user 81a16c3887f94b4d825e21e2fe34e26b and project 0f70e69ec3db4f378ac856e1e93b45e5. Resources: {'cores', 'instances', 'ram'} {{(pid=115799) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:09:22.833957 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f2771889-65bb-49fa-a42c-0e3c07002db6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Going to run 1 instances... {{(pid=115799) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 23:09:22.836306 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f2771889-65bb-49fa-a42c-0e3c07002db6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4159c567-fd66-4bbb-9bf4-6ce0afd65d88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 23:09:22.868419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0b2af86f-94f8-4d93-9a84-c0a94e31eddc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28163 microversion: 2.1 time: 0.446251 Nov 02 23:09:22.870035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 236/464] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:22 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28163 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:09:22.874450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9ca26ccb-9a6d-4b5f-9c76-26c75b58fa64 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:22.875683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9ca26ccb-9a6d-4b5f-9c76-26c75b58fa64 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:22.883671 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ca26ccb-9a6d-4b5f-9c76-26c75b58fa64 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:22.884359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ca26ccb-9a6d-4b5f-9c76-26c75b58fa64 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:22.885142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ca26ccb-9a6d-4b5f-9c76-26c75b58fa64 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:22.885575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ca26ccb-9a6d-4b5f-9c76-26c75b58fa64 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:22.892577 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f2771889-65bb-49fa-a42c-0e3c07002db6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568433 Nov 02 23:09:22.893608 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 229/465] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 2 23:09:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 23:09:22.904102 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-18e5bda1-e14a-4995-83e3-196d642fbb97 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:22.905052 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-18e5bda1-e14a-4995-83e3-196d642fbb97 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:22.970697 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-18e5bda1-e14a-4995-83e3-196d642fbb97 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:22.978113 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-18e5bda1-e14a-4995-83e3-196d642fbb97 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1218 microversion: 2.1 time: 0.077840 Nov 02 23:09:22.978778 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 230/466] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:22 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:22.993178 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-92be7095-9d63-41cc-9133-f6def67a81da tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:22.993801 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-92be7095-9d63-41cc-9133-f6def67a81da tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:23.001123 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-92be7095-9d63-41cc-9133-f6def67a81da tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:23.007052 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-92be7095-9d63-41cc-9133-f6def67a81da tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:23.007052 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-92be7095-9d63-41cc-9133-f6def67a81da tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:23.007052 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-92be7095-9d63-41cc-9133-f6def67a81da tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:23.038514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9ca26ccb-9a6d-4b5f-9c76-26c75b58fa64 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28174 microversion: 2.20 time: 0.167851 Nov 02 23:09:23.039432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 237/467] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:22 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28174 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:09:23.153647 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-92be7095-9d63-41cc-9133-f6def67a81da tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:23.161072 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-92be7095-9d63-41cc-9133-f6def67a81da tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1314 microversion: 2.1 time: 0.171381 Nov 02 23:09:23.161833 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 231/468] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:22 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:23.287681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a0f01581-b078-45dd-bfc0-330ab1728ba0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:23.288629 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a0f01581-b078-45dd-bfc0-330ab1728ba0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:23.295741 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0f01581-b078-45dd-bfc0-330ab1728ba0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:23.296192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0f01581-b078-45dd-bfc0-330ab1728ba0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:23.296984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0f01581-b078-45dd-bfc0-330ab1728ba0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:23.297420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0f01581-b078-45dd-bfc0-330ab1728ba0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:23.480906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a0f01581-b078-45dd-bfc0-330ab1728ba0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:23.488892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a0f01581-b078-45dd-bfc0-330ab1728ba0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1321 microversion: 2.1 time: 0.204824 Nov 02 23:09:23.489690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 238/469] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:23 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:23.689933 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [req-fd4e2697-f24a-421f-910f-bdc68f50c5b9 req-7e3680bc-7454-4688-a764-3b596c06eefd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796da481-6150-4e95-86f5-1e0732bce021", "name": "network-vif-plugged", "status": "completed", "tag": "abf458ed-eb32-434b-b82d-37b87b8d8d25"}, {"server_uuid": "e7bf8316-893d-4fad-b5f0-4ecad89120b3", "name": "network-vif-plugged", "status": "completed", "tag": "9393cccd-7a26-4491-b2a8-fc394dd1ec6c"}]} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:23.691854 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:09:23.691854 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: warnings.warn(msg) Nov 02 23:09:23.699857 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-fd4e2697-f24a-421f-910f-bdc68f50c5b9 req-7e3680bc-7454-4688-a764-3b596c06eefd service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:23.700300 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-fd4e2697-f24a-421f-910f-bdc68f50c5b9 req-7e3680bc-7454-4688-a764-3b596c06eefd service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:23.713162 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.compute.server_external_events [req-fd4e2697-f24a-421f-910f-bdc68f50c5b9 req-7e3680bc-7454-4688-a764-3b596c06eefd service nova] Creating event network-vif-plugged:abf458ed-eb32-434b-b82d-37b87b8d8d25 for instance 796da481-6150-4e95-86f5-1e0732bce021 on hv-cinder-81584 Nov 02 23:09:23.713664 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.compute.server_external_events [req-fd4e2697-f24a-421f-910f-bdc68f50c5b9 req-7e3680bc-7454-4688-a764-3b596c06eefd service nova] Creating event network-vif-plugged:9393cccd-7a26-4491-b2a8-fc394dd1ec6c for instance e7bf8316-893d-4fad-b5f0-4ecad89120b3 on hv-cinder-81584 Nov 02 23:09:23.720406 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [req-fd4e2697-f24a-421f-910f-bdc68f50c5b9 req-7e3680bc-7454-4688-a764-3b596c06eefd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034133 Nov 02 23:09:23.721017 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 232/470] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:09:23 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:09:23.879996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aa6def82-c74a-4f87-94bc-00c077ef6eb9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:23.881754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aa6def82-c74a-4f87-94bc-00c077ef6eb9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:23.888202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa6def82-c74a-4f87-94bc-00c077ef6eb9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:23.888652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa6def82-c74a-4f87-94bc-00c077ef6eb9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:23.889629 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa6def82-c74a-4f87-94bc-00c077ef6eb9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:23.890067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa6def82-c74a-4f87-94bc-00c077ef6eb9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:23.994660 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-4dc69633-1f68-4dc4-88b2-ae80ae09cf11 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:23.995384 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-4dc69633-1f68-4dc4-88b2-ae80ae09cf11 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:24.003724 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4dc69633-1f68-4dc4-88b2-ae80ae09cf11 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:24.004750 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4dc69633-1f68-4dc4-88b2-ae80ae09cf11 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:24.005548 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4dc69633-1f68-4dc4-88b2-ae80ae09cf11 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:24.005985 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4dc69633-1f68-4dc4-88b2-ae80ae09cf11 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:24.037091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aa6def82-c74a-4f87-94bc-00c077ef6eb9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28163 microversion: 2.1 time: 0.160608 Nov 02 23:09:24.042236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 239/471] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:23 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28163 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:09:24.061072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-71f029e9-9a12-44c3-aa92-fd14170e8cad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:24.062520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-71f029e9-9a12-44c3-aa92-fd14170e8cad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:24.080600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-71f029e9-9a12-44c3-aa92-fd14170e8cad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:24.082176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-71f029e9-9a12-44c3-aa92-fd14170e8cad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:24.083238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-71f029e9-9a12-44c3-aa92-fd14170e8cad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:24.083901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-71f029e9-9a12-44c3-aa92-fd14170e8cad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:24.104526 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-4dc69633-1f68-4dc4-88b2-ae80ae09cf11 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:24.112798 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-4dc69633-1f68-4dc4-88b2-ae80ae09cf11 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1270 microversion: 2.1 time: 0.122005 Nov 02 23:09:24.114111 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 233/472] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:23 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1270 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:24.178696 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-244aeaf3-cecf-4406-a9ac-5aeaab3285cf tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:24.179332 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-244aeaf3-cecf-4406-a9ac-5aeaab3285cf tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:24.186306 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-244aeaf3-cecf-4406-a9ac-5aeaab3285cf tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:24.186764 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-244aeaf3-cecf-4406-a9ac-5aeaab3285cf tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:24.187596 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-244aeaf3-cecf-4406-a9ac-5aeaab3285cf tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:24.188029 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-244aeaf3-cecf-4406-a9ac-5aeaab3285cf tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:24.325859 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-244aeaf3-cecf-4406-a9ac-5aeaab3285cf tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:24.330942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-71f029e9-9a12-44c3-aa92-fd14170e8cad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28174 microversion: 2.20 time: 0.283201 Nov 02 23:09:24.332468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 240/473] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:24 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28174 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:09:24.337699 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-244aeaf3-cecf-4406-a9ac-5aeaab3285cf tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1314 microversion: 2.1 time: 0.162726 Nov 02 23:09:24.338290 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 234/474] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:24 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:24.506678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e4e164e8-5d6f-4830-9e5e-a202039ee519 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:24.507762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e4e164e8-5d6f-4830-9e5e-a202039ee519 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:24.519774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4e164e8-5d6f-4830-9e5e-a202039ee519 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:24.520396 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4e164e8-5d6f-4830-9e5e-a202039ee519 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:24.521369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4e164e8-5d6f-4830-9e5e-a202039ee519 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:24.521949 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4e164e8-5d6f-4830-9e5e-a202039ee519 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:24.666396 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e4e164e8-5d6f-4830-9e5e-a202039ee519 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:24.676944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e4e164e8-5d6f-4830-9e5e-a202039ee519 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1321 microversion: 2.1 time: 0.174923 Nov 02 23:09:24.686997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 241/475] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:24 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:25.049453 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d81300fe-3b56-41d4-b2f8-dc98f0a470d2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:25.051107 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d81300fe-3b56-41d4-b2f8-dc98f0a470d2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:25.057990 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d81300fe-3b56-41d4-b2f8-dc98f0a470d2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:25.058432 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d81300fe-3b56-41d4-b2f8-dc98f0a470d2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:25.059248 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d81300fe-3b56-41d4-b2f8-dc98f0a470d2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:25.059680 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d81300fe-3b56-41d4-b2f8-dc98f0a470d2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:25.129611 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5fbbb00f-333f-4cb4-89da-4379216f4067 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:25.130222 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5fbbb00f-333f-4cb4-89da-4379216f4067 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:25.136957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5fbbb00f-333f-4cb4-89da-4379216f4067 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:25.137398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5fbbb00f-333f-4cb4-89da-4379216f4067 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:25.138199 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5fbbb00f-333f-4cb4-89da-4379216f4067 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:25.138632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5fbbb00f-333f-4cb4-89da-4379216f4067 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:25.198642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5fbbb00f-333f-4cb4-89da-4379216f4067 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:25.211379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5fbbb00f-333f-4cb4-89da-4379216f4067 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1270 microversion: 2.1 time: 0.085444 Nov 02 23:09:25.212134 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 242/476] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:25 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:25.342622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-459145d8-f6a4-4377-a11a-c29877d7813f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:25.343738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-459145d8-f6a4-4377-a11a-c29877d7813f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:25.350405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-459145d8-f6a4-4377-a11a-c29877d7813f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:25.350908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-459145d8-f6a4-4377-a11a-c29877d7813f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:25.351768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-459145d8-f6a4-4377-a11a-c29877d7813f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:25.352261 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-459145d8-f6a4-4377-a11a-c29877d7813f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:32.352220 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d81300fe-3b56-41d4-b2f8-dc98f0a470d2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28163 microversion: 2.1 time: 7.307331 Nov 02 23:09:32.356450 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 235/477] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:25 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28163 bytes in 7309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:09:32.357598 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-cb4fafe5-3dab-4526-908a-0d556bc09a73 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:32.358290 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-cb4fafe5-3dab-4526-908a-0d556bc09a73 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:32.366031 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cb4fafe5-3dab-4526-908a-0d556bc09a73 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:32.366473 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cb4fafe5-3dab-4526-908a-0d556bc09a73 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:32.367272 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cb4fafe5-3dab-4526-908a-0d556bc09a73 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:32.367711 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cb4fafe5-3dab-4526-908a-0d556bc09a73 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:32.506910 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-cb4fafe5-3dab-4526-908a-0d556bc09a73 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:32.514130 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-cb4fafe5-3dab-4526-908a-0d556bc09a73 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1314 microversion: 2.1 time: 0.160143 Nov 02 23:09:32.514715 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 236/478] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:32 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:32.519593 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ed530919-f6a3-4790-85c8-f855e735b524 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:32.520198 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ed530919-f6a3-4790-85c8-f855e735b524 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:32.525702 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ed530919-f6a3-4790-85c8-f855e735b524 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:32.526149 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ed530919-f6a3-4790-85c8-f855e735b524 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:32.526945 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ed530919-f6a3-4790-85c8-f855e735b524 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:32.527387 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ed530919-f6a3-4790-85c8-f855e735b524 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:32.656050 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-ed530919-f6a3-4790-85c8-f855e735b524 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:32.663462 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ed530919-f6a3-4790-85c8-f855e735b524 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1515 microversion: 2.1 time: 0.147778 Nov 02 23:09:32.664037 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 237/479] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:32 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:32.668345 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-360eb0fe-d866-481f-81ae-5eb0c7243a00 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:32.668943 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-360eb0fe-d866-481f-81ae-5eb0c7243a00 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:32.674607 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-360eb0fe-d866-481f-81ae-5eb0c7243a00 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:32.675152 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-360eb0fe-d866-481f-81ae-5eb0c7243a00 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:32.675923 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-360eb0fe-d866-481f-81ae-5eb0c7243a00 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:32.676358 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-360eb0fe-d866-481f-81ae-5eb0c7243a00 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:32.734720 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-360eb0fe-d866-481f-81ae-5eb0c7243a00 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:32.741801 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-360eb0fe-d866-481f-81ae-5eb0c7243a00 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1278 microversion: 2.1 time: 0.076828 Nov 02 23:09:32.742353 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 238/480] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:32 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1278 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:32.746856 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-9152f068-b89a-4755-b29f-fc8281147d7d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:32.747788 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-9152f068-b89a-4755-b29f-fc8281147d7d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:32.754090 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9152f068-b89a-4755-b29f-fc8281147d7d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:32.754611 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9152f068-b89a-4755-b29f-fc8281147d7d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:32.755350 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9152f068-b89a-4755-b29f-fc8281147d7d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:32.755788 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9152f068-b89a-4755-b29f-fc8281147d7d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:32.782063 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.objects.instance [None req-9152f068-b89a-4755-b29f-fc8281147d7d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lazy-loading 'flavor' on Instance uuid 128302f3-f7c5-4789-a766-c426046c9d16 {{(pid=115799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 23:09:32.888312 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-9152f068-b89a-4755-b29f-fc8281147d7d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "POST /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16/action" status: 200 len: 32 microversion: 2.1 time: 0.144753 Nov 02 23:09:32.888910 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 239/481] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:32 2021] POST /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16/action => generated 32 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 23:09:32.897924 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-9fee1883-2a64-4661-a51b-8df6ebc6a70d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:32.898615 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-9fee1883-2a64-4661-a51b-8df6ebc6a70d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:32.904512 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9fee1883-2a64-4661-a51b-8df6ebc6a70d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:32.904959 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9fee1883-2a64-4661-a51b-8df6ebc6a70d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:32.905737 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9fee1883-2a64-4661-a51b-8df6ebc6a70d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:32.906157 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9fee1883-2a64-4661-a51b-8df6ebc6a70d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:33.041925 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-9fee1883-2a64-4661-a51b-8df6ebc6a70d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:33.049407 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-9fee1883-2a64-4661-a51b-8df6ebc6a70d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.155322 Nov 02 23:09:33.049985 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 240/482] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:32 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:33.364627 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-20eb075d-f6fb-45c7-b874-fd507978a415 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:33.365451 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-20eb075d-f6fb-45c7-b874-fd507978a415 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:33.371255 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-20eb075d-f6fb-45c7-b874-fd507978a415 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:33.371702 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-20eb075d-f6fb-45c7-b874-fd507978a415 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:33.372456 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-20eb075d-f6fb-45c7-b874-fd507978a415 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:33.372883 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-20eb075d-f6fb-45c7-b874-fd507978a415 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:34.106902 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-459145d8-f6a4-4377-a11a-c29877d7813f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28174 microversion: 2.20 time: 8.767749 Nov 02 23:09:34.107630 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 243/483] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:25 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28174 bytes in 8769 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:09:34.124007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a21040e2-7894-4fa1-91d3-cb0c6adc7995 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:34.125040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a21040e2-7894-4fa1-91d3-cb0c6adc7995 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:34.133435 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a21040e2-7894-4fa1-91d3-cb0c6adc7995 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:34.134275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a21040e2-7894-4fa1-91d3-cb0c6adc7995 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:34.135640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a21040e2-7894-4fa1-91d3-cb0c6adc7995 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:34.136076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a21040e2-7894-4fa1-91d3-cb0c6adc7995 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:34.327792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a21040e2-7894-4fa1-91d3-cb0c6adc7995 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:34.335785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a21040e2-7894-4fa1-91d3-cb0c6adc7995 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1314 microversion: 2.1 time: 0.227098 Nov 02 23:09:34.336349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 244/484] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:34 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:34.340680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-84c8a3fe-88e2-4b7e-910d-57eea2e05a53 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:34.341275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-84c8a3fe-88e2-4b7e-910d-57eea2e05a53 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:34.346637 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-84c8a3fe-88e2-4b7e-910d-57eea2e05a53 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:34.347124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-84c8a3fe-88e2-4b7e-910d-57eea2e05a53 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:34.347891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-84c8a3fe-88e2-4b7e-910d-57eea2e05a53 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:34.348321 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-84c8a3fe-88e2-4b7e-910d-57eea2e05a53 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:34.408701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-84c8a3fe-88e2-4b7e-910d-57eea2e05a53 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:34.416049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-84c8a3fe-88e2-4b7e-910d-57eea2e05a53 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1276 microversion: 2.1 time: 0.078741 Nov 02 23:09:34.416611 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 245/485] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:34 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1276 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:34.420901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0595f903-d0b9-4491-9f52-81849dfe98b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:34.421493 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0595f903-d0b9-4491-9f52-81849dfe98b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:34.428263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0595f903-d0b9-4491-9f52-81849dfe98b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:34.428731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0595f903-d0b9-4491-9f52-81849dfe98b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:34.429475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0595f903-d0b9-4491-9f52-81849dfe98b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:34.429903 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0595f903-d0b9-4491-9f52-81849dfe98b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:34.551642 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-20eb075d-f6fb-45c7-b874-fd507978a415 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28163 microversion: 2.1 time: 1.190973 Nov 02 23:09:34.552775 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 241/486] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:33 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28163 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:09:34.562688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0595f903-d0b9-4491-9f52-81849dfe98b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:34.569989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0595f903-d0b9-4491-9f52-81849dfe98b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.152440 Nov 02 23:09:34.570567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 246/487] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:34 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:35.120600 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-95c788ea-90e2-4a74-9e32-207b2e021bdd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:35.121601 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-95c788ea-90e2-4a74-9e32-207b2e021bdd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:35.133695 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-95c788ea-90e2-4a74-9e32-207b2e021bdd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:35.134389 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-95c788ea-90e2-4a74-9e32-207b2e021bdd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:35.135335 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-95c788ea-90e2-4a74-9e32-207b2e021bdd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:35.135768 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-95c788ea-90e2-4a74-9e32-207b2e021bdd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:35.352425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0c24b002-e2ec-4105-98b7-385319698de2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:35.353696 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0c24b002-e2ec-4105-98b7-385319698de2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:35.361543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0c24b002-e2ec-4105-98b7-385319698de2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:35.363255 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0c24b002-e2ec-4105-98b7-385319698de2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:35.364174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0c24b002-e2ec-4105-98b7-385319698de2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:35.364610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0c24b002-e2ec-4105-98b7-385319698de2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:35.504488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0c24b002-e2ec-4105-98b7-385319698de2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:35.512067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0c24b002-e2ec-4105-98b7-385319698de2 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1314 microversion: 2.1 time: 0.163511 Nov 02 23:09:35.512869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 247/488] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:35 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:35.517393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-52b8b5b4-5f38-4d54-b9f7-04d980761106 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:35.518078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-52b8b5b4-5f38-4d54-b9f7-04d980761106 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:35.524988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52b8b5b4-5f38-4d54-b9f7-04d980761106 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:35.525436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52b8b5b4-5f38-4d54-b9f7-04d980761106 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:35.526224 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52b8b5b4-5f38-4d54-b9f7-04d980761106 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:35.526657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52b8b5b4-5f38-4d54-b9f7-04d980761106 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:35.532091 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-95c788ea-90e2-4a74-9e32-207b2e021bdd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28174 microversion: 2.20 time: 0.415406 Nov 02 23:09:35.533278 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 242/489] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:35 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28174 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:09:35.564001 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ba835026-21d9-46d0-8fec-78915f23d834 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:35.565156 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ba835026-21d9-46d0-8fec-78915f23d834 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:35.576669 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ba835026-21d9-46d0-8fec-78915f23d834 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:35.577231 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ba835026-21d9-46d0-8fec-78915f23d834 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:35.578101 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ba835026-21d9-46d0-8fec-78915f23d834 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:35.578613 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ba835026-21d9-46d0-8fec-78915f23d834 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:35.665870 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-52b8b5b4-5f38-4d54-b9f7-04d980761106 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:35.673090 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-52b8b5b4-5f38-4d54-b9f7-04d980761106 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1318 microversion: 2.1 time: 0.159461 Nov 02 23:09:35.673660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 248/490] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:35 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:35.678052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6ca0407d-806f-4633-b613-3332d82f6496 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:35.678655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6ca0407d-806f-4633-b613-3332d82f6496 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:35.684310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ca0407d-806f-4633-b613-3332d82f6496 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:35.684753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ca0407d-806f-4633-b613-3332d82f6496 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:35.685524 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ca0407d-806f-4633-b613-3332d82f6496 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:35.685954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ca0407d-806f-4633-b613-3332d82f6496 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:35.817296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6ca0407d-806f-4633-b613-3332d82f6496 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:35.824639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6ca0407d-806f-4633-b613-3332d82f6496 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.149990 Nov 02 23:09:35.825212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 249/491] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:35 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:36.008068 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ba835026-21d9-46d0-8fec-78915f23d834 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28163 microversion: 2.1 time: 0.448064 Nov 02 23:09:36.009602 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 243/492] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:35 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28163 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:09:36.062393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-af64769a-6da6-46ec-bc5d-3f3137abfe05 req-6758f117-f821-4f78-acb4-2868a9982f4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07", "tag": "a4dd4b8a-c493-4af8-b49d-f031913d57ab"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:36.063997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:09:36.063997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:09:36.071223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-af64769a-6da6-46ec-bc5d-3f3137abfe05 req-6758f117-f821-4f78-acb4-2868a9982f4a service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:36.071671 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-af64769a-6da6-46ec-bc5d-3f3137abfe05 req-6758f117-f821-4f78-acb4-2868a9982f4a service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:36.084283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-af64769a-6da6-46ec-bc5d-3f3137abfe05 req-6758f117-f821-4f78-acb4-2868a9982f4a service nova] Creating event network-changed:a4dd4b8a-c493-4af8-b49d-f031913d57ab for instance fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 on hv-cinder-81584 Nov 02 23:09:36.089343 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-af64769a-6da6-46ec-bc5d-3f3137abfe05 req-6758f117-f821-4f78-acb4-2868a9982f4a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030506 Nov 02 23:09:36.089940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 250/493] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:09:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:09:36.529686 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-6d9049ab-f4d4-4b3d-ab10-4e8a79f17815 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:36.530305 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-6d9049ab-f4d4-4b3d-ab10-4e8a79f17815 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:36.537586 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6d9049ab-f4d4-4b3d-ab10-4e8a79f17815 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:36.538042 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6d9049ab-f4d4-4b3d-ab10-4e8a79f17815 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:36.538839 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6d9049ab-f4d4-4b3d-ab10-4e8a79f17815 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:36.539300 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6d9049ab-f4d4-4b3d-ab10-4e8a79f17815 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:36.545060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b4b1c730-06be-424b-b31a-a7ea6269ca98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:36.546048 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b4b1c730-06be-424b-b31a-a7ea6269ca98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:36.552331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b4b1c730-06be-424b-b31a-a7ea6269ca98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:36.552936 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b4b1c730-06be-424b-b31a-a7ea6269ca98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:36.553936 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b4b1c730-06be-424b-b31a-a7ea6269ca98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:36.555147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b4b1c730-06be-424b-b31a-a7ea6269ca98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:36.689118 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6d9049ab-f4d4-4b3d-ab10-4e8a79f17815 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:36.696750 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-6d9049ab-f4d4-4b3d-ab10-4e8a79f17815 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1314 microversion: 2.1 time: 0.171314 Nov 02 23:09:36.697300 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 244/494] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:36 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:36.701465 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-bdaa5da0-85e6-4509-92a3-9eeba619f8ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:36.702056 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-bdaa5da0-85e6-4509-92a3-9eeba619f8ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:36.707832 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bdaa5da0-85e6-4509-92a3-9eeba619f8ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:36.708269 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bdaa5da0-85e6-4509-92a3-9eeba619f8ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:36.709037 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bdaa5da0-85e6-4509-92a3-9eeba619f8ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:36.709465 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bdaa5da0-85e6-4509-92a3-9eeba619f8ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:36.749164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b4b1c730-06be-424b-b31a-a7ea6269ca98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28174 microversion: 2.20 time: 0.207909 Nov 02 23:09:36.749835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 251/495] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:36 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28174 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:09:36.842054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b7d78e32-00af-4321-8f41-70d952463210 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:36.842771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b7d78e32-00af-4321-8f41-70d952463210 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:36.844132 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-bdaa5da0-85e6-4509-92a3-9eeba619f8ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:36.849598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b7d78e32-00af-4321-8f41-70d952463210 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:36.850039 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b7d78e32-00af-4321-8f41-70d952463210 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:36.850804 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b7d78e32-00af-4321-8f41-70d952463210 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:36.851265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b7d78e32-00af-4321-8f41-70d952463210 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:36.851392 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-bdaa5da0-85e6-4509-92a3-9eeba619f8ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1318 microversion: 2.1 time: 0.152993 Nov 02 23:09:36.851834 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 245/496] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:36 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:36.985826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b7d78e32-00af-4321-8f41-70d952463210 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:36.993893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b7d78e32-00af-4321-8f41-70d952463210 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.155870 Nov 02 23:09:36.994461 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 252/497] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:36 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:37.019644 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a28e29bf-647f-4b39-9ea5-8dfed9a647d1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:37.020669 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a28e29bf-647f-4b39-9ea5-8dfed9a647d1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:37.026492 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a28e29bf-647f-4b39-9ea5-8dfed9a647d1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:37.026970 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a28e29bf-647f-4b39-9ea5-8dfed9a647d1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:37.027728 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a28e29bf-647f-4b39-9ea5-8dfed9a647d1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:37.028160 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a28e29bf-647f-4b39-9ea5-8dfed9a647d1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:37.489879 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a28e29bf-647f-4b39-9ea5-8dfed9a647d1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28163 microversion: 2.1 time: 0.473610 Nov 02 23:09:37.493756 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 246/498] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:37 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28163 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:09:37.720540 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4d9704c7-3bd8-4c3b-824f-2bd00ee34384 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:37.721160 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4d9704c7-3bd8-4c3b-824f-2bd00ee34384 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:37.735193 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d9704c7-3bd8-4c3b-824f-2bd00ee34384 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:37.735899 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d9704c7-3bd8-4c3b-824f-2bd00ee34384 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:37.736829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d9704c7-3bd8-4c3b-824f-2bd00ee34384 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:37.737404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d9704c7-3bd8-4c3b-824f-2bd00ee34384 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:37.762836 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f0a9e78c-75a3-407c-98d1-03d018ea267f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:37.764565 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f0a9e78c-75a3-407c-98d1-03d018ea267f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:37.778286 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f0a9e78c-75a3-407c-98d1-03d018ea267f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:37.779033 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f0a9e78c-75a3-407c-98d1-03d018ea267f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:37.780109 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f0a9e78c-75a3-407c-98d1-03d018ea267f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:37.781197 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f0a9e78c-75a3-407c-98d1-03d018ea267f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:37.898518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4d9704c7-3bd8-4c3b-824f-2bd00ee34384 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:37.907633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4d9704c7-3bd8-4c3b-824f-2bd00ee34384 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1498 microversion: 2.1 time: 0.197888 Nov 02 23:09:37.908257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 253/499] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:37 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1498 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:37.914110 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4873a97a-d98e-4acb-8262-d59bac11da0c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:37.914712 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4873a97a-d98e-4acb-8262-d59bac11da0c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:37.920502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4873a97a-d98e-4acb-8262-d59bac11da0c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:37.920950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4873a97a-d98e-4acb-8262-d59bac11da0c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:37.921717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4873a97a-d98e-4acb-8262-d59bac11da0c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:37.922146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4873a97a-d98e-4acb-8262-d59bac11da0c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:38.067939 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4873a97a-d98e-4acb-8262-d59bac11da0c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:38.075154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4873a97a-d98e-4acb-8262-d59bac11da0c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1318 microversion: 2.1 time: 0.165545 Nov 02 23:09:38.083049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 254/500] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:37 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:38.084892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8f9ce83f-ad8d-41e5-8a50-07310d78fdff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:38.085493 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8f9ce83f-ad8d-41e5-8a50-07310d78fdff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:38.091698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8f9ce83f-ad8d-41e5-8a50-07310d78fdff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:38.092259 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8f9ce83f-ad8d-41e5-8a50-07310d78fdff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:38.093107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8f9ce83f-ad8d-41e5-8a50-07310d78fdff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:38.093663 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8f9ce83f-ad8d-41e5-8a50-07310d78fdff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:38.228788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8f9ce83f-ad8d-41e5-8a50-07310d78fdff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:38.236615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8f9ce83f-ad8d-41e5-8a50-07310d78fdff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.159908 Nov 02 23:09:38.239561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 255/501] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:38 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:38.502549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b17f4594-a0a3-47fa-ac1f-0f3627e69aaa tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:38.504177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b17f4594-a0a3-47fa-ac1f-0f3627e69aaa tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:38.510575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b17f4594-a0a3-47fa-ac1f-0f3627e69aaa tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:38.511057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b17f4594-a0a3-47fa-ac1f-0f3627e69aaa tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:38.511851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b17f4594-a0a3-47fa-ac1f-0f3627e69aaa tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:38.512275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b17f4594-a0a3-47fa-ac1f-0f3627e69aaa tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:38.665302 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f0a9e78c-75a3-407c-98d1-03d018ea267f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28174 microversion: 2.20 time: 0.908550 Nov 02 23:09:38.665870 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 247/502] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:37 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28174 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:09:38.693900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b17f4594-a0a3-47fa-ac1f-0f3627e69aaa tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28163 microversion: 2.1 time: 0.195993 Nov 02 23:09:38.694553 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 256/503] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:38 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28163 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:09:39.092951 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b85a4118-8ec2-41ae-8a02-bcd25f4e7aa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:39.093641 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b85a4118-8ec2-41ae-8a02-bcd25f4e7aa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:39.103513 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b85a4118-8ec2-41ae-8a02-bcd25f4e7aa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:39.103960 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b85a4118-8ec2-41ae-8a02-bcd25f4e7aa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:39.104724 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b85a4118-8ec2-41ae-8a02-bcd25f4e7aa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:39.105156 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b85a4118-8ec2-41ae-8a02-bcd25f4e7aa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:39.241935 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-b85a4118-8ec2-41ae-8a02-bcd25f4e7aa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:39.249537 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b85a4118-8ec2-41ae-8a02-bcd25f4e7aa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1318 microversion: 2.1 time: 0.160603 Nov 02 23:09:39.250106 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 248/504] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:39 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:39.254565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-426e43b7-6f46-46a7-9c52-0d8744046469 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:39.255288 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-426e43b7-6f46-46a7-9c52-0d8744046469 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:39.262112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-426e43b7-6f46-46a7-9c52-0d8744046469 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:39.262552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-426e43b7-6f46-46a7-9c52-0d8744046469 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:39.263346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-426e43b7-6f46-46a7-9c52-0d8744046469 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:39.263779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-426e43b7-6f46-46a7-9c52-0d8744046469 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:39.390220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-426e43b7-6f46-46a7-9c52-0d8744046469 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:39.397592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-426e43b7-6f46-46a7-9c52-0d8744046469 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.147544 Nov 02 23:09:39.398162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 257/505] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:39 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:39.677689 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-bba053a0-ce94-4066-b56e-f457e0fbf429 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:39.678528 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-bba053a0-ce94-4066-b56e-f457e0fbf429 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:39.684687 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bba053a0-ce94-4066-b56e-f457e0fbf429 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:39.685126 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bba053a0-ce94-4066-b56e-f457e0fbf429 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:39.685886 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bba053a0-ce94-4066-b56e-f457e0fbf429 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:39.686336 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bba053a0-ce94-4066-b56e-f457e0fbf429 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:39.705666 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-42170e31-4bf1-4520-9efd-ba14918a6a28 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:39.706580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-42170e31-4bf1-4520-9efd-ba14918a6a28 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:39.713163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42170e31-4bf1-4520-9efd-ba14918a6a28 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:39.713537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42170e31-4bf1-4520-9efd-ba14918a6a28 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:39.714311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42170e31-4bf1-4520-9efd-ba14918a6a28 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:39.714742 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42170e31-4bf1-4520-9efd-ba14918a6a28 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:39.897621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-42170e31-4bf1-4520-9efd-ba14918a6a28 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28163 microversion: 2.1 time: 0.195630 Nov 02 23:09:39.898280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 258/506] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:39 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28163 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:09:39.930670 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-bba053a0-ce94-4066-b56e-f457e0fbf429 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28174 microversion: 2.20 time: 0.256639 Nov 02 23:09:39.931377 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 249/507] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:39 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28174 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:09:40.030791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ce5a32ab-a215-4781-8530-733b612bee8a tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:40.031409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ce5a32ab-a215-4781-8530-733b612bee8a tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:40.038815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce5a32ab-a215-4781-8530-733b612bee8a tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:40.039298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce5a32ab-a215-4781-8530-733b612bee8a tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:40.040072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce5a32ab-a215-4781-8530-733b612bee8a tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:40.040504 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce5a32ab-a215-4781-8530-733b612bee8a tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:40.066092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ce5a32ab-a215-4781-8530-733b612bee8a tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Going to try to terminate instance {{(pid=115800) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 23:09:40.142640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ce5a32ab-a215-4781-8530-733b612bee8a tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "DELETE /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 204 len: 0 microversion: 2.1 time: 0.115516 Nov 02 23:09:40.143263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 259/508] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:09:40 2021] DELETE /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 23:09:40.152613 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-159bc3ca-294a-42bc-bae0-92cb664a470e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:40.153311 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-159bc3ca-294a-42bc-bae0-92cb664a470e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:40.160116 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-159bc3ca-294a-42bc-bae0-92cb664a470e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:40.160559 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-159bc3ca-294a-42bc-bae0-92cb664a470e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:40.161330 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-159bc3ca-294a-42bc-bae0-92cb664a470e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:40.161758 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-159bc3ca-294a-42bc-bae0-92cb664a470e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:40.267333 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1dda35a1-f64d-478c-bb11-d6b92f733490 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:40.268065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1dda35a1-f64d-478c-bb11-d6b92f733490 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:40.274936 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1dda35a1-f64d-478c-bb11-d6b92f733490 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:40.275599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1dda35a1-f64d-478c-bb11-d6b92f733490 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:40.276373 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1dda35a1-f64d-478c-bb11-d6b92f733490 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:40.276822 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1dda35a1-f64d-478c-bb11-d6b92f733490 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:40.295124 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-159bc3ca-294a-42bc-bae0-92cb664a470e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:40.302571 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-159bc3ca-294a-42bc-bae0-92cb664a470e tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1504 microversion: 2.1 time: 0.154085 Nov 02 23:09:40.303232 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 250/509] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:40 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:40.413729 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-42f8b2ff-7b06-43a5-9f3f-25640fb131b0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:40.414351 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-42f8b2ff-7b06-43a5-9f3f-25640fb131b0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:40.416262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1dda35a1-f64d-478c-bb11-d6b92f733490 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:40.420768 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-42f8b2ff-7b06-43a5-9f3f-25640fb131b0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:40.421400 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-42f8b2ff-7b06-43a5-9f3f-25640fb131b0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:40.422205 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-42f8b2ff-7b06-43a5-9f3f-25640fb131b0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:40.422668 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-42f8b2ff-7b06-43a5-9f3f-25640fb131b0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:40.423710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1dda35a1-f64d-478c-bb11-d6b92f733490 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1318 microversion: 2.1 time: 0.160506 Nov 02 23:09:40.424650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 260/510] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:40 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:40.560069 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-42f8b2ff-7b06-43a5-9f3f-25640fb131b0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:40.567977 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-42f8b2ff-7b06-43a5-9f3f-25640fb131b0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.158249 Nov 02 23:09:40.568550 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 251/511] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:40 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:40.910287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4741d2b4-fb61-4f00-b202-e51c572f9cc9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:40.911226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4741d2b4-fb61-4f00-b202-e51c572f9cc9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:40.917519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4741d2b4-fb61-4f00-b202-e51c572f9cc9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:40.917965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4741d2b4-fb61-4f00-b202-e51c572f9cc9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:40.918737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4741d2b4-fb61-4f00-b202-e51c572f9cc9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:40.919206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4741d2b4-fb61-4f00-b202-e51c572f9cc9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:40.942909 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e17260df-d4c2-4832-b692-ba0ea93f2861 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:40.943918 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e17260df-d4c2-4832-b692-ba0ea93f2861 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:40.950132 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e17260df-d4c2-4832-b692-ba0ea93f2861 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:40.950578 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e17260df-d4c2-4832-b692-ba0ea93f2861 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:40.951383 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e17260df-d4c2-4832-b692-ba0ea93f2861 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:40.951812 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e17260df-d4c2-4832-b692-ba0ea93f2861 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:41.272287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4741d2b4-fb61-4f00-b202-e51c572f9cc9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28340 microversion: 2.1 time: 0.366214 Nov 02 23:09:41.273181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 261/512] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:40 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28340 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:09:41.292841 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e17260df-d4c2-4832-b692-ba0ea93f2861 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28174 microversion: 2.20 time: 0.353611 Nov 02 23:09:41.293533 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 252/513] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:40 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28174 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:09:41.319806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3eded38f-df72-4672-a475-e10f661e8eff tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:41.320517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3eded38f-df72-4672-a475-e10f661e8eff tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:41.327473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3eded38f-df72-4672-a475-e10f661e8eff tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:41.327916 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3eded38f-df72-4672-a475-e10f661e8eff tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:41.328680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3eded38f-df72-4672-a475-e10f661e8eff tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:41.329135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3eded38f-df72-4672-a475-e10f661e8eff tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:41.442087 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-629af86c-e875-4faa-a10c-9e24c65b35a3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:41.443008 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-629af86c-e875-4faa-a10c-9e24c65b35a3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:41.449691 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-629af86c-e875-4faa-a10c-9e24c65b35a3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:41.450129 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-629af86c-e875-4faa-a10c-9e24c65b35a3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:41.450941 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-629af86c-e875-4faa-a10c-9e24c65b35a3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:41.451372 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-629af86c-e875-4faa-a10c-9e24c65b35a3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:41.459996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3eded38f-df72-4672-a475-e10f661e8eff tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:41.467554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3eded38f-df72-4672-a475-e10f661e8eff tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1504 microversion: 2.1 time: 0.151836 Nov 02 23:09:41.468114 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 262/514] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:41 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:41.585267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-03a1dee3-8229-431c-8ef3-32dcf648b8b8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:41.586015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-03a1dee3-8229-431c-8ef3-32dcf648b8b8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:41.586441 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-629af86c-e875-4faa-a10c-9e24c65b35a3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:41.592507 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03a1dee3-8229-431c-8ef3-32dcf648b8b8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:41.592951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03a1dee3-8229-431c-8ef3-32dcf648b8b8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:41.593549 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-629af86c-e875-4faa-a10c-9e24c65b35a3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1318 microversion: 2.1 time: 0.155854 Nov 02 23:09:41.593722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03a1dee3-8229-431c-8ef3-32dcf648b8b8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:41.594112 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 253/515] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:41 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:41.594221 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03a1dee3-8229-431c-8ef3-32dcf648b8b8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:41.728289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-03a1dee3-8229-431c-8ef3-32dcf648b8b8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:41.735719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-03a1dee3-8229-431c-8ef3-32dcf648b8b8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.154551 Nov 02 23:09:41.736299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 263/516] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:41 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:42.283553 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-5195808b-674e-429f-81c6-dc6d181e6820 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:42.284465 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-5195808b-674e-429f-81c6-dc6d181e6820 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:42.290625 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5195808b-674e-429f-81c6-dc6d181e6820 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:42.291110 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5195808b-674e-429f-81c6-dc6d181e6820 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:42.291902 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5195808b-674e-429f-81c6-dc6d181e6820 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:42.292326 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5195808b-674e-429f-81c6-dc6d181e6820 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:42.304936 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b910dde5-4772-48f6-8c07-333d4575a88a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:42.305901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b910dde5-4772-48f6-8c07-333d4575a88a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:42.312407 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b910dde5-4772-48f6-8c07-333d4575a88a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:42.312787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b910dde5-4772-48f6-8c07-333d4575a88a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:42.313567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b910dde5-4772-48f6-8c07-333d4575a88a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:42.313994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b910dde5-4772-48f6-8c07-333d4575a88a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:42.538752 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-5195808b-674e-429f-81c6-dc6d181e6820 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28453 microversion: 2.1 time: 0.258943 Nov 02 23:09:42.539896 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 254/517] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:42 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28453 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:09:42.545503 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-56969223-f1ab-4a08-8fef-db317aed6412 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:42.547569 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-56969223-f1ab-4a08-8fef-db317aed6412 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:42.553319 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-56969223-f1ab-4a08-8fef-db317aed6412 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:42.553767 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-56969223-f1ab-4a08-8fef-db317aed6412 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:42.554538 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-56969223-f1ab-4a08-8fef-db317aed6412 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:42.554995 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-56969223-f1ab-4a08-8fef-db317aed6412 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:42.590796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b910dde5-4772-48f6-8c07-333d4575a88a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28462 microversion: 2.20 time: 0.289371 Nov 02 23:09:42.591498 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 264/518] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:42 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28462 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:09:42.609928 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5ac5004b-ee07-43f5-8d34-a3d933b9d2b7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:42.610612 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5ac5004b-ee07-43f5-8d34-a3d933b9d2b7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:42.620280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ac5004b-ee07-43f5-8d34-a3d933b9d2b7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:42.620770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ac5004b-ee07-43f5-8d34-a3d933b9d2b7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:42.621736 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ac5004b-ee07-43f5-8d34-a3d933b9d2b7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:42.622170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ac5004b-ee07-43f5-8d34-a3d933b9d2b7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:42.692511 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-56969223-f1ab-4a08-8fef-db317aed6412 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:42.699913 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-56969223-f1ab-4a08-8fef-db317aed6412 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1504 microversion: 2.1 time: 0.158384 Nov 02 23:09:42.700406 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 255/519] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:42 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:42.752349 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-0e3c84ca-72bc-46a2-ab27-1038eda5f36e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:42.753014 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-0e3c84ca-72bc-46a2-ab27-1038eda5f36e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:42.756611 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5ac5004b-ee07-43f5-8d34-a3d933b9d2b7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:42.759414 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0e3c84ca-72bc-46a2-ab27-1038eda5f36e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:42.759861 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0e3c84ca-72bc-46a2-ab27-1038eda5f36e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:42.760665 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0e3c84ca-72bc-46a2-ab27-1038eda5f36e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:42.761107 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0e3c84ca-72bc-46a2-ab27-1038eda5f36e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:42.764753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5ac5004b-ee07-43f5-8d34-a3d933b9d2b7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1318 microversion: 2.1 time: 0.158945 Nov 02 23:09:42.765321 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 265/520] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:42 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:42.914350 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-0e3c84ca-72bc-46a2-ab27-1038eda5f36e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:42.925813 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-0e3c84ca-72bc-46a2-ab27-1038eda5f36e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.176857 Nov 02 23:09:42.926891 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 256/521] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:42 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:43.550811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8f3663c5-9c9f-47df-8077-ed9f43cdc62d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:43.551752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8f3663c5-9c9f-47df-8077-ed9f43cdc62d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:43.559129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8f3663c5-9c9f-47df-8077-ed9f43cdc62d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:43.559575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8f3663c5-9c9f-47df-8077-ed9f43cdc62d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:43.560345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8f3663c5-9c9f-47df-8077-ed9f43cdc62d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:43.561084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8f3663c5-9c9f-47df-8077-ed9f43cdc62d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:43.603448 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-599836bb-9048-429a-82b1-b19f78c96b18 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:43.605354 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-599836bb-9048-429a-82b1-b19f78c96b18 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:43.616549 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-599836bb-9048-429a-82b1-b19f78c96b18 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:43.617035 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-599836bb-9048-429a-82b1-b19f78c96b18 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:43.617857 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-599836bb-9048-429a-82b1-b19f78c96b18 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:43.618410 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-599836bb-9048-429a-82b1-b19f78c96b18 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:43.770109 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8f3663c5-9c9f-47df-8077-ed9f43cdc62d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28453 microversion: 2.1 time: 0.222895 Nov 02 23:09:43.770797 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 266/522] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:43 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28453 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:09:43.780047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-86670beb-2817-436b-a322-564e02092adb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4acbca45-2fdd-4f9b-82bf-54b9f1ab189f", "device": "/dev/sdb"}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:43.782341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-86670beb-2817-436b-a322-564e02092adb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:43.792924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86670beb-2817-436b-a322-564e02092adb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:43.793546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86670beb-2817-436b-a322-564e02092adb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:43.797733 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-599836bb-9048-429a-82b1-b19f78c96b18 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28462 microversion: 2.20 time: 0.197697 Nov 02 23:09:43.798969 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 257/523] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:43 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28462 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:09:43.804263 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-6ca6c6c8-d802-4eba-9476-1bb0ae0bccf0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:43.806463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86670beb-2817-436b-a322-564e02092adb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:43.806945 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86670beb-2817-436b-a322-564e02092adb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:43.810752 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-6ca6c6c8-d802-4eba-9476-1bb0ae0bccf0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:43.832832 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6ca6c6c8-d802-4eba-9476-1bb0ae0bccf0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:43.833276 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6ca6c6c8-d802-4eba-9476-1bb0ae0bccf0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:43.834061 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6ca6c6c8-d802-4eba-9476-1bb0ae0bccf0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:43.834488 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6ca6c6c8-d802-4eba-9476-1bb0ae0bccf0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:43.914065 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6ca6c6c8-d802-4eba-9476-1bb0ae0bccf0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ea0ff3573488eac0a388cd3c97353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597c421223e44586815fe2608b4f1f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:43.921889 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-6ca6c6c8-d802-4eba-9476-1bb0ae0bccf0 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 200 len: 1462 microversion: 2.1 time: 0.121491 Nov 02 23:09:43.922475 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 258/524] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:43 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 1462 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:43.927046 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-c9f66ecf-3a1c-41c2-b0e9-f857fcf7360d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:43.927846 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-c9f66ecf-3a1c-41c2-b0e9-f857fcf7360d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:43.933804 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c9f66ecf-3a1c-41c2-b0e9-f857fcf7360d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:43.934265 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c9f66ecf-3a1c-41c2-b0e9-f857fcf7360d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:43.935072 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c9f66ecf-3a1c-41c2-b0e9-f857fcf7360d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:43.935508 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c9f66ecf-3a1c-41c2-b0e9-f857fcf7360d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:44.084413 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-c9f66ecf-3a1c-41c2-b0e9-f857fcf7360d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:44.099426 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-c9f66ecf-3a1c-41c2-b0e9-f857fcf7360d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1318 microversion: 2.1 time: 0.175598 Nov 02 23:09:44.100928 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 259/525] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:43 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:44.104693 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [req-c5e90339-95b1-40fc-bef6-b87f953f7491 req-50fcfca1-925d-4454-8655-0c7a56ec3093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796da481-6150-4e95-86f5-1e0732bce021", "name": "network-vif-deleted", "tag": "abf458ed-eb32-434b-b82d-37b87b8d8d25"}]} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:44.106376 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:09:44.106376 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: warnings.warn(msg) Nov 02 23:09:44.114907 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-c5e90339-95b1-40fc-bef6-b87f953f7491 req-50fcfca1-925d-4454-8655-0c7a56ec3093 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:44.115376 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-c5e90339-95b1-40fc-bef6-b87f953f7491 req-50fcfca1-925d-4454-8655-0c7a56ec3093 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:44.126431 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.compute.server_external_events [req-c5e90339-95b1-40fc-bef6-b87f953f7491 req-50fcfca1-925d-4454-8655-0c7a56ec3093 service nova] Creating event network-vif-deleted:abf458ed-eb32-434b-b82d-37b87b8d8d25 for instance 796da481-6150-4e95-86f5-1e0732bce021 on hv-cinder-81584 Nov 02 23:09:44.131543 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [req-c5e90339-95b1-40fc-bef6-b87f953f7491 req-50fcfca1-925d-4454-8655-0c7a56ec3093 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030035 Nov 02 23:09:44.132190 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 260/526] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:09:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:09:44.137206 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-8e1e7e3d-84d9-4c8f-9d4c-504f6ff4d83b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:44.137966 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-8e1e7e3d-84d9-4c8f-9d4c-504f6ff4d83b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:44.144939 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8e1e7e3d-84d9-4c8f-9d4c-504f6ff4d83b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:44.145385 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8e1e7e3d-84d9-4c8f-9d4c-504f6ff4d83b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:44.146152 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8e1e7e3d-84d9-4c8f-9d4c-504f6ff4d83b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:44.146580 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8e1e7e3d-84d9-4c8f-9d4c-504f6ff4d83b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:44.188327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-86670beb-2817-436b-a322-564e02092adb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "POST /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.415901 Nov 02 23:09:44.193636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 267/527] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 2 23:09:43 2021] POST /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9/os-volume_attachments => generated 194 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:09:44.308227 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-8e1e7e3d-84d9-4c8f-9d4c-504f6ff4d83b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:44.318706 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-8e1e7e3d-84d9-4c8f-9d4c-504f6ff4d83b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.185329 Nov 02 23:09:44.319630 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 261/528] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:44 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:44.785156 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-50c0f0ca-bc7f-489f-b064-2f934fc16b65 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:44.786076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-50c0f0ca-bc7f-489f-b064-2f934fc16b65 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:44.794756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50c0f0ca-bc7f-489f-b064-2f934fc16b65 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:44.795228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50c0f0ca-bc7f-489f-b064-2f934fc16b65 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:44.796029 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50c0f0ca-bc7f-489f-b064-2f934fc16b65 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:44.796467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50c0f0ca-bc7f-489f-b064-2f934fc16b65 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:44.812618 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-be10403e-55a0-42cf-9613-d48e636a7e57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:44.815255 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-be10403e-55a0-42cf-9613-d48e636a7e57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:44.831167 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-be10403e-55a0-42cf-9613-d48e636a7e57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:44.832569 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-be10403e-55a0-42cf-9613-d48e636a7e57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:44.833438 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-be10403e-55a0-42cf-9613-d48e636a7e57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:44.833871 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-be10403e-55a0-42cf-9613-d48e636a7e57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:45.055257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-50c0f0ca-bc7f-489f-b064-2f934fc16b65 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.276498 Nov 02 23:09:45.059686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 268/529] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:44 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:09:45.061593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-171b3640-d441-4f49-b057-8e8b9bda9969 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:45.062442 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-171b3640-d441-4f49-b057-8e8b9bda9969 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] [instance: 796da481-6150-4e95-86f5-1e0732bce021] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:45.069752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-171b3640-d441-4f49-b057-8e8b9bda9969 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:45.070188 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-171b3640-d441-4f49-b057-8e8b9bda9969 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:45.070973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-171b3640-d441-4f49-b057-8e8b9bda9969 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:45.071402 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-171b3640-d441-4f49-b057-8e8b9bda9969 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:45.085028 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-171b3640-d441-4f49-b057-8e8b9bda9969 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] HTTP exception thrown: Instance 796da481-6150-4e95-86f5-1e0732bce021 could not be found. Nov 02 23:09:45.085642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-171b3640-d441-4f49-b057-8e8b9bda9969 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] Returning 404 to user: Instance 796da481-6150-4e95-86f5-1e0732bce021 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:09:45.086452 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-171b3640-d441-4f49-b057-8e8b9bda9969 tempest-VolumesActionsTest-1300668607 tempest-VolumesActionsTest-1300668607-project] 10.222.0.41 "GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021" status: 404 len: 111 microversion: 2.1 time: 0.029236 Nov 02 23:09:45.087011 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 269/530] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:45 2021] GET /compute/v2.1/servers/796da481-6150-4e95-86f5-1e0732bce021 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 23:09:45.100126 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-be10403e-55a0-42cf-9613-d48e636a7e57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28462 microversion: 2.20 time: 0.292590 Nov 02 23:09:45.100126 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 262/531] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:44 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28462 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:09:45.121076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-77a4ee99-5dcd-457f-9c7c-a8bd72affb44 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:45.121748 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-77a4ee99-5dcd-457f-9c7c-a8bd72affb44 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:45.130125 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-77a4ee99-5dcd-457f-9c7c-a8bd72affb44 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:45.130603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-77a4ee99-5dcd-457f-9c7c-a8bd72affb44 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:45.131473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-77a4ee99-5dcd-457f-9c7c-a8bd72affb44 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:45.131905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-77a4ee99-5dcd-457f-9c7c-a8bd72affb44 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:45.291500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-77a4ee99-5dcd-457f-9c7c-a8bd72affb44 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:45.312996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-77a4ee99-5dcd-457f-9c7c-a8bd72affb44 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1318 microversion: 2.1 time: 0.198771 Nov 02 23:09:45.313573 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 270/532] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:45 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:45.336893 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-99bf1245-70ed-4200-8d15-e8aa909eee26 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:45.337593 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-99bf1245-70ed-4200-8d15-e8aa909eee26 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:45.344789 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-99bf1245-70ed-4200-8d15-e8aa909eee26 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:45.345237 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-99bf1245-70ed-4200-8d15-e8aa909eee26 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:45.346114 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-99bf1245-70ed-4200-8d15-e8aa909eee26 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:45.346543 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-99bf1245-70ed-4200-8d15-e8aa909eee26 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:45.515474 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-99bf1245-70ed-4200-8d15-e8aa909eee26 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:45.529215 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-99bf1245-70ed-4200-8d15-e8aa909eee26 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.196457 Nov 02 23:09:45.529953 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 263/533] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:45 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:46.068132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1e6379a5-9b7e-4742-8624-3338b750ffba tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:46.069073 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1e6379a5-9b7e-4742-8624-3338b750ffba tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:46.075728 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e6379a5-9b7e-4742-8624-3338b750ffba tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:46.076113 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e6379a5-9b7e-4742-8624-3338b750ffba tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:46.076864 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e6379a5-9b7e-4742-8624-3338b750ffba tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:46.077297 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e6379a5-9b7e-4742-8624-3338b750ffba tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:46.111319 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e239383c-f854-479a-a8ef-69e6670e6c5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:46.113387 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e239383c-f854-479a-a8ef-69e6670e6c5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:46.122861 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e239383c-f854-479a-a8ef-69e6670e6c5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:46.122861 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e239383c-f854-479a-a8ef-69e6670e6c5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:46.122861 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e239383c-f854-479a-a8ef-69e6670e6c5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:46.122861 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e239383c-f854-479a-a8ef-69e6670e6c5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:46.261052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1e6379a5-9b7e-4742-8624-3338b750ffba tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.196631 Nov 02 23:09:46.264997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 271/534] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:46 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:09:46.328738 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e239383c-f854-479a-a8ef-69e6670e6c5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.221461 Nov 02 23:09:46.333840 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 264/535] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:46 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:09:46.334015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3dbfe921-0e14-4d30-abe3-87ec71f1b832 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:46.334015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3dbfe921-0e14-4d30-abe3-87ec71f1b832 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:46.340322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dbfe921-0e14-4d30-abe3-87ec71f1b832 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:46.340956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dbfe921-0e14-4d30-abe3-87ec71f1b832 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:46.341729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dbfe921-0e14-4d30-abe3-87ec71f1b832 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:46.342155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dbfe921-0e14-4d30-abe3-87ec71f1b832 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:46.493202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3dbfe921-0e14-4d30-abe3-87ec71f1b832 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:46.501256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3dbfe921-0e14-4d30-abe3-87ec71f1b832 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1318 microversion: 2.1 time: 0.174094 Nov 02 23:09:46.501850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 272/536] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:46 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:46.546190 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f2999850-c234-4dce-84fc-df843eb98aa5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:46.546892 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f2999850-c234-4dce-84fc-df843eb98aa5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:46.554166 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f2999850-c234-4dce-84fc-df843eb98aa5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:46.554617 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f2999850-c234-4dce-84fc-df843eb98aa5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:46.555463 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f2999850-c234-4dce-84fc-df843eb98aa5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:46.555898 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f2999850-c234-4dce-84fc-df843eb98aa5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:46.700313 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-f2999850-c234-4dce-84fc-df843eb98aa5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:46.708465 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f2999850-c234-4dce-84fc-df843eb98aa5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.166486 Nov 02 23:09:46.709039 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 265/537] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:46 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:47.272287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-19fb9442-a588-4b4a-8abd-03fe55dbf893 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:47.273195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-19fb9442-a588-4b4a-8abd-03fe55dbf893 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:47.279525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19fb9442-a588-4b4a-8abd-03fe55dbf893 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:47.279971 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19fb9442-a588-4b4a-8abd-03fe55dbf893 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:47.280737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19fb9442-a588-4b4a-8abd-03fe55dbf893 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:47.281164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19fb9442-a588-4b4a-8abd-03fe55dbf893 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:47.342014 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d07f9796-a335-4caf-88cb-7f957523e138 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:47.343031 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d07f9796-a335-4caf-88cb-7f957523e138 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:47.349383 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d07f9796-a335-4caf-88cb-7f957523e138 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:47.349843 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d07f9796-a335-4caf-88cb-7f957523e138 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:47.350620 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d07f9796-a335-4caf-88cb-7f957523e138 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:47.351097 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d07f9796-a335-4caf-88cb-7f957523e138 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:47.463663 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-19fb9442-a588-4b4a-8abd-03fe55dbf893 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.194705 Nov 02 23:09:47.464242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 273/538] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:47 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:09:47.518744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5130baeb-0240-4605-9067-28a864c36418 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:47.519644 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5130baeb-0240-4605-9067-28a864c36418 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:47.526293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5130baeb-0240-4605-9067-28a864c36418 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:47.526762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5130baeb-0240-4605-9067-28a864c36418 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:47.527588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5130baeb-0240-4605-9067-28a864c36418 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:47.528018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5130baeb-0240-4605-9067-28a864c36418 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:47.663270 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5130baeb-0240-4605-9067-28a864c36418 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:47.670603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5130baeb-0240-4605-9067-28a864c36418 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1318 microversion: 2.1 time: 0.155951 Nov 02 23:09:47.671200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 274/539] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:47 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:47.725503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fb841c53-60b7-4552-bfc0-738accd87716 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:47.726112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fb841c53-60b7-4552-bfc0-738accd87716 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:47.732093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fb841c53-60b7-4552-bfc0-738accd87716 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:47.732538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fb841c53-60b7-4552-bfc0-738accd87716 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:47.733311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fb841c53-60b7-4552-bfc0-738accd87716 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:47.733744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fb841c53-60b7-4552-bfc0-738accd87716 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:47.864880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fb841c53-60b7-4552-bfc0-738accd87716 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:47.872051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fb841c53-60b7-4552-bfc0-738accd87716 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.150673 Nov 02 23:09:47.872605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 275/540] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:47 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:48.474985 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5ed1e92a-5c57-410c-91e2-ca2d20cf1849 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:48.475985 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5ed1e92a-5c57-410c-91e2-ca2d20cf1849 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:48.482134 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ed1e92a-5c57-410c-91e2-ca2d20cf1849 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:48.482574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ed1e92a-5c57-410c-91e2-ca2d20cf1849 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:48.483366 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ed1e92a-5c57-410c-91e2-ca2d20cf1849 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:48.483798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ed1e92a-5c57-410c-91e2-ca2d20cf1849 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:53.640144 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d07f9796-a335-4caf-88cb-7f957523e138 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 6.301778 Nov 02 23:09:53.641052 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 266/541] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:47 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 6304 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:09:53.645964 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f3a6ea79-04ba-458c-8393-eebbdb936ec3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:53.646656 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f3a6ea79-04ba-458c-8393-eebbdb936ec3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:53.654087 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f3a6ea79-04ba-458c-8393-eebbdb936ec3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:53.654526 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f3a6ea79-04ba-458c-8393-eebbdb936ec3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:53.655317 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f3a6ea79-04ba-458c-8393-eebbdb936ec3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:53.655748 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f3a6ea79-04ba-458c-8393-eebbdb936ec3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:53.787803 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-f3a6ea79-04ba-458c-8393-eebbdb936ec3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:53.794895 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f3a6ea79-04ba-458c-8393-eebbdb936ec3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1318 microversion: 2.1 time: 0.152755 Nov 02 23:09:53.795483 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 267/542] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:53 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:53.800280 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-9b784872-9b29-4a7f-b06f-450805b522d3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:53.800950 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-9b784872-9b29-4a7f-b06f-450805b522d3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:53.804997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5ed1e92a-5c57-410c-91e2-ca2d20cf1849 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 5.333382 Nov 02 23:09:53.806086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 276/543] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:48 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 5335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:09:53.807092 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9b784872-9b29-4a7f-b06f-450805b522d3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:53.807540 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9b784872-9b29-4a7f-b06f-450805b522d3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:53.808323 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9b784872-9b29-4a7f-b06f-450805b522d3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:53.808751 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9b784872-9b29-4a7f-b06f-450805b522d3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:53.945139 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-9b784872-9b29-4a7f-b06f-450805b522d3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:53.952379 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-9b784872-9b29-4a7f-b06f-450805b522d3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.155977 Nov 02 23:09:53.952954 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 268/544] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:53 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:54.652432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ce60aaac-8018-4172-a24f-c549394ce575 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:54.653421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ce60aaac-8018-4172-a24f-c549394ce575 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:54.660224 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce60aaac-8018-4172-a24f-c549394ce575 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:54.660773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce60aaac-8018-4172-a24f-c549394ce575 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:54.661552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce60aaac-8018-4172-a24f-c549394ce575 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:54.661981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce60aaac-8018-4172-a24f-c549394ce575 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:54.813006 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-92ffcd0b-470a-4f27-ac77-efd1a45f13f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:54.813647 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-92ffcd0b-470a-4f27-ac77-efd1a45f13f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:54.820525 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-92ffcd0b-470a-4f27-ac77-efd1a45f13f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:54.820970 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-92ffcd0b-470a-4f27-ac77-efd1a45f13f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:54.821743 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-92ffcd0b-470a-4f27-ac77-efd1a45f13f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:54.822174 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-92ffcd0b-470a-4f27-ac77-efd1a45f13f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:54.950629 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-92ffcd0b-470a-4f27-ac77-efd1a45f13f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:54.958055 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-92ffcd0b-470a-4f27-ac77-efd1a45f13f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1318 microversion: 2.1 time: 0.149157 Nov 02 23:09:54.958616 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 269/545] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:54 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:54.962884 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b67edfc4-ca9d-44e1-9b4d-30bfcf48d715 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:54.963817 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b67edfc4-ca9d-44e1-9b4d-30bfcf48d715 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:54.969553 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b67edfc4-ca9d-44e1-9b4d-30bfcf48d715 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:54.969993 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b67edfc4-ca9d-44e1-9b4d-30bfcf48d715 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:54.970750 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b67edfc4-ca9d-44e1-9b4d-30bfcf48d715 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:54.971211 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b67edfc4-ca9d-44e1-9b4d-30bfcf48d715 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:55.386741 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ce60aaac-8018-4172-a24f-c549394ce575 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.738118 Nov 02 23:09:55.390588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 277/546] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:54 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:09:55.392846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-30cfcd2f-2260-4330-99d8-077b76204bd7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:55.393545 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-30cfcd2f-2260-4330-99d8-077b76204bd7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:55.401144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30cfcd2f-2260-4330-99d8-077b76204bd7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:55.401598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30cfcd2f-2260-4330-99d8-077b76204bd7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:55.402384 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30cfcd2f-2260-4330-99d8-077b76204bd7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:55.402857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30cfcd2f-2260-4330-99d8-077b76204bd7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:55.431440 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b67edfc4-ca9d-44e1-9b4d-30bfcf48d715 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.471508 Nov 02 23:09:55.432673 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 270/547] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:54 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:09:55.535512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-30cfcd2f-2260-4330-99d8-077b76204bd7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:55.543539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-30cfcd2f-2260-4330-99d8-077b76204bd7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.154500 Nov 02 23:09:55.544097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 278/548] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:55 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:55.777022 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [req-52a38fd6-4b32-437d-bbb7-3d510d3f2031 req-92244a6a-2f6a-4162-a394-b41a3b9dc44d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07", "name": "network-vif-plugged", "status": "completed", "tag": "a4dd4b8a-c493-4af8-b49d-f031913d57ab"}]} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:55.778566 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:09:55.778566 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: warnings.warn(msg) Nov 02 23:09:55.787693 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-52a38fd6-4b32-437d-bbb7-3d510d3f2031 req-92244a6a-2f6a-4162-a394-b41a3b9dc44d service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:55.788230 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-52a38fd6-4b32-437d-bbb7-3d510d3f2031 req-92244a6a-2f6a-4162-a394-b41a3b9dc44d service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:55.800612 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.compute.server_external_events [req-52a38fd6-4b32-437d-bbb7-3d510d3f2031 req-92244a6a-2f6a-4162-a394-b41a3b9dc44d service nova] Creating event network-vif-plugged:a4dd4b8a-c493-4af8-b49d-f031913d57ab for instance fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 on hv-cinder-81584 Nov 02 23:09:55.806462 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [req-52a38fd6-4b32-437d-bbb7-3d510d3f2031 req-92244a6a-2f6a-4162-a394-b41a3b9dc44d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033366 Nov 02 23:09:55.807241 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 271/549] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:09:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:09:55.975500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4c09c94a-ca68-4c1c-adfa-89954f6baf9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:55.976140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4c09c94a-ca68-4c1c-adfa-89954f6baf9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:55.982479 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4c09c94a-ca68-4c1c-adfa-89954f6baf9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:55.982941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4c09c94a-ca68-4c1c-adfa-89954f6baf9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:55.983754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4c09c94a-ca68-4c1c-adfa-89954f6baf9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:55.984188 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4c09c94a-ca68-4c1c-adfa-89954f6baf9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:56.114694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4c09c94a-ca68-4c1c-adfa-89954f6baf9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:56.121856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4c09c94a-ca68-4c1c-adfa-89954f6baf9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1318 microversion: 2.1 time: 0.150598 Nov 02 23:09:56.122423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 279/550] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:55 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:56.398883 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-411369e2-6159-485a-ab2c-052f84e06ed8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:56.399942 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-411369e2-6159-485a-ab2c-052f84e06ed8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:56.405841 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-411369e2-6159-485a-ab2c-052f84e06ed8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:56.406294 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-411369e2-6159-485a-ab2c-052f84e06ed8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:56.407101 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-411369e2-6159-485a-ab2c-052f84e06ed8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:56.407537 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-411369e2-6159-485a-ab2c-052f84e06ed8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:56.443227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-957ef876-f602-4a08-a07b-eaee20693d66 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:56.444140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-957ef876-f602-4a08-a07b-eaee20693d66 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:56.450241 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-957ef876-f602-4a08-a07b-eaee20693d66 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:56.450690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-957ef876-f602-4a08-a07b-eaee20693d66 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:56.451499 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-957ef876-f602-4a08-a07b-eaee20693d66 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:56.451933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-957ef876-f602-4a08-a07b-eaee20693d66 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:57.214800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-957ef876-f602-4a08-a07b-eaee20693d66 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.769334 Nov 02 23:09:57.219149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 280/551] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:56 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:09:57.225872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0d30887f-06c0-4c5e-8aff-159cc0b6ed86 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:57.226755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0d30887f-06c0-4c5e-8aff-159cc0b6ed86 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:57.235499 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d30887f-06c0-4c5e-8aff-159cc0b6ed86 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:57.236434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d30887f-06c0-4c5e-8aff-159cc0b6ed86 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:57.237739 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d30887f-06c0-4c5e-8aff-159cc0b6ed86 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:57.239413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d30887f-06c0-4c5e-8aff-159cc0b6ed86 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:57.396589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0d30887f-06c0-4c5e-8aff-159cc0b6ed86 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:57.408766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0d30887f-06c0-4c5e-8aff-159cc0b6ed86 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.187735 Nov 02 23:09:57.409618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 281/552] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:57 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:57.414204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7562ddac-d94b-471a-bcff-61aee0219a30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:57.414805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7562ddac-d94b-471a-bcff-61aee0219a30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:57.421704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7562ddac-d94b-471a-bcff-61aee0219a30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:57.421704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7562ddac-d94b-471a-bcff-61aee0219a30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:57.422108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7562ddac-d94b-471a-bcff-61aee0219a30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:57.422541 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7562ddac-d94b-471a-bcff-61aee0219a30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:57.438829 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-411369e2-6159-485a-ab2c-052f84e06ed8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 1.043782 Nov 02 23:09:57.442743 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 272/553] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:56 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:09:57.589290 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7562ddac-d94b-471a-bcff-61aee0219a30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:57.596900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7562ddac-d94b-471a-bcff-61aee0219a30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1318 microversion: 2.1 time: 0.186108 Nov 02 23:09:57.597526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 282/554] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:57 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:09:58.236161 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-22867f9f-b6c4-4361-a099-4d925b6a5830 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:58.237885 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-22867f9f-b6c4-4361-a099-4d925b6a5830 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:58.257199 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-22867f9f-b6c4-4361-a099-4d925b6a5830 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:58.259708 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-22867f9f-b6c4-4361-a099-4d925b6a5830 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:58.261523 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-22867f9f-b6c4-4361-a099-4d925b6a5830 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:58.262055 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-22867f9f-b6c4-4361-a099-4d925b6a5830 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:58.425483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0b7689a3-52ea-476a-88d1-889621528422 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:58.426079 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0b7689a3-52ea-476a-88d1-889621528422 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:58.432463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b7689a3-52ea-476a-88d1-889621528422 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:58.432908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b7689a3-52ea-476a-88d1-889621528422 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:58.433668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b7689a3-52ea-476a-88d1-889621528422 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:58.434099 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b7689a3-52ea-476a-88d1-889621528422 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:58.547074 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-22867f9f-b6c4-4361-a099-4d925b6a5830 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.320069 Nov 02 23:09:58.551321 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 273/555] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:58 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:09:58.556626 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-c10e03e4-bef5-43c9-a33f-4316b169c64e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:58.557738 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-c10e03e4-bef5-43c9-a33f-4316b169c64e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:58.565173 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c10e03e4-bef5-43c9-a33f-4316b169c64e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:58.565870 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c10e03e4-bef5-43c9-a33f-4316b169c64e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:58.566640 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c10e03e4-bef5-43c9-a33f-4316b169c64e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:58.567087 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c10e03e4-bef5-43c9-a33f-4316b169c64e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:58.590369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0b7689a3-52ea-476a-88d1-889621528422 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:58.598480 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0b7689a3-52ea-476a-88d1-889621528422 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.176585 Nov 02 23:09:58.599584 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 283/556] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:58 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:58.613614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-04d419a9-a4cf-4496-ac31-dfbc1456e859 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:58.614310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-04d419a9-a4cf-4496-ac31-dfbc1456e859 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:58.620485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-04d419a9-a4cf-4496-ac31-dfbc1456e859 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:58.621095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-04d419a9-a4cf-4496-ac31-dfbc1456e859 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:58.621916 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-04d419a9-a4cf-4496-ac31-dfbc1456e859 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:58.622448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-04d419a9-a4cf-4496-ac31-dfbc1456e859 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:58.771497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-04d419a9-a4cf-4496-ac31-dfbc1456e859 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:58.772147 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-c10e03e4-bef5-43c9-a33f-4316b169c64e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.219288 Nov 02 23:09:58.772806 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 274/557] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:58 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:09:58.780294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-04d419a9-a4cf-4496-ac31-dfbc1456e859 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1318 microversion: 2.1 time: 0.170189 Nov 02 23:09:58.780821 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 284/558] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:58 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:59.559604 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-028251da-61f1-47e9-8456-ad565c1862ac tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:59.561316 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-028251da-61f1-47e9-8456-ad565c1862ac tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:59.568179 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-028251da-61f1-47e9-8456-ad565c1862ac tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:59.568852 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-028251da-61f1-47e9-8456-ad565c1862ac tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:59.569622 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-028251da-61f1-47e9-8456-ad565c1862ac tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:59.570200 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-028251da-61f1-47e9-8456-ad565c1862ac tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:59.615937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8b23d551-fc0d-4736-ba5d-916f538aab2b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:09:59.616533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8b23d551-fc0d-4736-ba5d-916f538aab2b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:59.622723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8b23d551-fc0d-4736-ba5d-916f538aab2b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:59.623200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8b23d551-fc0d-4736-ba5d-916f538aab2b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:59.623976 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8b23d551-fc0d-4736-ba5d-916f538aab2b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:59.624402 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8b23d551-fc0d-4736-ba5d-916f538aab2b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:59.760484 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8b23d551-fc0d-4736-ba5d-916f538aab2b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:09:59.769410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8b23d551-fc0d-4736-ba5d-916f538aab2b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.157494 Nov 02 23:09:59.770229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 285/559] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:09:59 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:09:59.785023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2e7cf0e5-f743-44b9-8f52-7135406bcb2b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:09:59.786187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2e7cf0e5-f743-44b9-8f52-7135406bcb2b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:09:59.793918 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2e7cf0e5-f743-44b9-8f52-7135406bcb2b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:59.794444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2e7cf0e5-f743-44b9-8f52-7135406bcb2b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:09:59.795378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2e7cf0e5-f743-44b9-8f52-7135406bcb2b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:09:59.796407 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2e7cf0e5-f743-44b9-8f52-7135406bcb2b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:06.254422 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-028251da-61f1-47e9-8456-ad565c1862ac tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 6.698778 Nov 02 23:10:06.255190 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 275/560] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:09:59 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 6701 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:10:06.260352 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-90e69ed5-0343-405a-beda-064d33b7326e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:06.261077 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-90e69ed5-0343-405a-beda-064d33b7326e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:06.268377 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-90e69ed5-0343-405a-beda-064d33b7326e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:06.268828 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-90e69ed5-0343-405a-beda-064d33b7326e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:06.269629 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-90e69ed5-0343-405a-beda-064d33b7326e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:06.270070 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-90e69ed5-0343-405a-beda-064d33b7326e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:06.285414 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2e7cf0e5-f743-44b9-8f52-7135406bcb2b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 6.505990 Nov 02 23:10:06.287159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 286/561] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:09:59 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 6508 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:10:06.293426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d412f2e2-de1e-4909-8598-ab85713de57c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:06.294118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d412f2e2-de1e-4909-8598-ab85713de57c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:06.303466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d412f2e2-de1e-4909-8598-ab85713de57c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:06.304194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d412f2e2-de1e-4909-8598-ab85713de57c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:06.305180 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d412f2e2-de1e-4909-8598-ab85713de57c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:06.305776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d412f2e2-de1e-4909-8598-ab85713de57c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:06.427569 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-90e69ed5-0343-405a-beda-064d33b7326e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:06.436075 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-90e69ed5-0343-405a-beda-064d33b7326e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1318 microversion: 2.1 time: 0.179472 Nov 02 23:10:06.437135 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 276/562] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:06 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:06.464541 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d412f2e2-de1e-4909-8598-ab85713de57c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:06.475128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d412f2e2-de1e-4909-8598-ab85713de57c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.185512 Nov 02 23:10:06.475879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 287/563] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:06 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:07.265424 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a4f6847c-9c3e-4b6e-8a3e-0f0533715627 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:07.266335 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a4f6847c-9c3e-4b6e-8a3e-0f0533715627 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:07.273259 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a4f6847c-9c3e-4b6e-8a3e-0f0533715627 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:07.273700 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a4f6847c-9c3e-4b6e-8a3e-0f0533715627 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:07.274456 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a4f6847c-9c3e-4b6e-8a3e-0f0533715627 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:07.274880 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a4f6847c-9c3e-4b6e-8a3e-0f0533715627 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:07.298723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-485b7b63-7eb8-4643-8405-b11c04249d2b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:07.300694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-485b7b63-7eb8-4643-8405-b11c04249d2b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:07.308272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-485b7b63-7eb8-4643-8405-b11c04249d2b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:07.309038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-485b7b63-7eb8-4643-8405-b11c04249d2b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:07.310074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-485b7b63-7eb8-4643-8405-b11c04249d2b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:07.310508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-485b7b63-7eb8-4643-8405-b11c04249d2b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:07.466009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-485b7b63-7eb8-4643-8405-b11c04249d2b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.171686 Nov 02 23:10:07.466788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 288/564] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:07 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:10:07.471551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-06262f30-3920-4c4a-a438-38b7f994bf81 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:07.472238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-06262f30-3920-4c4a-a438-38b7f994bf81 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:07.480371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06262f30-3920-4c4a-a438-38b7f994bf81 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:07.480833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06262f30-3920-4c4a-a438-38b7f994bf81 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:07.481653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06262f30-3920-4c4a-a438-38b7f994bf81 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:07.482111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06262f30-3920-4c4a-a438-38b7f994bf81 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:07.498521 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a4f6847c-9c3e-4b6e-8a3e-0f0533715627 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.236066 Nov 02 23:10:07.505363 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 277/565] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:07 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:10:07.511764 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-fe3b7663-9325-49b6-a8ad-01ebb8b550ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:07.511764 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-fe3b7663-9325-49b6-a8ad-01ebb8b550ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:07.537418 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fe3b7663-9325-49b6-a8ad-01ebb8b550ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:07.542235 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fe3b7663-9325-49b6-a8ad-01ebb8b550ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:07.543990 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fe3b7663-9325-49b6-a8ad-01ebb8b550ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:07.544787 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fe3b7663-9325-49b6-a8ad-01ebb8b550ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:07.716107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-06262f30-3920-4c4a-a438-38b7f994bf81 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:07.729026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-06262f30-3920-4c4a-a438-38b7f994bf81 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1508 microversion: 2.1 time: 0.261230 Nov 02 23:10:07.729618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 289/566] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:07 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1508 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:07.793828 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-fe3b7663-9325-49b6-a8ad-01ebb8b550ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:07.807288 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-fe3b7663-9325-49b6-a8ad-01ebb8b550ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.305509 Nov 02 23:10:07.809893 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 278/567] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:07 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:08.478101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0a892c2e-a181-4955-aa0d-d5afa2a51b91 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:08.479061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0a892c2e-a181-4955-aa0d-d5afa2a51b91 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:08.485331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0a892c2e-a181-4955-aa0d-d5afa2a51b91 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:08.485777 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0a892c2e-a181-4955-aa0d-d5afa2a51b91 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:08.486551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0a892c2e-a181-4955-aa0d-d5afa2a51b91 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:08.487015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0a892c2e-a181-4955-aa0d-d5afa2a51b91 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:08.512892 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f65d11f3-2970-4e1e-83e6-86b3d2897a47 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:08.513786 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f65d11f3-2970-4e1e-83e6-86b3d2897a47 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:08.520697 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f65d11f3-2970-4e1e-83e6-86b3d2897a47 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:08.521147 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f65d11f3-2970-4e1e-83e6-86b3d2897a47 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:08.521913 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f65d11f3-2970-4e1e-83e6-86b3d2897a47 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:08.522384 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f65d11f3-2970-4e1e-83e6-86b3d2897a47 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:14.980951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0a892c2e-a181-4955-aa0d-d5afa2a51b91 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 6.506350 Nov 02 23:10:14.981610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 290/568] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:08 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 6508 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:10:14.986422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4e10b6f3-80f8-41d9-a0c3-023ab1a4f4a4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:14.987786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4e10b6f3-80f8-41d9-a0c3-023ab1a4f4a4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:14.995907 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e10b6f3-80f8-41d9-a0c3-023ab1a4f4a4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:14.995907 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e10b6f3-80f8-41d9-a0c3-023ab1a4f4a4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:14.996634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e10b6f3-80f8-41d9-a0c3-023ab1a4f4a4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:14.997065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e10b6f3-80f8-41d9-a0c3-023ab1a4f4a4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:15.010162 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f65d11f3-2970-4e1e-83e6-86b3d2897a47 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 6.500669 Nov 02 23:10:15.011361 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 279/569] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:08 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 6503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:10:15.135557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4e10b6f3-80f8-41d9-a0c3-023ab1a4f4a4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:15.143181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4e10b6f3-80f8-41d9-a0c3-023ab1a4f4a4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.160438 Nov 02 23:10:15.143750 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 291/570] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:14 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:15.993452 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f0caf88c-5cd2-4ef3-bb6e-27b9ef3ef78e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:15.994456 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f0caf88c-5cd2-4ef3-bb6e-27b9ef3ef78e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:16.002865 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f0caf88c-5cd2-4ef3-bb6e-27b9ef3ef78e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:16.003344 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f0caf88c-5cd2-4ef3-bb6e-27b9ef3ef78e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:16.004127 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f0caf88c-5cd2-4ef3-bb6e-27b9ef3ef78e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:16.004559 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f0caf88c-5cd2-4ef3-bb6e-27b9ef3ef78e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:16.023669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-80ae6576-c0d8-4fbc-98f0-c5576fb627e6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:16.024592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-80ae6576-c0d8-4fbc-98f0-c5576fb627e6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:16.030844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-80ae6576-c0d8-4fbc-98f0-c5576fb627e6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:16.032116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-80ae6576-c0d8-4fbc-98f0-c5576fb627e6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:16.032911 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-80ae6576-c0d8-4fbc-98f0-c5576fb627e6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:16.033350 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-80ae6576-c0d8-4fbc-98f0-c5576fb627e6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:16.122061 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f0caf88c-5cd2-4ef3-bb6e-27b9ef3ef78e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.132530 Nov 02 23:10:16.123452 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 280/571] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:15 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:10:16.147756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-80ae6576-c0d8-4fbc-98f0-c5576fb627e6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.127469 Nov 02 23:10:16.148463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 292/572] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:16 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:10:16.160294 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-875987de-722b-4148-8ae0-e385d9a97b70 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:16.160905 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-875987de-722b-4148-8ae0-e385d9a97b70 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:16.167793 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-875987de-722b-4148-8ae0-e385d9a97b70 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:16.168236 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-875987de-722b-4148-8ae0-e385d9a97b70 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:16.169005 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-875987de-722b-4148-8ae0-e385d9a97b70 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:16.169429 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-875987de-722b-4148-8ae0-e385d9a97b70 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:16.303359 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-875987de-722b-4148-8ae0-e385d9a97b70 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:16.312447 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-875987de-722b-4148-8ae0-e385d9a97b70 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.156164 Nov 02 23:10:16.313025 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 281/573] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:16 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:17.134122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ee4d8a4b-ec43-4bed-9b8f-6dca47dee601 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:17.135175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ee4d8a4b-ec43-4bed-9b8f-6dca47dee601 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:17.141966 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ee4d8a4b-ec43-4bed-9b8f-6dca47dee601 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:17.142405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ee4d8a4b-ec43-4bed-9b8f-6dca47dee601 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:17.143692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ee4d8a4b-ec43-4bed-9b8f-6dca47dee601 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:17.144119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ee4d8a4b-ec43-4bed-9b8f-6dca47dee601 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:17.160128 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-135adb7e-5d94-4776-af9a-e0bbfd409045 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:17.161907 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-135adb7e-5d94-4776-af9a-e0bbfd409045 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:17.169059 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-135adb7e-5d94-4776-af9a-e0bbfd409045 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:17.169623 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-135adb7e-5d94-4776-af9a-e0bbfd409045 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:17.170469 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-135adb7e-5d94-4776-af9a-e0bbfd409045 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:17.171025 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-135adb7e-5d94-4776-af9a-e0bbfd409045 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:17.299251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ee4d8a4b-ec43-4bed-9b8f-6dca47dee601 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.168539 Nov 02 23:10:17.303730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 293/574] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:17 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:10:17.332801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d00704da-1b23-407b-b805-4371b41bb48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:17.334215 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-135adb7e-5d94-4776-af9a-e0bbfd409045 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.178258 Nov 02 23:10:17.334865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d00704da-1b23-407b-b805-4371b41bb48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:17.335077 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 282/575] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:17 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:10:17.345175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d00704da-1b23-407b-b805-4371b41bb48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:17.346574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d00704da-1b23-407b-b805-4371b41bb48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:17.347655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d00704da-1b23-407b-b805-4371b41bb48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:17.348202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d00704da-1b23-407b-b805-4371b41bb48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:17.536850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d00704da-1b23-407b-b805-4371b41bb48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:17.545736 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d00704da-1b23-407b-b805-4371b41bb48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.219602 Nov 02 23:10:17.546396 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 294/576] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:17 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:18.314344 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-77ea9f54-53a1-4c5c-a087-e96fc610477a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:18.316236 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-77ea9f54-53a1-4c5c-a087-e96fc610477a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:18.324002 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-77ea9f54-53a1-4c5c-a087-e96fc610477a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:18.324718 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-77ea9f54-53a1-4c5c-a087-e96fc610477a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:18.325741 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-77ea9f54-53a1-4c5c-a087-e96fc610477a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:18.327089 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-77ea9f54-53a1-4c5c-a087-e96fc610477a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:18.355159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ec330c3f-58dd-45bd-93b8-987cc1a56f8a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:18.356829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ec330c3f-58dd-45bd-93b8-987cc1a56f8a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:18.368253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec330c3f-58dd-45bd-93b8-987cc1a56f8a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:18.370610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec330c3f-58dd-45bd-93b8-987cc1a56f8a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:18.374363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec330c3f-58dd-45bd-93b8-987cc1a56f8a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:18.375120 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec330c3f-58dd-45bd-93b8-987cc1a56f8a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:23.053663 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ec330c3f-58dd-45bd-93b8-987cc1a56f8a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 4.701878 Nov 02 23:10:23.054362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 295/577] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:18 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 4703 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:10:23.059296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1e7986ef-e162-4a72-b3e9-5d6c4a5bca73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:23.059985 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1e7986ef-e162-4a72-b3e9-5d6c4a5bca73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:23.067815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e7986ef-e162-4a72-b3e9-5d6c4a5bca73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:23.068098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e7986ef-e162-4a72-b3e9-5d6c4a5bca73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:23.068879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e7986ef-e162-4a72-b3e9-5d6c4a5bca73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:23.069313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e7986ef-e162-4a72-b3e9-5d6c4a5bca73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:23.105984 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-77ea9f54-53a1-4c5c-a087-e96fc610477a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 4.798366 Nov 02 23:10:23.109991 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 283/578] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:18 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 4801 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:10:23.112993 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-2474fcb2-5d28-4d43-9155-23381df0cb31 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93b291c6-450a-4fba-aaee-bcf07f1086ce"}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:23.114226 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-2474fcb2-5d28-4d43-9155-23381df0cb31 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:23.121994 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2474fcb2-5d28-4d43-9155-23381df0cb31 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:23.122712 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2474fcb2-5d28-4d43-9155-23381df0cb31 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:23.123580 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2474fcb2-5d28-4d43-9155-23381df0cb31 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:23.124075 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2474fcb2-5d28-4d43-9155-23381df0cb31 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:23.204412 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1e7986ef-e162-4a72-b3e9-5d6c4a5bca73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:23.212607 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1e7986ef-e162-4a72-b3e9-5d6c4a5bca73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.157124 Nov 02 23:10:23.213171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 296/579] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:23 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:23.386697 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-2474fcb2-5d28-4d43-9155-23381df0cb31 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "POST /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278068 Nov 02 23:10:23.387388 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 284/580] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 2 23:10:23 2021] POST /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:10:24.067360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-48cb1d45-1df1-4b47-b53f-a6cce9de597f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:24.068273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-48cb1d45-1df1-4b47-b53f-a6cce9de597f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:24.074844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48cb1d45-1df1-4b47-b53f-a6cce9de597f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:24.075323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48cb1d45-1df1-4b47-b53f-a6cce9de597f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:24.076119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48cb1d45-1df1-4b47-b53f-a6cce9de597f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:24.076544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48cb1d45-1df1-4b47-b53f-a6cce9de597f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:24.118519 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-8eda48cb-cb70-4c27-b3fc-af455de4d47d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:24.119742 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-8eda48cb-cb70-4c27-b3fc-af455de4d47d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:24.126286 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8eda48cb-cb70-4c27-b3fc-af455de4d47d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:24.126728 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8eda48cb-cb70-4c27-b3fc-af455de4d47d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:24.128148 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8eda48cb-cb70-4c27-b3fc-af455de4d47d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:24.128577 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8eda48cb-cb70-4c27-b3fc-af455de4d47d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:24.335554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-48cb1d45-1df1-4b47-b53f-a6cce9de597f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.273314 Nov 02 23:10:24.336135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 297/581] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:24 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:10:24.342231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6a149cc2-b3be-46b9-80d7-707cb4f9460d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:24.343110 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6a149cc2-b3be-46b9-80d7-707cb4f9460d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:24.350801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a149cc2-b3be-46b9-80d7-707cb4f9460d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:24.351372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a149cc2-b3be-46b9-80d7-707cb4f9460d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:24.352893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a149cc2-b3be-46b9-80d7-707cb4f9460d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:24.353407 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a149cc2-b3be-46b9-80d7-707cb4f9460d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:24.361059 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-8eda48cb-cb70-4c27-b3fc-af455de4d47d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.246317 Nov 02 23:10:24.362963 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 285/582] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:24 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:10:24.502532 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6a149cc2-b3be-46b9-80d7-707cb4f9460d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:24.510213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6a149cc2-b3be-46b9-80d7-707cb4f9460d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.172920 Nov 02 23:10:24.510898 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 298/583] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:24 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:25.347930 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-0554e773-f2ad-4b3d-94cc-7b3fa614014a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:25.348941 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-0554e773-f2ad-4b3d-94cc-7b3fa614014a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:25.356503 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0554e773-f2ad-4b3d-94cc-7b3fa614014a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:25.356959 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0554e773-f2ad-4b3d-94cc-7b3fa614014a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:25.357757 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0554e773-f2ad-4b3d-94cc-7b3fa614014a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:25.358191 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0554e773-f2ad-4b3d-94cc-7b3fa614014a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:25.373815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d716f6d7-fe19-4ad0-9531-2e95f74cf70e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:25.374739 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d716f6d7-fe19-4ad0-9531-2e95f74cf70e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:25.381240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d716f6d7-fe19-4ad0-9531-2e95f74cf70e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:25.381680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d716f6d7-fe19-4ad0-9531-2e95f74cf70e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:25.382468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d716f6d7-fe19-4ad0-9531-2e95f74cf70e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:25.382893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d716f6d7-fe19-4ad0-9531-2e95f74cf70e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:26.029298 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-0554e773-f2ad-4b3d-94cc-7b3fa614014a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.685760 Nov 02 23:10:26.029958 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 286/584] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:25 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:10:26.034771 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-07dee1e6-8116-4960-8158-715977159b13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:26.035485 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-07dee1e6-8116-4960-8158-715977159b13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:26.042907 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-07dee1e6-8116-4960-8158-715977159b13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:26.043378 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-07dee1e6-8116-4960-8158-715977159b13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:26.044158 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-07dee1e6-8116-4960-8158-715977159b13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:26.044594 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-07dee1e6-8116-4960-8158-715977159b13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:26.116406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d716f6d7-fe19-4ad0-9531-2e95f74cf70e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.746247 Nov 02 23:10:26.117056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 299/585] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:25 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:10:26.217955 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-07dee1e6-8116-4960-8158-715977159b13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:26.225963 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-07dee1e6-8116-4960-8158-715977159b13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.194745 Nov 02 23:10:26.226570 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 287/586] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:26 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:27.041365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7d8210f9-250c-4022-b313-c362c1967557 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:27.042360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7d8210f9-250c-4022-b313-c362c1967557 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:27.049619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7d8210f9-250c-4022-b313-c362c1967557 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:27.050093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7d8210f9-250c-4022-b313-c362c1967557 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:27.050889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7d8210f9-250c-4022-b313-c362c1967557 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:27.051341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7d8210f9-250c-4022-b313-c362c1967557 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:27.128823 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-136958c4-8fd9-4863-be31-3080ab2e40e0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:27.129733 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-136958c4-8fd9-4863-be31-3080ab2e40e0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:27.136067 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-136958c4-8fd9-4863-be31-3080ab2e40e0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:27.136519 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-136958c4-8fd9-4863-be31-3080ab2e40e0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:27.137294 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-136958c4-8fd9-4863-be31-3080ab2e40e0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:27.137729 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-136958c4-8fd9-4863-be31-3080ab2e40e0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:27.254712 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-136958c4-8fd9-4863-be31-3080ab2e40e0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.129873 Nov 02 23:10:27.255501 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 288/587] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:27 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:10:27.261359 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-c4871eea-3ed2-4bb6-8cf0-6e104deebde1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:27.262136 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-c4871eea-3ed2-4bb6-8cf0-6e104deebde1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:27.269648 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c4871eea-3ed2-4bb6-8cf0-6e104deebde1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:27.270149 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c4871eea-3ed2-4bb6-8cf0-6e104deebde1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:27.271096 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c4871eea-3ed2-4bb6-8cf0-6e104deebde1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:27.271594 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c4871eea-3ed2-4bb6-8cf0-6e104deebde1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:27.291568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7d8210f9-250c-4022-b313-c362c1967557 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.253949 Nov 02 23:10:27.292326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 300/588] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:27 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:10:27.405262 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-c4871eea-3ed2-4bb6-8cf0-6e104deebde1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:27.413926 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-c4871eea-3ed2-4bb6-8cf0-6e104deebde1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1521 microversion: 2.1 time: 0.157118 Nov 02 23:10:27.414493 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 289/589] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:27 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:28.266741 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0252fd9a-a30e-4962-bc4e-8ccab190b832 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:28.268505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0252fd9a-a30e-4962-bc4e-8ccab190b832 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:28.275400 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0252fd9a-a30e-4962-bc4e-8ccab190b832 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:28.275849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0252fd9a-a30e-4962-bc4e-8ccab190b832 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:28.276624 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0252fd9a-a30e-4962-bc4e-8ccab190b832 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:28.277054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0252fd9a-a30e-4962-bc4e-8ccab190b832 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:28.305132 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d77a3caa-789e-4d1a-918c-31ae539986d6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:28.306124 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d77a3caa-789e-4d1a-918c-31ae539986d6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:28.313458 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d77a3caa-789e-4d1a-918c-31ae539986d6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:28.313941 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d77a3caa-789e-4d1a-918c-31ae539986d6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:28.315263 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d77a3caa-789e-4d1a-918c-31ae539986d6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:28.315885 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d77a3caa-789e-4d1a-918c-31ae539986d6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:28.409682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0252fd9a-a30e-4962-bc4e-8ccab190b832 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.146952 Nov 02 23:10:28.413693 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 301/590] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:28 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:10:28.431589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e379eb88-6d0e-49f7-a7f6-c93cb186bdb4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:28.432531 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e379eb88-6d0e-49f7-a7f6-c93cb186bdb4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:28.440349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e379eb88-6d0e-49f7-a7f6-c93cb186bdb4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:28.440793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e379eb88-6d0e-49f7-a7f6-c93cb186bdb4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:28.441572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e379eb88-6d0e-49f7-a7f6-c93cb186bdb4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:28.442003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e379eb88-6d0e-49f7-a7f6-c93cb186bdb4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:28.457356 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d77a3caa-789e-4d1a-918c-31ae539986d6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.156734 Nov 02 23:10:28.458198 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 290/591] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:28 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:10:28.588798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e379eb88-6d0e-49f7-a7f6-c93cb186bdb4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:28.596139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e379eb88-6d0e-49f7-a7f6-c93cb186bdb4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1501 microversion: 2.1 time: 0.169029 Nov 02 23:10:28.596711 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 302/592] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:28 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1501 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:28.613527 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b897560a-b27c-48e4-a7eb-c9222deb2112 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:28.614223 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b897560a-b27c-48e4-a7eb-c9222deb2112 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:28.620781 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b897560a-b27c-48e4-a7eb-c9222deb2112 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:28.621226 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b897560a-b27c-48e4-a7eb-c9222deb2112 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:28.622000 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b897560a-b27c-48e4-a7eb-c9222deb2112 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:28.622423 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b897560a-b27c-48e4-a7eb-c9222deb2112 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:28.762476 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-b897560a-b27c-48e4-a7eb-c9222deb2112 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:28.770833 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b897560a-b27c-48e4-a7eb-c9222deb2112 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1516 microversion: 2.1 time: 0.161754 Nov 02 23:10:28.771476 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 291/593] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:28 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:29.421081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0803e2a1-f2ec-4761-b59a-b6e5813f8570 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:29.421987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0803e2a1-f2ec-4761-b59a-b6e5813f8570 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:29.428703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0803e2a1-f2ec-4761-b59a-b6e5813f8570 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:29.429169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0803e2a1-f2ec-4761-b59a-b6e5813f8570 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:29.429933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0803e2a1-f2ec-4761-b59a-b6e5813f8570 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:29.430358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0803e2a1-f2ec-4761-b59a-b6e5813f8570 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:29.468936 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e2558966-bcfe-4a35-a6f9-d6ac163c6895 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:29.469897 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e2558966-bcfe-4a35-a6f9-d6ac163c6895 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:29.476818 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e2558966-bcfe-4a35-a6f9-d6ac163c6895 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:29.477261 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e2558966-bcfe-4a35-a6f9-d6ac163c6895 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:29.478027 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e2558966-bcfe-4a35-a6f9-d6ac163c6895 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:29.478478 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e2558966-bcfe-4a35-a6f9-d6ac163c6895 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:29.558614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0803e2a1-f2ec-4761-b59a-b6e5813f8570 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.141136 Nov 02 23:10:29.559813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 303/594] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:29 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:10:29.597779 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e2558966-bcfe-4a35-a6f9-d6ac163c6895 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.132259 Nov 02 23:10:29.598451 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 292/595] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:29 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:10:29.934619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0841661f-89ad-42f4-b1ee-88f0d1e9ae01 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:29.935406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0841661f-89ad-42f4-b1ee-88f0d1e9ae01 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:29.942645 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0841661f-89ad-42f4-b1ee-88f0d1e9ae01 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:29.943169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0841661f-89ad-42f4-b1ee-88f0d1e9ae01 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:29.943963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0841661f-89ad-42f4-b1ee-88f0d1e9ae01 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:29.944395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0841661f-89ad-42f4-b1ee-88f0d1e9ae01 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:30.024877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.objects.instance [None req-0841661f-89ad-42f4-b1ee-88f0d1e9ae01 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lazy-loading 'services' on Instance uuid 4c38d18d-608e-45d6-b13b-8e25b83023c9 {{(pid=115800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 23:10:30.096932 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0841661f-89ad-42f4-b1ee-88f0d1e9ae01 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9/os-volume_attachments/4acbca45-2fdd-4f9b-82bf-54b9f1ab189f" status: 202 len: 0 microversion: 2.1 time: 0.165267 Nov 02 23:10:30.097877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 304/596] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 2 23:10:29 2021] DELETE /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9/os-volume_attachments/4acbca45-2fdd-4f9b-82bf-54b9f1ab189f => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:10:30.571449 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-5807b23f-237a-406b-a37c-fe1615d57b51 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:30.572451 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-5807b23f-237a-406b-a37c-fe1615d57b51 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:30.579461 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5807b23f-237a-406b-a37c-fe1615d57b51 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:30.580745 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5807b23f-237a-406b-a37c-fe1615d57b51 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:30.581566 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5807b23f-237a-406b-a37c-fe1615d57b51 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:30.582006 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5807b23f-237a-406b-a37c-fe1615d57b51 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:30.614503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2760000f-a393-41fe-943e-083519aa4123 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:30.614503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2760000f-a393-41fe-943e-083519aa4123 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:30.618283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2760000f-a393-41fe-943e-083519aa4123 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:30.618728 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2760000f-a393-41fe-943e-083519aa4123 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:30.619554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2760000f-a393-41fe-943e-083519aa4123 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:30.619987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2760000f-a393-41fe-943e-083519aa4123 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:30.691253 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-5807b23f-237a-406b-a37c-fe1615d57b51 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.123639 Nov 02 23:10:30.691932 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 293/597] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:30 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:10:30.717495 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2760000f-a393-41fe-943e-083519aa4123 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.111509 Nov 02 23:10:30.718142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 305/598] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:30 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:10:31.241250 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-95a5ea7d-81bc-445a-b624-0a7ba4938f37 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:31.242289 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-95a5ea7d-81bc-445a-b624-0a7ba4938f37 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:31.249092 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-95a5ea7d-81bc-445a-b624-0a7ba4938f37 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:31.249545 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-95a5ea7d-81bc-445a-b624-0a7ba4938f37 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:31.250319 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-95a5ea7d-81bc-445a-b624-0a7ba4938f37 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:31.250755 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-95a5ea7d-81bc-445a-b624-0a7ba4938f37 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:31.278416 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.objects.instance [None req-95a5ea7d-81bc-445a-b624-0a7ba4938f37 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lazy-loading 'flavor' on Instance uuid e7bf8316-893d-4fad-b5f0-4ecad89120b3 {{(pid=115799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 23:10:31.359312 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-95a5ea7d-81bc-445a-b624-0a7ba4938f37 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "POST /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/action" status: 200 len: 32 microversion: 2.1 time: 0.122795 Nov 02 23:10:31.359990 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 294/599] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:31 2021] POST /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/action => generated 32 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 23:10:31.370151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c860211c-5e7e-40d8-9f49-7f85fb780c63 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:31.370858 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c860211c-5e7e-40d8-9f49-7f85fb780c63 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:31.377904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c860211c-5e7e-40d8-9f49-7f85fb780c63 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:31.378351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c860211c-5e7e-40d8-9f49-7f85fb780c63 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:31.379167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c860211c-5e7e-40d8-9f49-7f85fb780c63 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:31.379598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c860211c-5e7e-40d8-9f49-7f85fb780c63 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:31.513172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c860211c-5e7e-40d8-9f49-7f85fb780c63 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:31.522202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c860211c-5e7e-40d8-9f49-7f85fb780c63 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1522 microversion: 2.1 time: 0.156064 Nov 02 23:10:31.522854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 306/600] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:31 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:10:31.705564 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-8175aca5-3c6e-42db-81aa-249e7b97c718 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:31.706559 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-8175aca5-3c6e-42db-81aa-249e7b97c718 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:31.713042 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8175aca5-3c6e-42db-81aa-249e7b97c718 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:31.713324 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8175aca5-3c6e-42db-81aa-249e7b97c718 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:31.714096 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8175aca5-3c6e-42db-81aa-249e7b97c718 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:31.714516 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8175aca5-3c6e-42db-81aa-249e7b97c718 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:31.729150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ac2bf2e8-2c3a-4cdb-a9f2-5ee2435de860 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:31.730907 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ac2bf2e8-2c3a-4cdb-a9f2-5ee2435de860 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:31.737304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac2bf2e8-2c3a-4cdb-a9f2-5ee2435de860 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:31.738009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac2bf2e8-2c3a-4cdb-a9f2-5ee2435de860 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:31.738849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac2bf2e8-2c3a-4cdb-a9f2-5ee2435de860 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:31.739376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac2bf2e8-2c3a-4cdb-a9f2-5ee2435de860 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:31.833683 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-8175aca5-3c6e-42db-81aa-249e7b97c718 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.133220 Nov 02 23:10:31.837628 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 295/601] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:31 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:10:31.873120 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ac2bf2e8-2c3a-4cdb-a9f2-5ee2435de860 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.147614 Nov 02 23:10:31.874232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 307/602] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:31 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:10:32.540248 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-98f95061-eb97-4a9b-93f6-e16423bfaae5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:32.540866 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-98f95061-eb97-4a9b-93f6-e16423bfaae5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:32.547985 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-98f95061-eb97-4a9b-93f6-e16423bfaae5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:32.548525 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-98f95061-eb97-4a9b-93f6-e16423bfaae5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:32.549883 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-98f95061-eb97-4a9b-93f6-e16423bfaae5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:32.550354 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-98f95061-eb97-4a9b-93f6-e16423bfaae5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:32.722639 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-98f95061-eb97-4a9b-93f6-e16423bfaae5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:32.735743 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-98f95061-eb97-4a9b-93f6-e16423bfaae5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1522 microversion: 2.1 time: 0.199150 Nov 02 23:10:32.737371 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 296/603] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:32 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:32.846375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e9b67334-4843-4604-bde7-1b705eea12c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:32.847343 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e9b67334-4843-4604-bde7-1b705eea12c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:32.854744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9b67334-4843-4604-bde7-1b705eea12c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:32.855233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9b67334-4843-4604-bde7-1b705eea12c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:32.856109 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9b67334-4843-4604-bde7-1b705eea12c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:32.856534 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9b67334-4843-4604-bde7-1b705eea12c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:32.885082 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-6c042a1d-b85e-472f-a81e-d6105eb8026c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:32.886854 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-6c042a1d-b85e-472f-a81e-d6105eb8026c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:32.894439 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6c042a1d-b85e-472f-a81e-d6105eb8026c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:32.894882 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6c042a1d-b85e-472f-a81e-d6105eb8026c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:32.895675 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6c042a1d-b85e-472f-a81e-d6105eb8026c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:32.896097 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6c042a1d-b85e-472f-a81e-d6105eb8026c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:32.984903 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e9b67334-4843-4604-bde7-1b705eea12c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.143318 Nov 02 23:10:32.985792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 308/604] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:32 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:10:33.031966 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-6c042a1d-b85e-472f-a81e-d6105eb8026c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.150279 Nov 02 23:10:33.032862 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 297/605] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:32 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:10:33.754165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bc2e8f12-ada5-4ec2-98d1-2788c46d8836 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:33.754853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bc2e8f12-ada5-4ec2-98d1-2788c46d8836 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:33.761672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc2e8f12-ada5-4ec2-98d1-2788c46d8836 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:33.762117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc2e8f12-ada5-4ec2-98d1-2788c46d8836 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:33.762891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc2e8f12-ada5-4ec2-98d1-2788c46d8836 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:33.763345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc2e8f12-ada5-4ec2-98d1-2788c46d8836 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:33.918060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bc2e8f12-ada5-4ec2-98d1-2788c46d8836 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:33.925762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bc2e8f12-ada5-4ec2-98d1-2788c46d8836 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1522 microversion: 2.1 time: 0.175743 Nov 02 23:10:33.926347 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 309/606] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:33 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:33.997183 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-8210f312-9756-4c19-866c-a61f495dda39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:34.000556 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-8210f312-9756-4c19-866c-a61f495dda39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:34.005710 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8210f312-9756-4c19-866c-a61f495dda39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:34.006094 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8210f312-9756-4c19-866c-a61f495dda39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:34.006872 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8210f312-9756-4c19-866c-a61f495dda39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:34.007332 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8210f312-9756-4c19-866c-a61f495dda39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:34.044059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-79072004-657e-41b8-95ea-ac1506bbf7ac tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:34.044986 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-79072004-657e-41b8-95ea-ac1506bbf7ac tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:34.052475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79072004-657e-41b8-95ea-ac1506bbf7ac tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:34.052998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79072004-657e-41b8-95ea-ac1506bbf7ac tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:34.053974 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79072004-657e-41b8-95ea-ac1506bbf7ac tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:34.054525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79072004-657e-41b8-95ea-ac1506bbf7ac tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:34.155441 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-8210f312-9756-4c19-866c-a61f495dda39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.162054 Nov 02 23:10:34.156109 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 298/607] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:33 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:10:34.203404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-79072004-657e-41b8-95ea-ac1506bbf7ac tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.162816 Nov 02 23:10:34.204051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 310/608] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:34 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:10:34.943669 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a76dab4f-072c-49d5-a9ff-4ccdb6be0062 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:34.944360 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a76dab4f-072c-49d5-a9ff-4ccdb6be0062 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:34.951190 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a76dab4f-072c-49d5-a9ff-4ccdb6be0062 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:34.951636 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a76dab4f-072c-49d5-a9ff-4ccdb6be0062 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:34.952408 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a76dab4f-072c-49d5-a9ff-4ccdb6be0062 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:34.952839 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a76dab4f-072c-49d5-a9ff-4ccdb6be0062 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:35.087711 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-a76dab4f-072c-49d5-a9ff-4ccdb6be0062 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:35.095040 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a76dab4f-072c-49d5-a9ff-4ccdb6be0062 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1522 microversion: 2.1 time: 0.155925 Nov 02 23:10:35.095794 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 299/609] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:34 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:35.117383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-592f4a65-0632-46cc-b2ec-fc0268053b74 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93b291c6-450a-4fba-aaee-bcf07f1086ce"}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:35.118538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-592f4a65-0632-46cc-b2ec-fc0268053b74 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:35.125364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-592f4a65-0632-46cc-b2ec-fc0268053b74 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:35.125813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-592f4a65-0632-46cc-b2ec-fc0268053b74 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:35.126611 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-592f4a65-0632-46cc-b2ec-fc0268053b74 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:35.127594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-592f4a65-0632-46cc-b2ec-fc0268053b74 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:35.166103 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-74d53b2b-4a29-401a-9ba2-b63660ba6483 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:35.167089 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-74d53b2b-4a29-401a-9ba2-b63660ba6483 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:35.172753 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-74d53b2b-4a29-401a-9ba2-b63660ba6483 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:35.173191 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-74d53b2b-4a29-401a-9ba2-b63660ba6483 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:35.174440 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-74d53b2b-4a29-401a-9ba2-b63660ba6483 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:35.174865 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-74d53b2b-4a29-401a-9ba2-b63660ba6483 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:35.208301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-592f4a65-0632-46cc-b2ec-fc0268053b74 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] HTTP exception thrown: Invalid volume: volume 93b291c6-450a-4fba-aaee-bcf07f1086ce is already attached to instances: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 Nov 02 23:10:35.210858 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-592f4a65-0632-46cc-b2ec-fc0268053b74 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Returning 400 to user: Invalid volume: volume 93b291c6-450a-4fba-aaee-bcf07f1086ce is already attached to instances: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:10:35.211789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-592f4a65-0632-46cc-b2ec-fc0268053b74 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "POST /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098612 Nov 02 23:10:35.212385 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 311/610] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 2 23:10:35 2021] POST /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 23:10:35.217228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4e76bb48-5940-44a2-a28e-19360471eb3b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:35.218386 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4e76bb48-5940-44a2-a28e-19360471eb3b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:35.225392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e76bb48-5940-44a2-a28e-19360471eb3b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:35.225866 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e76bb48-5940-44a2-a28e-19360471eb3b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:35.226651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e76bb48-5940-44a2-a28e-19360471eb3b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:35.227148 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e76bb48-5940-44a2-a28e-19360471eb3b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:35.309128 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-74d53b2b-4a29-401a-9ba2-b63660ba6483 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.146373 Nov 02 23:10:35.309769 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 300/611] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:35 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:10:35.315501 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-4a345704-b4df-44a2-904e-198907d18548 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:35.316069 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-4a345704-b4df-44a2-904e-198907d18548 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:35.322710 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4a345704-b4df-44a2-904e-198907d18548 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:35.323177 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4a345704-b4df-44a2-904e-198907d18548 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:35.324064 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4a345704-b4df-44a2-904e-198907d18548 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:35.324497 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4a345704-b4df-44a2-904e-198907d18548 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:35.360217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4e76bb48-5940-44a2-a28e-19360471eb3b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.146554 Nov 02 23:10:35.364583 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 312/612] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:35 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:10:35.588683 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.objects.instance [None req-4a345704-b4df-44a2-904e-198907d18548 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lazy-loading 'services' on Instance uuid fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 {{(pid=115799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 23:10:35.698481 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-4a345704-b4df-44a2-904e-198907d18548 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07/os-volume_attachments/93b291c6-450a-4fba-aaee-bcf07f1086ce" status: 202 len: 0 microversion: 2.1 time: 0.387111 Nov 02 23:10:35.699142 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 301/613] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 2 23:10:35 2021] DELETE /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07/os-volume_attachments/93b291c6-450a-4fba-aaee-bcf07f1086ce => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:10:35.708814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b308d4b7-df84-46ff-833f-90cffc8771ce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:35.709947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b308d4b7-df84-46ff-833f-90cffc8771ce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:35.717191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b308d4b7-df84-46ff-833f-90cffc8771ce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:35.717673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b308d4b7-df84-46ff-833f-90cffc8771ce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:35.718576 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b308d4b7-df84-46ff-833f-90cffc8771ce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:35.719031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b308d4b7-df84-46ff-833f-90cffc8771ce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:35.750108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b308d4b7-df84-46ff-833f-90cffc8771ce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046310 Nov 02 23:10:35.750673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 313/614] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:10:35 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:10:36.116877 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-468745fd-5d02-476b-bc47-9cdc2a9cf3db tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:36.117477 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-468745fd-5d02-476b-bc47-9cdc2a9cf3db tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:36.123558 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-468745fd-5d02-476b-bc47-9cdc2a9cf3db tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:36.124006 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-468745fd-5d02-476b-bc47-9cdc2a9cf3db tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:36.124768 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-468745fd-5d02-476b-bc47-9cdc2a9cf3db tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:36.125195 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-468745fd-5d02-476b-bc47-9cdc2a9cf3db tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:36.256412 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-468745fd-5d02-476b-bc47-9cdc2a9cf3db tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:36.263787 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-468745fd-5d02-476b-bc47-9cdc2a9cf3db tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1522 microversion: 2.1 time: 0.151189 Nov 02 23:10:36.264349 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 302/615] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:36 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:36.320858 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1bf0ff28-81fd-409e-ac23-81b3f212b941 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:36.321813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1bf0ff28-81fd-409e-ac23-81b3f212b941 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:36.328090 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1bf0ff28-81fd-409e-ac23-81b3f212b941 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:36.328544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1bf0ff28-81fd-409e-ac23-81b3f212b941 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:36.329350 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1bf0ff28-81fd-409e-ac23-81b3f212b941 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:36.330608 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1bf0ff28-81fd-409e-ac23-81b3f212b941 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:36.372174 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-abe1b8a1-ad97-4334-bff2-8aa059401fcc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:36.373022 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-abe1b8a1-ad97-4334-bff2-8aa059401fcc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:36.379600 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-abe1b8a1-ad97-4334-bff2-8aa059401fcc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:36.380040 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-abe1b8a1-ad97-4334-bff2-8aa059401fcc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:36.380796 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-abe1b8a1-ad97-4334-bff2-8aa059401fcc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:36.381468 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-abe1b8a1-ad97-4334-bff2-8aa059401fcc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:36.476135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1bf0ff28-81fd-409e-ac23-81b3f212b941 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.158815 Nov 02 23:10:36.476863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 314/616] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:36 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:10:36.508256 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-abe1b8a1-ad97-4334-bff2-8aa059401fcc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.139532 Nov 02 23:10:36.509127 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 303/617] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:36 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:10:36.599937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-94022ff4-2089-4a82-bf0c-679d7ed0f93b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:36.600516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-94022ff4-2089-4a82-bf0c-679d7ed0f93b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:36.607330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94022ff4-2089-4a82-bf0c-679d7ed0f93b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:36.607823 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94022ff4-2089-4a82-bf0c-679d7ed0f93b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:36.608616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94022ff4-2089-4a82-bf0c-679d7ed0f93b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:36.609052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94022ff4-2089-4a82-bf0c-679d7ed0f93b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:36.640481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-94022ff4-2089-4a82-bf0c-679d7ed0f93b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Going to try to terminate instance {{(pid=115800) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 23:10:36.718751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-94022ff4-2089-4a82-bf0c-679d7ed0f93b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 204 len: 0 microversion: 2.1 time: 0.122579 Nov 02 23:10:36.719431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 315/618] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:10:36 2021] DELETE /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 23:10:36.728060 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a1204b20-15fe-49a2-80ae-dda7644f8e10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:36.728790 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a1204b20-15fe-49a2-80ae-dda7644f8e10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:36.735771 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a1204b20-15fe-49a2-80ae-dda7644f8e10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:36.736750 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a1204b20-15fe-49a2-80ae-dda7644f8e10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:36.737540 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a1204b20-15fe-49a2-80ae-dda7644f8e10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:36.737975 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a1204b20-15fe-49a2-80ae-dda7644f8e10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:36.762153 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d438ece5-a565-4540-b82d-2d48379157c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:36.763183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d438ece5-a565-4540-b82d-2d48379157c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:36.770594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d438ece5-a565-4540-b82d-2d48379157c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:36.771075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d438ece5-a565-4540-b82d-2d48379157c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:36.771907 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d438ece5-a565-4540-b82d-2d48379157c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:36.772332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d438ece5-a565-4540-b82d-2d48379157c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:36.802348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d438ece5-a565-4540-b82d-2d48379157c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044396 Nov 02 23:10:36.802939 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 316/619] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:10:36 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:10:36.871629 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-a1204b20-15fe-49a2-80ae-dda7644f8e10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:36.879973 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a1204b20-15fe-49a2-80ae-dda7644f8e10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 200 len: 1514 microversion: 2.1 time: 0.155877 Nov 02 23:10:36.880499 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 304/620] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:36 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:37.281202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-095aa974-8d0e-408f-a4f5-149981a8e7c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:37.281827 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-095aa974-8d0e-408f-a4f5-149981a8e7c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:37.288751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-095aa974-8d0e-408f-a4f5-149981a8e7c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:37.289196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-095aa974-8d0e-408f-a4f5-149981a8e7c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:37.289957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-095aa974-8d0e-408f-a4f5-149981a8e7c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:37.290417 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-095aa974-8d0e-408f-a4f5-149981a8e7c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:37.418538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-095aa974-8d0e-408f-a4f5-149981a8e7c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:37.425707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-095aa974-8d0e-408f-a4f5-149981a8e7c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1522 microversion: 2.1 time: 0.148160 Nov 02 23:10:37.426290 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 317/621] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:37 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:37.487616 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b353dbb2-80fa-42ec-98de-d023592a3f27 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:37.488667 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b353dbb2-80fa-42ec-98de-d023592a3f27 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:37.495030 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b353dbb2-80fa-42ec-98de-d023592a3f27 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:37.495479 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b353dbb2-80fa-42ec-98de-d023592a3f27 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:37.496242 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b353dbb2-80fa-42ec-98de-d023592a3f27 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:37.496670 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b353dbb2-80fa-42ec-98de-d023592a3f27 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:37.520208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7fd2237b-5500-4261-b887-36d0c39b4f77 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:37.521142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7fd2237b-5500-4261-b887-36d0c39b4f77 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:37.527220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7fd2237b-5500-4261-b887-36d0c39b4f77 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:37.527673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7fd2237b-5500-4261-b887-36d0c39b4f77 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:37.528449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7fd2237b-5500-4261-b887-36d0c39b4f77 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:37.528887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7fd2237b-5500-4261-b887-36d0c39b4f77 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:37.561673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:10:37.561859 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:10:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action (ip 10.222.0.41) !!! Nov 02 23:10:37.617789 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b353dbb2-80fa-42ec-98de-d023592a3f27 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.133611 Nov 02 23:10:37.618432 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 305/622] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:37 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:10:37.640937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7fd2237b-5500-4261-b887-36d0c39b4f77 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.124747 Nov 02 23:10:37.641600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 318/623] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:37 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:10:37.815545 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-bdb7c17c-7560-40f3-a52b-7a0188ced4cf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:37.816779 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-bdb7c17c-7560-40f3-a52b-7a0188ced4cf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:37.823594 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bdb7c17c-7560-40f3-a52b-7a0188ced4cf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:37.824040 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bdb7c17c-7560-40f3-a52b-7a0188ced4cf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:37.824823 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bdb7c17c-7560-40f3-a52b-7a0188ced4cf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:37.825236 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bdb7c17c-7560-40f3-a52b-7a0188ced4cf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:37.854221 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-bdb7c17c-7560-40f3-a52b-7a0188ced4cf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043982 Nov 02 23:10:37.854766 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 306/624] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:10:37 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 23:10:37.897716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bcef21f7-3558-46b3-9cb4-6bc4c588292b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:37.898411 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bcef21f7-3558-46b3-9cb4-6bc4c588292b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:37.905512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcef21f7-3558-46b3-9cb4-6bc4c588292b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:37.905962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcef21f7-3558-46b3-9cb4-6bc4c588292b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:37.906944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcef21f7-3558-46b3-9cb4-6bc4c588292b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:37.908007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcef21f7-3558-46b3-9cb4-6bc4c588292b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:38.001213 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-c329dd40-7d51-42b8-b7c5-1f5f6132b5cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-955697172", "imageRef": "4159c567-fd66-4bbb-9bf4-6ce0afd65d88", "flavorRef": "452", "networks": [{"uuid": "a641b2e8-96fc-4d47-b974-970483d44042"}]}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:38.040761 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bcef21f7-3558-46b3-9cb4-6bc4c588292b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:38.048098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bcef21f7-3558-46b3-9cb4-6bc4c588292b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 200 len: 1514 microversion: 2.1 time: 0.154387 Nov 02 23:10:38.048662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 319/625] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:37 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:38.054448 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.network.neutron [None req-c329dd40-7d51-42b8-b7c5-1f5f6132b5cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] validate_networks() for [('a641b2e8-96fc-4d47-b974-970483d44042', None, None, None, None, None)] {{(pid=115799) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 23:10:38.421094 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-c329dd40-7d51-42b8-b7c5-1f5f6132b5cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Flavor limits 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 23:10:38.421491 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-c329dd40-7d51-42b8-b7c5-1f5f6132b5cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Image limits 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 23:10:38.421956 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-c329dd40-7d51-42b8-b7c5-1f5f6132b5cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Flavor pref 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 23:10:38.422352 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-c329dd40-7d51-42b8-b7c5-1f5f6132b5cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Image pref 0:0:0 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 23:10:38.422746 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.virt.hardware [None req-c329dd40-7d51-42b8-b7c5-1f5f6132b5cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 23:10:38.432238 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c329dd40-7d51-42b8-b7c5-1f5f6132b5cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:38.432677 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c329dd40-7d51-42b8-b7c5-1f5f6132b5cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:38.433468 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c329dd40-7d51-42b8-b7c5-1f5f6132b5cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:38.433895 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c329dd40-7d51-42b8-b7c5-1f5f6132b5cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:38.445465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1204d299-2d1b-4461-8ee0-c0d1215f834a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:38.446074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1204d299-2d1b-4461-8ee0-c0d1215f834a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:38.451490 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.quota [None req-c329dd40-7d51-42b8-b7c5-1f5f6132b5cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Getting quotas for project 0f70e69ec3db4f378ac856e1e93b45e5. Resources: {'cores', 'instances', 'ram'} {{(pid=115799) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:10:38.453149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1204d299-2d1b-4461-8ee0-c0d1215f834a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:38.453593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1204d299-2d1b-4461-8ee0-c0d1215f834a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:38.454370 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1204d299-2d1b-4461-8ee0-c0d1215f834a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:38.455091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1204d299-2d1b-4461-8ee0-c0d1215f834a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:38.456034 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.quota [None req-c329dd40-7d51-42b8-b7c5-1f5f6132b5cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Getting quotas for user 81a16c3887f94b4d825e21e2fe34e26b and project 0f70e69ec3db4f378ac856e1e93b45e5. Resources: {'cores', 'instances', 'ram'} {{(pid=115799) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:10:38.466986 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-c329dd40-7d51-42b8-b7c5-1f5f6132b5cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Going to run 1 instances... {{(pid=115799) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 23:10:38.469300 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-c329dd40-7d51-42b8-b7c5-1f5f6132b5cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4159c567-fd66-4bbb-9bf4-6ce0afd65d88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 23:10:38.519681 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-c329dd40-7d51-42b8-b7c5-1f5f6132b5cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521778 Nov 02 23:10:38.520514 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 307/626] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 2 23:10:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 23:10:38.530242 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-7db041c8-6f06-4710-b1a3-f04db4c8ab39 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:38.530851 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-7db041c8-6f06-4710-b1a3-f04db4c8ab39 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:38.586072 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-7db041c8-6f06-4710-b1a3-f04db4c8ab39 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:38.592519 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-7db041c8-6f06-4710-b1a3-f04db4c8ab39 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1217 microversion: 2.1 time: 0.065907 Nov 02 23:10:38.593400 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 308/627] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:38 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:10:38.610305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1204d299-2d1b-4461-8ee0-c0d1215f834a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:38.618140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1204d299-2d1b-4461-8ee0-c0d1215f834a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1522 microversion: 2.1 time: 0.179081 Nov 02 23:10:38.618790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 320/628] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:38 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:10:38.629421 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-98fbd0cf-a019-4d93-bb1f-5ca4bd76f7d3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:38.630499 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-98fbd0cf-a019-4d93-bb1f-5ca4bd76f7d3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:38.636637 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-98fbd0cf-a019-4d93-bb1f-5ca4bd76f7d3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:38.636982 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-98fbd0cf-a019-4d93-bb1f-5ca4bd76f7d3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:38.637795 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-98fbd0cf-a019-4d93-bb1f-5ca4bd76f7d3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:38.638176 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-98fbd0cf-a019-4d93-bb1f-5ca4bd76f7d3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:38.652798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7ff55a6e-fd2b-4a28-a949-127a62d2dec4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:38.653709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7ff55a6e-fd2b-4a28-a949-127a62d2dec4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:38.660525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ff55a6e-fd2b-4a28-a949-127a62d2dec4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:38.661324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ff55a6e-fd2b-4a28-a949-127a62d2dec4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:38.662169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ff55a6e-fd2b-4a28-a949-127a62d2dec4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:38.662609 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ff55a6e-fd2b-4a28-a949-127a62d2dec4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:38.802273 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-98fbd0cf-a019-4d93-bb1f-5ca4bd76f7d3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.176397 Nov 02 23:10:38.805156 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 309/629] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:38 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:10:38.857038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7ff55a6e-fd2b-4a28-a949-127a62d2dec4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.207666 Nov 02 23:10:38.857955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 321/630] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:38 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:10:39.065722 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-1bd4bb28-cf33-4370-ad56-0f2de3d45f87 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:39.066441 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-1bd4bb28-cf33-4370-ad56-0f2de3d45f87 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:39.073603 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1bd4bb28-cf33-4370-ad56-0f2de3d45f87 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:39.074049 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1bd4bb28-cf33-4370-ad56-0f2de3d45f87 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:39.074818 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1bd4bb28-cf33-4370-ad56-0f2de3d45f87 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:39.075272 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1bd4bb28-cf33-4370-ad56-0f2de3d45f87 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:39.209262 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-1bd4bb28-cf33-4370-ad56-0f2de3d45f87 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:39.216401 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-1bd4bb28-cf33-4370-ad56-0f2de3d45f87 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 200 len: 1514 microversion: 2.1 time: 0.155344 Nov 02 23:10:39.216954 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 310/631] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:39 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:39.610178 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-47918a21-b6c0-4c8f-8adc-f935a4131f79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:39.610785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-47918a21-b6c0-4c8f-8adc-f935a4131f79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:39.618084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47918a21-b6c0-4c8f-8adc-f935a4131f79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:39.618523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47918a21-b6c0-4c8f-8adc-f935a4131f79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:39.619379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47918a21-b6c0-4c8f-8adc-f935a4131f79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:39.619805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47918a21-b6c0-4c8f-8adc-f935a4131f79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:39.634151 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-52c5199e-411d-4081-94ef-a937dc776936 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:39.635672 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-52c5199e-411d-4081-94ef-a937dc776936 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:39.642406 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-52c5199e-411d-4081-94ef-a937dc776936 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:39.643110 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-52c5199e-411d-4081-94ef-a937dc776936 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:39.643883 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-52c5199e-411d-4081-94ef-a937dc776936 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:39.644311 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-52c5199e-411d-4081-94ef-a937dc776936 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:39.680403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-47918a21-b6c0-4c8f-8adc-f935a4131f79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:39.688443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-47918a21-b6c0-4c8f-8adc-f935a4131f79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1269 microversion: 2.1 time: 0.082374 Nov 02 23:10:39.689060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 322/632] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:39 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1269 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:39.814093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4aeb7818-3108-4043-9e44-0e1f3f5f1551 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:39.815321 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4aeb7818-3108-4043-9e44-0e1f3f5f1551 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:39.821753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4aeb7818-3108-4043-9e44-0e1f3f5f1551 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:39.822200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4aeb7818-3108-4043-9e44-0e1f3f5f1551 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:39.822998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4aeb7818-3108-4043-9e44-0e1f3f5f1551 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:39.823432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4aeb7818-3108-4043-9e44-0e1f3f5f1551 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:39.882659 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-52c5199e-411d-4081-94ef-a937dc776936 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:39.890471 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-52c5199e-411d-4081-94ef-a937dc776936 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1522 microversion: 2.1 time: 0.259913 Nov 02 23:10:39.891199 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 311/633] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:39 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:10:39.896793 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-bde35a63-2ce8-47f6-be83-e97f0c655f4a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:39.897766 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-bde35a63-2ce8-47f6-be83-e97f0c655f4a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:39.904287 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bde35a63-2ce8-47f6-be83-e97f0c655f4a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:39.904864 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bde35a63-2ce8-47f6-be83-e97f0c655f4a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:39.905732 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bde35a63-2ce8-47f6-be83-e97f0c655f4a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:39.906454 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bde35a63-2ce8-47f6-be83-e97f0c655f4a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:39.936937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4aeb7818-3108-4043-9e44-0e1f3f5f1551 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.126680 Nov 02 23:10:39.938128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 323/634] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:39 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:10:40.081594 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-bde35a63-2ce8-47f6-be83-e97f0c655f4a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.189128 Nov 02 23:10:40.082766 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 312/635] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:39 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:10:40.192505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-dce97752-1132-47e4-b3a8-512d64b1cba2 req-01f458ce-31b2-436c-bca8-9f9e6949682a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c38d18d-608e-45d6-b13b-8e25b83023c9", "name": "network-vif-deleted", "tag": "5b5cb467-f6ad-4c1b-8089-7b22526c9370"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:40.194348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:10:40.194348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:10:40.212621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-dce97752-1132-47e4-b3a8-512d64b1cba2 req-01f458ce-31b2-436c-bca8-9f9e6949682a service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:40.213159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-dce97752-1132-47e4-b3a8-512d64b1cba2 req-01f458ce-31b2-436c-bca8-9f9e6949682a service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:40.234494 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b376a9ec-7181-4f57-bbe2-11f8b61c90de tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:40.235491 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b376a9ec-7181-4f57-bbe2-11f8b61c90de tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:40.238142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-dce97752-1132-47e4-b3a8-512d64b1cba2 req-01f458ce-31b2-436c-bca8-9f9e6949682a service nova] Creating event network-vif-deleted:5b5cb467-f6ad-4c1b-8089-7b22526c9370 for instance 4c38d18d-608e-45d6-b13b-8e25b83023c9 on hv-cinder-81584 Nov 02 23:10:40.243863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-dce97752-1132-47e4-b3a8-512d64b1cba2 req-01f458ce-31b2-436c-bca8-9f9e6949682a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056044 Nov 02 23:10:40.244053 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b376a9ec-7181-4f57-bbe2-11f8b61c90de tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:40.244703 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b376a9ec-7181-4f57-bbe2-11f8b61c90de tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:40.245453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 324/636] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:10:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:10:40.245565 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b376a9ec-7181-4f57-bbe2-11f8b61c90de tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:40.245967 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b376a9ec-7181-4f57-bbe2-11f8b61c90de tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:40.353870 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-b376a9ec-7181-4f57-bbe2-11f8b61c90de tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:40.362168 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b376a9ec-7181-4f57-bbe2-11f8b61c90de tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 200 len: 1472 microversion: 2.1 time: 0.131919 Nov 02 23:10:40.365635 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 313/637] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:40 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 1472 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:10:40.706839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b0cbc361-4d66-4b0c-9071-37c70aed257b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:40.708262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b0cbc361-4d66-4b0c-9071-37c70aed257b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:40.714582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b0cbc361-4d66-4b0c-9071-37c70aed257b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:40.715055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b0cbc361-4d66-4b0c-9071-37c70aed257b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:40.715829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b0cbc361-4d66-4b0c-9071-37c70aed257b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:40.716283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b0cbc361-4d66-4b0c-9071-37c70aed257b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:40.800794 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b0cbc361-4d66-4b0c-9071-37c70aed257b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:40.808398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b0cbc361-4d66-4b0c-9071-37c70aed257b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1275 microversion: 2.1 time: 0.106413 Nov 02 23:10:40.809001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 325/638] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:40 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1275 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:10:40.910909 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-4218fed7-b878-4c2c-a305-754d73117298 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:40.911756 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-4218fed7-b878-4c2c-a305-754d73117298 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:40.918117 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4218fed7-b878-4c2c-a305-754d73117298 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:40.918563 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4218fed7-b878-4c2c-a305-754d73117298 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:40.919380 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4218fed7-b878-4c2c-a305-754d73117298 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:40.920033 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4218fed7-b878-4c2c-a305-754d73117298 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:40.948807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d62b99ce-b43b-4046-a8aa-05bb525cfd66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:40.949696 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d62b99ce-b43b-4046-a8aa-05bb525cfd66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:40.956588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d62b99ce-b43b-4046-a8aa-05bb525cfd66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:40.957241 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d62b99ce-b43b-4046-a8aa-05bb525cfd66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:40.958382 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d62b99ce-b43b-4046-a8aa-05bb525cfd66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:40.959019 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d62b99ce-b43b-4046-a8aa-05bb525cfd66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:41.101676 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-4218fed7-b878-4c2c-a305-754d73117298 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:41.104211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d62b99ce-b43b-4046-a8aa-05bb525cfd66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.158629 Nov 02 23:10:41.105246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 326/639] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:40 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:10:41.112455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-26113ddd-75ec-49da-a901-28df62d7f51f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:41.113463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-26113ddd-75ec-49da-a901-28df62d7f51f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:41.120511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26113ddd-75ec-49da-a901-28df62d7f51f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:41.120976 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26113ddd-75ec-49da-a901-28df62d7f51f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:41.121970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26113ddd-75ec-49da-a901-28df62d7f51f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:41.122447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26113ddd-75ec-49da-a901-28df62d7f51f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:41.125443 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-4218fed7-b878-4c2c-a305-754d73117298 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1522 microversion: 2.1 time: 0.219496 Nov 02 23:10:41.126684 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 314/640] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:40 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:41.253730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-26113ddd-75ec-49da-a901-28df62d7f51f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.146439 Nov 02 23:10:41.254390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 327/641] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:41 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:10:41.385448 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-16fdce12-cd11-4dd6-8ba1-4219638bbf20 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:41.386820 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-16fdce12-cd11-4dd6-8ba1-4219638bbf20 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 4c38d18d-608e-45d6-b13b-8e25b83023c9] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:41.395653 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-16fdce12-cd11-4dd6-8ba1-4219638bbf20 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:41.396105 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-16fdce12-cd11-4dd6-8ba1-4219638bbf20 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:41.396894 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-16fdce12-cd11-4dd6-8ba1-4219638bbf20 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:41.397329 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-16fdce12-cd11-4dd6-8ba1-4219638bbf20 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:41.414768 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.wsgi [None req-16fdce12-cd11-4dd6-8ba1-4219638bbf20 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] HTTP exception thrown: Instance 4c38d18d-608e-45d6-b13b-8e25b83023c9 could not be found. Nov 02 23:10:41.415590 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-16fdce12-cd11-4dd6-8ba1-4219638bbf20 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Returning 404 to user: Instance 4c38d18d-608e-45d6-b13b-8e25b83023c9 could not be found. {{(pid=115799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:10:41.416948 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-16fdce12-cd11-4dd6-8ba1-4219638bbf20 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9" status: 404 len: 111 microversion: 2.1 time: 0.038444 Nov 02 23:10:41.422583 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 315/642] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:41 2021] GET /compute/v2.1/servers/4c38d18d-608e-45d6-b13b-8e25b83023c9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 23:10:41.825917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-89a04d34-524b-4d5d-897b-9e02bb31c3a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:41.826681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-89a04d34-524b-4d5d-897b-9e02bb31c3a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:41.833707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-89a04d34-524b-4d5d-897b-9e02bb31c3a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:41.834145 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-89a04d34-524b-4d5d-897b-9e02bb31c3a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:41.834940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-89a04d34-524b-4d5d-897b-9e02bb31c3a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:41.835387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-89a04d34-524b-4d5d-897b-9e02bb31c3a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:41.859960 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [req-720060ad-240f-4f70-b061-4f8670b7a96b req-40f89c7c-5d0d-46c7-a06a-e141816038bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70df37d3-8cae-4366-a8c6-fc59e334cfd6", "tag": "ca582222-cb8c-4686-856e-ca98f5fa2458"}]} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:41.862437 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:10:41.862437 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: warnings.warn(msg) Nov 02 23:10:41.869757 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-720060ad-240f-4f70-b061-4f8670b7a96b req-40f89c7c-5d0d-46c7-a06a-e141816038bb service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:41.870323 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-720060ad-240f-4f70-b061-4f8670b7a96b req-40f89c7c-5d0d-46c7-a06a-e141816038bb service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:41.881973 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.compute.server_external_events [req-720060ad-240f-4f70-b061-4f8670b7a96b req-40f89c7c-5d0d-46c7-a06a-e141816038bb service nova] Creating event network-changed:ca582222-cb8c-4686-856e-ca98f5fa2458 for instance 70df37d3-8cae-4366-a8c6-fc59e334cfd6 on hv-cinder-81584 Nov 02 23:10:41.888587 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [req-720060ad-240f-4f70-b061-4f8670b7a96b req-40f89c7c-5d0d-46c7-a06a-e141816038bb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032278 Nov 02 23:10:41.889710 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 316/643] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:10:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:10:42.005605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-89a04d34-524b-4d5d-897b-9e02bb31c3a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:42.013680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-89a04d34-524b-4d5d-897b-9e02bb31c3a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1317 microversion: 2.1 time: 0.191582 Nov 02 23:10:42.014485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 328/644] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:41 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:42.118131 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-469fba64-b3d1-4b0f-afaa-5b87518bfc64 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:42.119197 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-469fba64-b3d1-4b0f-afaa-5b87518bfc64 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:42.125278 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-469fba64-b3d1-4b0f-afaa-5b87518bfc64 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:42.125721 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-469fba64-b3d1-4b0f-afaa-5b87518bfc64 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:42.126519 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-469fba64-b3d1-4b0f-afaa-5b87518bfc64 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:42.126963 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-469fba64-b3d1-4b0f-afaa-5b87518bfc64 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:42.143111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2840003a-74ae-4026-9d61-b4a6e2b55464 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:42.144152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2840003a-74ae-4026-9d61-b4a6e2b55464 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:42.150729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2840003a-74ae-4026-9d61-b4a6e2b55464 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:42.151339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2840003a-74ae-4026-9d61-b4a6e2b55464 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:42.152244 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2840003a-74ae-4026-9d61-b4a6e2b55464 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:42.152775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2840003a-74ae-4026-9d61-b4a6e2b55464 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:42.320592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2840003a-74ae-4026-9d61-b4a6e2b55464 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:42.327919 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2840003a-74ae-4026-9d61-b4a6e2b55464 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1522 microversion: 2.1 time: 0.189162 Nov 02 23:10:42.328508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 329/645] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:42 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:42.333558 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c4f1e530-0bc7-4483-9b65-2a249a8abb0c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:42.334450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c4f1e530-0bc7-4483-9b65-2a249a8abb0c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:42.339751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4f1e530-0bc7-4483-9b65-2a249a8abb0c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:42.340201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4f1e530-0bc7-4483-9b65-2a249a8abb0c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:42.340964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4f1e530-0bc7-4483-9b65-2a249a8abb0c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:42.341401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4f1e530-0bc7-4483-9b65-2a249a8abb0c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:43.747840 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:10:43.748328 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: Tue Nov 2 23:10:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action (ip 10.222.0.41) !!! Nov 02 23:10:44.975244 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c4f1e530-0bc7-4483-9b65-2a249a8abb0c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 2.645461 Nov 02 23:10:44.975887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 330/646] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:42 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 2647 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:10:44.980598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-232e14e3-8170-4767-a621-fe68cf6d50f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:44.981322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-232e14e3-8170-4767-a621-fe68cf6d50f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:44.988269 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-232e14e3-8170-4767-a621-fe68cf6d50f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:44.988719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-232e14e3-8170-4767-a621-fe68cf6d50f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:44.989524 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-232e14e3-8170-4767-a621-fe68cf6d50f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:44.989958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-232e14e3-8170-4767-a621-fe68cf6d50f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:45.118978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-232e14e3-8170-4767-a621-fe68cf6d50f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:45.126613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-232e14e3-8170-4767-a621-fe68cf6d50f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1317 microversion: 2.1 time: 0.149636 Nov 02 23:10:45.127212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 331/647] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:44 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:45.131380 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d5c1ca18-6015-4c9d-8828-0d6eeeb5ae3a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:45.131972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d5c1ca18-6015-4c9d-8828-0d6eeeb5ae3a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:45.137319 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d5c1ca18-6015-4c9d-8828-0d6eeeb5ae3a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:45.137761 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d5c1ca18-6015-4c9d-8828-0d6eeeb5ae3a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:45.138559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d5c1ca18-6015-4c9d-8828-0d6eeeb5ae3a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:45.139017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d5c1ca18-6015-4c9d-8828-0d6eeeb5ae3a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:45.265563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d5c1ca18-6015-4c9d-8828-0d6eeeb5ae3a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:45.273662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d5c1ca18-6015-4c9d-8828-0d6eeeb5ae3a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1522 microversion: 2.1 time: 0.145475 Nov 02 23:10:45.274271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 332/648] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:45 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:45.987426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1c5166aa-1486-485d-98a7-44f58f1630b2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:45.988247 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1c5166aa-1486-485d-98a7-44f58f1630b2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:45.995086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c5166aa-1486-485d-98a7-44f58f1630b2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:45.995532 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c5166aa-1486-485d-98a7-44f58f1630b2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:45.996299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c5166aa-1486-485d-98a7-44f58f1630b2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:45.996945 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c5166aa-1486-485d-98a7-44f58f1630b2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:46.477568 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-469fba64-b3d1-4b0f-afaa-5b87518bfc64 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 4.364334 Nov 02 23:10:46.478218 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 317/649] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:42 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 4366 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:10:46.483133 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a6c4e5ee-77f7-43f3-928d-ffd218eb8791 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:46.483820 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a6c4e5ee-77f7-43f3-928d-ffd218eb8791 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:46.492074 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a6c4e5ee-77f7-43f3-928d-ffd218eb8791 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:46.492522 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a6c4e5ee-77f7-43f3-928d-ffd218eb8791 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:46.493292 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a6c4e5ee-77f7-43f3-928d-ffd218eb8791 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:46.493724 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a6c4e5ee-77f7-43f3-928d-ffd218eb8791 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:46.542744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1c5166aa-1486-485d-98a7-44f58f1630b2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.558845 Nov 02 23:10:46.546686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 333/650] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:45 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:10:46.549213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d8806a38-bd25-43f7-809b-3b5f66fe463d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:46.551068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d8806a38-bd25-43f7-809b-3b5f66fe463d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:46.557687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8806a38-bd25-43f7-809b-3b5f66fe463d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:46.558380 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8806a38-bd25-43f7-809b-3b5f66fe463d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:46.559151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8806a38-bd25-43f7-809b-3b5f66fe463d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:46.559704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8806a38-bd25-43f7-809b-3b5f66fe463d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:46.629951 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-a6c4e5ee-77f7-43f3-928d-ffd218eb8791 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:46.637164 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a6c4e5ee-77f7-43f3-928d-ffd218eb8791 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1317 microversion: 2.1 time: 0.157839 Nov 02 23:10:46.637780 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 318/651] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:46 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:46.696430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d8806a38-bd25-43f7-809b-3b5f66fe463d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:46.703682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d8806a38-bd25-43f7-809b-3b5f66fe463d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1522 microversion: 2.1 time: 0.158900 Nov 02 23:10:46.704244 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 334/652] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:46 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:47.489331 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-edba4f2e-0c2f-4da9-a9d8-1e11b7b4cec4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:47.490293 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-edba4f2e-0c2f-4da9-a9d8-1e11b7b4cec4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:47.496806 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-edba4f2e-0c2f-4da9-a9d8-1e11b7b4cec4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:47.497261 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-edba4f2e-0c2f-4da9-a9d8-1e11b7b4cec4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:47.498078 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-edba4f2e-0c2f-4da9-a9d8-1e11b7b4cec4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:47.498504 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-edba4f2e-0c2f-4da9-a9d8-1e11b7b4cec4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:47.553704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-67263d49-8423-45ae-a6b1-b4dd3c7c0988 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:47.554637 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-67263d49-8423-45ae-a6b1-b4dd3c7c0988 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:47.561179 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67263d49-8423-45ae-a6b1-b4dd3c7c0988 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:47.561619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67263d49-8423-45ae-a6b1-b4dd3c7c0988 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:47.562383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67263d49-8423-45ae-a6b1-b4dd3c7c0988 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:47.562813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67263d49-8423-45ae-a6b1-b4dd3c7c0988 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:47.993787 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-edba4f2e-0c2f-4da9-a9d8-1e11b7b4cec4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.508054 Nov 02 23:10:47.994738 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 319/653] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:47 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:10:47.999782 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b3d7250f-1a36-4239-beb2-0892dc78a729 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:48.000483 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b3d7250f-1a36-4239-beb2-0892dc78a729 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:48.007141 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b3d7250f-1a36-4239-beb2-0892dc78a729 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:48.007578 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b3d7250f-1a36-4239-beb2-0892dc78a729 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:48.008337 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b3d7250f-1a36-4239-beb2-0892dc78a729 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:48.008759 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b3d7250f-1a36-4239-beb2-0892dc78a729 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:48.021026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-67263d49-8423-45ae-a6b1-b4dd3c7c0988 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.470883 Nov 02 23:10:48.021686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 335/654] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:47 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:10:48.027003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4be15570-6309-47a8-8d4f-20e7cb45adfb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:48.027845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4be15570-6309-47a8-8d4f-20e7cb45adfb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:48.035807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4be15570-6309-47a8-8d4f-20e7cb45adfb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:48.036245 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4be15570-6309-47a8-8d4f-20e7cb45adfb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:48.037230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4be15570-6309-47a8-8d4f-20e7cb45adfb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:48.037807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4be15570-6309-47a8-8d4f-20e7cb45adfb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:48.152248 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-b3d7250f-1a36-4239-beb2-0892dc78a729 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:48.160075 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b3d7250f-1a36-4239-beb2-0892dc78a729 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1317 microversion: 2.1 time: 0.163866 Nov 02 23:10:48.160651 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 320/655] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:47 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:48.184490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4be15570-6309-47a8-8d4f-20e7cb45adfb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:48.191881 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4be15570-6309-47a8-8d4f-20e7cb45adfb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1522 microversion: 2.1 time: 0.168829 Nov 02 23:10:48.192444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 336/656] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:48 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:49.006049 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e64fb319-6d1f-4661-8a14-f61cadd1a006 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:49.006988 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e64fb319-6d1f-4661-8a14-f61cadd1a006 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:49.013269 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e64fb319-6d1f-4661-8a14-f61cadd1a006 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:49.013709 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e64fb319-6d1f-4661-8a14-f61cadd1a006 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:49.014480 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e64fb319-6d1f-4661-8a14-f61cadd1a006 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:49.014910 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e64fb319-6d1f-4661-8a14-f61cadd1a006 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:49.033168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5f48958d-4688-4ff9-aac2-761aab1ddd0b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:49.033808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5f48958d-4688-4ff9-aac2-761aab1ddd0b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:49.040323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f48958d-4688-4ff9-aac2-761aab1ddd0b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:49.040982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f48958d-4688-4ff9-aac2-761aab1ddd0b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:49.041858 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f48958d-4688-4ff9-aac2-761aab1ddd0b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:49.042360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f48958d-4688-4ff9-aac2-761aab1ddd0b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:49.243501 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e64fb319-6d1f-4661-8a14-f61cadd1a006 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.241445 Nov 02 23:10:49.247602 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 321/657] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:49 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:10:49.249114 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e9e21a7c-8441-4847-8df6-69b735db9e8c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:49.249806 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e9e21a7c-8441-4847-8df6-69b735db9e8c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:49.257248 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e9e21a7c-8441-4847-8df6-69b735db9e8c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:49.257698 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e9e21a7c-8441-4847-8df6-69b735db9e8c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:49.258469 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e9e21a7c-8441-4847-8df6-69b735db9e8c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:49.258899 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e9e21a7c-8441-4847-8df6-69b735db9e8c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:49.295379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5f48958d-4688-4ff9-aac2-761aab1ddd0b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.261512 Nov 02 23:10:49.297755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 337/658] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:49 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:10:49.308304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e81c53a1-675e-421f-8bc8-e161a9ee2a66 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:49.309100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e81c53a1-675e-421f-8bc8-e161a9ee2a66 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:49.317097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e81c53a1-675e-421f-8bc8-e161a9ee2a66 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:49.317642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e81c53a1-675e-421f-8bc8-e161a9ee2a66 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:49.318496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e81c53a1-675e-421f-8bc8-e161a9ee2a66 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:49.319095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e81c53a1-675e-421f-8bc8-e161a9ee2a66 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:49.461717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e81c53a1-675e-421f-8bc8-e161a9ee2a66 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:49.469839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e81c53a1-675e-421f-8bc8-e161a9ee2a66 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1522 microversion: 2.1 time: 0.170621 Nov 02 23:10:49.470853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 338/659] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:49 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:49.622546 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e9e21a7c-8441-4847-8df6-69b735db9e8c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:49.630101 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e9e21a7c-8441-4847-8df6-69b735db9e8c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1317 microversion: 2.1 time: 0.384702 Nov 02 23:10:49.630685 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 322/660] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:49 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:50.255682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1c2a9faa-98f8-476a-a207-40e85e46ce54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:50.256604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1c2a9faa-98f8-476a-a207-40e85e46ce54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:50.262963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c2a9faa-98f8-476a-a207-40e85e46ce54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:50.263342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c2a9faa-98f8-476a-a207-40e85e46ce54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:50.264115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c2a9faa-98f8-476a-a207-40e85e46ce54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:50.264543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c2a9faa-98f8-476a-a207-40e85e46ce54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:50.307672 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-0ff4734d-a982-4b6d-aac4-0571d1b11745 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:50.308589 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-0ff4734d-a982-4b6d-aac4-0571d1b11745 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:50.315554 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0ff4734d-a982-4b6d-aac4-0571d1b11745 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:50.316003 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0ff4734d-a982-4b6d-aac4-0571d1b11745 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:50.316772 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0ff4734d-a982-4b6d-aac4-0571d1b11745 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:50.317195 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0ff4734d-a982-4b6d-aac4-0571d1b11745 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:54.499492 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1c2a9faa-98f8-476a-a207-40e85e46ce54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 4.247633 Nov 02 23:10:54.500427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 339/661] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:50 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 4250 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:10:54.506523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0eff1c6c-7111-44e3-b456-fe4501cbb83b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:54.507914 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0eff1c6c-7111-44e3-b456-fe4501cbb83b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:54.516290 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0eff1c6c-7111-44e3-b456-fe4501cbb83b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:54.517719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0eff1c6c-7111-44e3-b456-fe4501cbb83b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:54.518611 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-0ff4734d-a982-4b6d-aac4-0571d1b11745 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 4.214418 Nov 02 23:10:54.519563 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 323/662] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:50 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 4216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:10:54.519689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0eff1c6c-7111-44e3-b456-fe4501cbb83b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:54.520038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0eff1c6c-7111-44e3-b456-fe4501cbb83b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:54.527856 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-31186959-866f-4e04-9c2f-082c67b9e476 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:54.528756 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-31186959-866f-4e04-9c2f-082c67b9e476 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:54.537819 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-31186959-866f-4e04-9c2f-082c67b9e476 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:54.538518 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-31186959-866f-4e04-9c2f-082c67b9e476 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:54.539544 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-31186959-866f-4e04-9c2f-082c67b9e476 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:54.540138 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-31186959-866f-4e04-9c2f-082c67b9e476 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:54.760475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0eff1c6c-7111-44e3-b456-fe4501cbb83b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:54.769849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0eff1c6c-7111-44e3-b456-fe4501cbb83b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1522 microversion: 2.1 time: 0.267370 Nov 02 23:10:54.771610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 340/663] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:54 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:54.772525 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-31186959-866f-4e04-9c2f-082c67b9e476 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:54.781681 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-31186959-866f-4e04-9c2f-082c67b9e476 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1317 microversion: 2.1 time: 0.257755 Nov 02 23:10:54.787301 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 324/664] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:54 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:55.470757 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-130c3aee-4394-4fd3-83ca-c0ad1d233f55 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-844060867", "imageRef": "4159c567-fd66-4bbb-9bf4-6ce0afd65d88", "flavorRef": "452", "networks": [{"uuid": "fa6c611e-389b-49dc-91f7-c2d41021d5f6"}]}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:55.511453 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-5c88f752-6489-449c-881b-1548594f8b30 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:55.512677 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-5c88f752-6489-449c-881b-1548594f8b30 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:55.524303 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5c88f752-6489-449c-881b-1548594f8b30 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:55.527372 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5c88f752-6489-449c-881b-1548594f8b30 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:55.528389 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5c88f752-6489-449c-881b-1548594f8b30 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:55.531779 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5c88f752-6489-449c-881b-1548594f8b30 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:55.559820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.network.neutron [None req-130c3aee-4394-4fd3-83ca-c0ad1d233f55 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] validate_networks() for [('fa6c611e-389b-49dc-91f7-c2d41021d5f6', None, None, None, None, None)] {{(pid=115800) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 23:10:55.667204 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-5c88f752-6489-449c-881b-1548594f8b30 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.159204 Nov 02 23:10:55.668746 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 325/665] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:55 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:10:55.676844 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-75791dac-d66e-4182-a33b-5c4ac57be0a2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:55.678761 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-75791dac-d66e-4182-a33b-5c4ac57be0a2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:55.687094 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-75791dac-d66e-4182-a33b-5c4ac57be0a2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:55.687925 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-75791dac-d66e-4182-a33b-5c4ac57be0a2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:55.688966 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-75791dac-d66e-4182-a33b-5c4ac57be0a2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:55.690065 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-75791dac-d66e-4182-a33b-5c4ac57be0a2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:56.023233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-130c3aee-4394-4fd3-83ca-c0ad1d233f55 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Flavor limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 23:10:56.023908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-130c3aee-4394-4fd3-83ca-c0ad1d233f55 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Image limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 23:10:56.024555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-130c3aee-4394-4fd3-83ca-c0ad1d233f55 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Flavor pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 23:10:56.024967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-130c3aee-4394-4fd3-83ca-c0ad1d233f55 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Image pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 23:10:56.025388 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-130c3aee-4394-4fd3-83ca-c0ad1d233f55 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 23:10:56.038835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-130c3aee-4394-4fd3-83ca-c0ad1d233f55 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:56.039445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-130c3aee-4394-4fd3-83ca-c0ad1d233f55 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:56.040278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-130c3aee-4394-4fd3-83ca-c0ad1d233f55 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:56.040904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-130c3aee-4394-4fd3-83ca-c0ad1d233f55 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:56.060915 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-130c3aee-4394-4fd3-83ca-c0ad1d233f55 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Getting quotas for project 02de7621570a42e28e06ce65bd3b3000. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:10:56.065494 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-130c3aee-4394-4fd3-83ca-c0ad1d233f55 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Getting quotas for user 6b767694343c4a488f2ba0c19b62947e and project 02de7621570a42e28e06ce65bd3b3000. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:10:56.076842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-130c3aee-4394-4fd3-83ca-c0ad1d233f55 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Going to run 1 instances... {{(pid=115800) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 23:10:56.079582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-130c3aee-4394-4fd3-83ca-c0ad1d233f55 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4159c567-fd66-4bbb-9bf4-6ce0afd65d88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 23:10:56.128261 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-130c3aee-4394-4fd3-83ca-c0ad1d233f55 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662190 Nov 02 23:10:56.128814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 341/666] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 2 23:10:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 23:10:56.133472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a9f0d9fd-9b34-495a-852e-85690bf4b519 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:56.134084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a9f0d9fd-9b34-495a-852e-85690bf4b519 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:56.140261 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9f0d9fd-9b34-495a-852e-85690bf4b519 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:56.140926 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9f0d9fd-9b34-495a-852e-85690bf4b519 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:56.142445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9f0d9fd-9b34-495a-852e-85690bf4b519 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:56.143074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9f0d9fd-9b34-495a-852e-85690bf4b519 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:56.339242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a9f0d9fd-9b34-495a-852e-85690bf4b519 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:56.347339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a9f0d9fd-9b34-495a-852e-85690bf4b519 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1522 microversion: 2.1 time: 0.217136 Nov 02 23:10:56.356921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 342/667] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:56 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:56.356921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bd5eee89-ffbc-491e-b5d3-0174d57f6ff4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:56.356921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bd5eee89-ffbc-491e-b5d3-0174d57f6ff4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:56.361782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bd5eee89-ffbc-491e-b5d3-0174d57f6ff4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:56.362458 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bd5eee89-ffbc-491e-b5d3-0174d57f6ff4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:56.363964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bd5eee89-ffbc-491e-b5d3-0174d57f6ff4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:56.364669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bd5eee89-ffbc-491e-b5d3-0174d57f6ff4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:56.527293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bd5eee89-ffbc-491e-b5d3-0174d57f6ff4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:56.531884 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-75791dac-d66e-4182-a33b-5c4ac57be0a2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.861349 Nov 02 23:10:56.534170 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 326/668] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:55 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:10:56.541984 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b7677c97-655e-404a-ab44-11ffe570b86e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:56.542452 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bd5eee89-ffbc-491e-b5d3-0174d57f6ff4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1317 microversion: 2.1 time: 0.192096 Nov 02 23:10:56.542690 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b7677c97-655e-404a-ab44-11ffe570b86e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:56.543680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 343/669] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:56 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:56.679527 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-b7677c97-655e-404a-ab44-11ffe570b86e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:56.680029 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c4ed6697-8cd5-400e-b0b0-58e5afa87bf7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:56.681107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c4ed6697-8cd5-400e-b0b0-58e5afa87bf7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:56.688313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4ed6697-8cd5-400e-b0b0-58e5afa87bf7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:56.689136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4ed6697-8cd5-400e-b0b0-58e5afa87bf7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:56.690500 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b7677c97-655e-404a-ab44-11ffe570b86e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1218 microversion: 2.1 time: 0.154352 Nov 02 23:10:56.690816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4ed6697-8cd5-400e-b0b0-58e5afa87bf7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:56.691447 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 327/670] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:56 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1218 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:56.700567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4ed6697-8cd5-400e-b0b0-58e5afa87bf7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:56.932204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c4ed6697-8cd5-400e-b0b0-58e5afa87bf7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.255145 Nov 02 23:10:56.933449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 344/671] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:56 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:10:57.364676 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-abd9a073-565e-4f0f-a693-bc8ccc861462 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:57.365525 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-abd9a073-565e-4f0f-a693-bc8ccc861462 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:57.372476 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-abd9a073-565e-4f0f-a693-bc8ccc861462 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:57.373305 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-abd9a073-565e-4f0f-a693-bc8ccc861462 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:57.374844 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-abd9a073-565e-4f0f-a693-bc8ccc861462 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:57.375463 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-abd9a073-565e-4f0f-a693-bc8ccc861462 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:57.552924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d3a47c56-2ed8-409c-b468-34203e9f3399 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:57.558093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d3a47c56-2ed8-409c-b468-34203e9f3399 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:57.578333 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3a47c56-2ed8-409c-b468-34203e9f3399 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:57.579203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3a47c56-2ed8-409c-b468-34203e9f3399 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:57.580979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3a47c56-2ed8-409c-b468-34203e9f3399 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:57.581673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3a47c56-2ed8-409c-b468-34203e9f3399 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:57.766292 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-abd9a073-565e-4f0f-a693-bc8ccc861462 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:57.769556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d3a47c56-2ed8-409c-b468-34203e9f3399 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.220026 Nov 02 23:10:57.774072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 345/672] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:57 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:10:57.794337 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-abd9a073-565e-4f0f-a693-bc8ccc861462 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1522 microversion: 2.1 time: 0.433296 Nov 02 23:10:57.802192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f04f97c3-7191-4fe5-99f4-c632a839baff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:57.803767 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 328/673] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:57 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:57.805442 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f04f97c3-7191-4fe5-99f4-c632a839baff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:57.829998 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-7f50c68a-bba8-477f-8b75-b426b177ef68 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:57.831195 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-7f50c68a-bba8-477f-8b75-b426b177ef68 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:57.834608 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f04f97c3-7191-4fe5-99f4-c632a839baff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:57.836085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f04f97c3-7191-4fe5-99f4-c632a839baff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:57.847346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f04f97c3-7191-4fe5-99f4-c632a839baff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:57.848225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f04f97c3-7191-4fe5-99f4-c632a839baff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:57.854753 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7f50c68a-bba8-477f-8b75-b426b177ef68 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:57.857788 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7f50c68a-bba8-477f-8b75-b426b177ef68 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:57.859154 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7f50c68a-bba8-477f-8b75-b426b177ef68 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:57.860257 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7f50c68a-bba8-477f-8b75-b426b177ef68 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:58.031442 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-7f50c68a-bba8-477f-8b75-b426b177ef68 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:58.044262 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-7f50c68a-bba8-477f-8b75-b426b177ef68 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1288 microversion: 2.1 time: 0.236644 Nov 02 23:10:58.044920 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 329/674] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:57 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1288 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:58.058092 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f176f321-6b9d-4551-bb1b-e9c40a4b8628 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:58.058465 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f176f321-6b9d-4551-bb1b-e9c40a4b8628 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:58.076537 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f176f321-6b9d-4551-bb1b-e9c40a4b8628 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:58.077291 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f176f321-6b9d-4551-bb1b-e9c40a4b8628 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:58.078264 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f176f321-6b9d-4551-bb1b-e9c40a4b8628 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:58.078870 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f176f321-6b9d-4551-bb1b-e9c40a4b8628 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:58.230097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f04f97c3-7191-4fe5-99f4-c632a839baff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:58.240463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f04f97c3-7191-4fe5-99f4-c632a839baff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1317 microversion: 2.1 time: 0.462771 Nov 02 23:10:58.245075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 346/675] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:57 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:58.339028 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f176f321-6b9d-4551-bb1b-e9c40a4b8628 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.287143 Nov 02 23:10:58.339970 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 330/676] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:58 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:10:58.784092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d6e8b9f9-0663-424c-bd81-65636862e59b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:58.785175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d6e8b9f9-0663-424c-bd81-65636862e59b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:58.811114 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6e8b9f9-0663-424c-bd81-65636862e59b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:58.811854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6e8b9f9-0663-424c-bd81-65636862e59b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:58.819187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6e8b9f9-0663-424c-bd81-65636862e59b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:58.821445 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-8f5edc0e-5e0a-43d5-8a2f-5c5f7c7d490c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:58.822803 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-8f5edc0e-5e0a-43d5-8a2f-5c5f7c7d490c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:58.822994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6e8b9f9-0663-424c-bd81-65636862e59b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:58.832531 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8f5edc0e-5e0a-43d5-8a2f-5c5f7c7d490c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:58.844863 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8f5edc0e-5e0a-43d5-8a2f-5c5f7c7d490c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:58.846820 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8f5edc0e-5e0a-43d5-8a2f-5c5f7c7d490c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:58.847561 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8f5edc0e-5e0a-43d5-8a2f-5c5f7c7d490c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:59.034616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d6e8b9f9-0663-424c-bd81-65636862e59b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.253649 Nov 02 23:10:59.036152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 347/677] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:58 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:10:59.063093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-95fd8609-d78c-4324-b784-b0c69ae9b86e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:59.063910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-95fd8609-d78c-4324-b784-b0c69ae9b86e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:59.093735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-95fd8609-d78c-4324-b784-b0c69ae9b86e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:59.104534 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-95fd8609-d78c-4324-b784-b0c69ae9b86e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:59.105849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-95fd8609-d78c-4324-b784-b0c69ae9b86e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:59.114346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-95fd8609-d78c-4324-b784-b0c69ae9b86e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:59.366296 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-8f5edc0e-5e0a-43d5-8a2f-5c5f7c7d490c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:59.375056 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-8f5edc0e-5e0a-43d5-8a2f-5c5f7c7d490c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1502 microversion: 2.1 time: 0.557945 Nov 02 23:10:59.384491 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 331/678] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:58 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1502 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:10:59.398263 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-00065e69-8205-4365-a9d7-79ffd85f24d5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:10:59.404636 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-00065e69-8205-4365-a9d7-79ffd85f24d5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:59.432228 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-00065e69-8205-4365-a9d7-79ffd85f24d5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:59.438846 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-00065e69-8205-4365-a9d7-79ffd85f24d5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:59.444071 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-00065e69-8205-4365-a9d7-79ffd85f24d5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:59.445613 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-00065e69-8205-4365-a9d7-79ffd85f24d5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:59.643799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-95fd8609-d78c-4324-b784-b0c69ae9b86e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:59.665187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-95fd8609-d78c-4324-b784-b0c69ae9b86e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1318 microversion: 2.1 time: 0.603636 Nov 02 23:10:59.672712 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 348/679] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:59 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1318 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:10:59.676972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cdb8cfe1-68da-42a9-ac40-43381dab5d02 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:59.688329 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cdb8cfe1-68da-42a9-ac40-43381dab5d02 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:59.710519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cdb8cfe1-68da-42a9-ac40-43381dab5d02 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:59.711511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cdb8cfe1-68da-42a9-ac40-43381dab5d02 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:59.717033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cdb8cfe1-68da-42a9-ac40-43381dab5d02 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:59.717953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cdb8cfe1-68da-42a9-ac40-43381dab5d02 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:59.877466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cdb8cfe1-68da-42a9-ac40-43381dab5d02 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.207191 Nov 02 23:10:59.881051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 349/680] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:10:59 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:10:59.911355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6aa78eed-506a-4d6c-b1fa-b7130b73c23d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "430b9ec3-244b-4bca-a0eb-4130475b2d82"}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:10:59.919296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6aa78eed-506a-4d6c-b1fa-b7130b73c23d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:10:59.941927 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-00065e69-8205-4365-a9d7-79ffd85f24d5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:10:59.943648 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6aa78eed-506a-4d6c-b1fa-b7130b73c23d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:59.944915 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6aa78eed-506a-4d6c-b1fa-b7130b73c23d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:59.946045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6aa78eed-506a-4d6c-b1fa-b7130b73c23d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:10:59.946656 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6aa78eed-506a-4d6c-b1fa-b7130b73c23d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:10:59.992326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-6aa78eed-506a-4d6c-b1fa-b7130b73c23d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] HTTP exception thrown: Cannot 'attach_volume' instance e7bf8316-893d-4fad-b5f0-4ecad89120b3 while it is in vm_state rescued Nov 02 23:10:59.993397 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6aa78eed-506a-4d6c-b1fa-b7130b73c23d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Returning 409 to user: Cannot 'attach_volume' instance e7bf8316-893d-4fad-b5f0-4ecad89120b3 while it is in vm_state rescued {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:10:59.994489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6aa78eed-506a-4d6c-b1fa-b7130b73c23d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "POST /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.106884 Nov 02 23:10:59.995627 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 350/681] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 2 23:10:59 2021] POST /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 152 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 23:10:59.996558 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-00065e69-8205-4365-a9d7-79ffd85f24d5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1317 microversion: 2.1 time: 0.603092 Nov 02 23:10:59.997968 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 332/682] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:10:59 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1317 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:00.012066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5da5c598-875a-4b39-8d75-fc2d71556447 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:00.013399 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5da5c598-875a-4b39-8d75-fc2d71556447 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:00.032620 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5da5c598-875a-4b39-8d75-fc2d71556447 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:00.033855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5da5c598-875a-4b39-8d75-fc2d71556447 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:00.036771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5da5c598-875a-4b39-8d75-fc2d71556447 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:00.039688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5da5c598-875a-4b39-8d75-fc2d71556447 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:00.051542 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-4e647c98-6d76-4d31-a940-64ed9a39d374 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:00.056389 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-4e647c98-6d76-4d31-a940-64ed9a39d374 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:00.088942 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4e647c98-6d76-4d31-a940-64ed9a39d374 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:00.090625 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4e647c98-6d76-4d31-a940-64ed9a39d374 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:00.094745 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4e647c98-6d76-4d31-a940-64ed9a39d374 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:00.096465 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4e647c98-6d76-4d31-a940-64ed9a39d374 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:00.261059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5da5c598-875a-4b39-8d75-fc2d71556447 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "POST /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/action" status: 202 len: 0 microversion: 2.1 time: 0.259828 Nov 02 23:11:00.262094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 351/683] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:10:59 2021] POST /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:11:00.274879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-25f8093d-55f1-42b1-801c-2b04b7848ab6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:00.275621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-25f8093d-55f1-42b1-801c-2b04b7848ab6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:00.301229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25f8093d-55f1-42b1-801c-2b04b7848ab6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:00.303216 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25f8093d-55f1-42b1-801c-2b04b7848ab6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:00.305725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25f8093d-55f1-42b1-801c-2b04b7848ab6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:00.306246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25f8093d-55f1-42b1-801c-2b04b7848ab6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:00.328179 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-4e647c98-6d76-4d31-a940-64ed9a39d374 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.283642 Nov 02 23:11:00.332371 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 333/684] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:00 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:11:00.693509 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-48a85d31-d618-4ee9-8e13-8323a1287052 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:00.695635 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-48a85d31-d618-4ee9-8e13-8323a1287052 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:00.731906 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-48a85d31-d618-4ee9-8e13-8323a1287052 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:00.734069 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-48a85d31-d618-4ee9-8e13-8323a1287052 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:00.742682 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-48a85d31-d618-4ee9-8e13-8323a1287052 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:00.745169 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-48a85d31-d618-4ee9-8e13-8323a1287052 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:00.929371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-25f8093d-55f1-42b1-801c-2b04b7848ab6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:00.940222 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-25f8093d-55f1-42b1-801c-2b04b7848ab6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1510 microversion: 2.1 time: 0.672636 Nov 02 23:11:00.942973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 352/685] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:00 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1510 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:00.955245 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f3f15191-6725-45f3-b73e-5c22039dc9b6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:00.956856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f3f15191-6725-45f3-b73e-5c22039dc9b6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:00.978047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3f15191-6725-45f3-b73e-5c22039dc9b6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:00.978779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3f15191-6725-45f3-b73e-5c22039dc9b6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:00.980325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3f15191-6725-45f3-b73e-5c22039dc9b6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:00.981405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3f15191-6725-45f3-b73e-5c22039dc9b6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:01.134942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f3f15191-6725-45f3-b73e-5c22039dc9b6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.189830 Nov 02 23:11:01.137526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 353/686] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:00 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:11:01.146758 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1fecd8dd-7431-43fe-ac18-66eb386ad798 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:01.148004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1fecd8dd-7431-43fe-ac18-66eb386ad798 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:01.157103 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fecd8dd-7431-43fe-ac18-66eb386ad798 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:01.158339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fecd8dd-7431-43fe-ac18-66eb386ad798 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:01.159838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fecd8dd-7431-43fe-ac18-66eb386ad798 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:01.160478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fecd8dd-7431-43fe-ac18-66eb386ad798 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:01.320419 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-48a85d31-d618-4ee9-8e13-8323a1287052 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:01.328174 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-48a85d31-d618-4ee9-8e13-8323a1287052 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1318 microversion: 2.1 time: 0.646653 Nov 02 23:11:01.328767 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 334/687] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:00 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1318 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:11:01.342142 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [req-89713d6d-c238-4a27-ba3c-7a36f10ec5d3 req-eda1fe73-482d-4b83-9dda-119ff902f2dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21eb9b39-67de-489a-aa38-4f0b94947a68", "tag": "8c7d0507-2ba2-4059-80b8-14aa3f7ce582"}]} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:01.343821 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:11:01.343821 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: warnings.warn(msg) Nov 02 23:11:01.355519 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-89713d6d-c238-4a27-ba3c-7a36f10ec5d3 req-eda1fe73-482d-4b83-9dda-119ff902f2dd service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:01.355965 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-89713d6d-c238-4a27-ba3c-7a36f10ec5d3 req-eda1fe73-482d-4b83-9dda-119ff902f2dd service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:01.376021 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.compute.server_external_events [req-89713d6d-c238-4a27-ba3c-7a36f10ec5d3 req-eda1fe73-482d-4b83-9dda-119ff902f2dd service nova] Creating event network-changed:8c7d0507-2ba2-4059-80b8-14aa3f7ce582 for instance 21eb9b39-67de-489a-aa38-4f0b94947a68 on hv-cinder-81584 Nov 02 23:11:01.394942 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [req-89713d6d-c238-4a27-ba3c-7a36f10ec5d3 req-eda1fe73-482d-4b83-9dda-119ff902f2dd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064425 Nov 02 23:11:01.395874 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 335/688] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:11:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:11:01.419080 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [req-c9a3fc95-f60e-4cb8-9a1c-1f2444598e05 req-b8d8293d-739e-4f90-9bfd-717edbbefc48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70df37d3-8cae-4366-a8c6-fc59e334cfd6", "name": "network-vif-plugged", "status": "completed", "tag": "ca582222-cb8c-4686-856e-ca98f5fa2458"}]} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:01.423311 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:11:01.423311 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: warnings.warn(msg) Nov 02 23:11:01.443940 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-c9a3fc95-f60e-4cb8-9a1c-1f2444598e05 req-b8d8293d-739e-4f90-9bfd-717edbbefc48 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:01.444544 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-c9a3fc95-f60e-4cb8-9a1c-1f2444598e05 req-b8d8293d-739e-4f90-9bfd-717edbbefc48 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:01.478302 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.compute.server_external_events [req-c9a3fc95-f60e-4cb8-9a1c-1f2444598e05 req-b8d8293d-739e-4f90-9bfd-717edbbefc48 service nova] Creating event network-vif-plugged:ca582222-cb8c-4686-856e-ca98f5fa2458 for instance 70df37d3-8cae-4366-a8c6-fc59e334cfd6 on hv-cinder-81584 Nov 02 23:11:01.489658 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [req-c9a3fc95-f60e-4cb8-9a1c-1f2444598e05 req-b8d8293d-739e-4f90-9bfd-717edbbefc48 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087239 Nov 02 23:11:01.490343 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 336/689] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:11:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:11:01.502418 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-04482121-4827-4484-a399-6f483dda52fb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:01.504181 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-04482121-4827-4484-a399-6f483dda52fb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:01.507529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1fecd8dd-7431-43fe-ac18-66eb386ad798 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:01.514507 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-04482121-4827-4484-a399-6f483dda52fb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:01.515258 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-04482121-4827-4484-a399-6f483dda52fb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:01.516214 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-04482121-4827-4484-a399-6f483dda52fb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:01.516338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1fecd8dd-7431-43fe-ac18-66eb386ad798 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1317 microversion: 2.1 time: 0.376378 Nov 02 23:11:01.517614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 354/690] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:01 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:01.518051 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-04482121-4827-4484-a399-6f483dda52fb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:01.698761 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-04482121-4827-4484-a399-6f483dda52fb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.206863 Nov 02 23:11:01.701765 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 337/691] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:01 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:11:01.958658 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f58a51aa-c385-4385-82e2-65e3b68b2678 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:01.959324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f58a51aa-c385-4385-82e2-65e3b68b2678 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:01.981408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f58a51aa-c385-4385-82e2-65e3b68b2678 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:01.983355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f58a51aa-c385-4385-82e2-65e3b68b2678 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:01.984467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f58a51aa-c385-4385-82e2-65e3b68b2678 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:01.985226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f58a51aa-c385-4385-82e2-65e3b68b2678 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:02.148743 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e9dd4f01-e7e9-4d23-8567-e8d0d11495ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:02.149923 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e9dd4f01-e7e9-4d23-8567-e8d0d11495ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:02.158886 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e9dd4f01-e7e9-4d23-8567-e8d0d11495ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:02.160472 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e9dd4f01-e7e9-4d23-8567-e8d0d11495ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:02.161877 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e9dd4f01-e7e9-4d23-8567-e8d0d11495ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:02.162547 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e9dd4f01-e7e9-4d23-8567-e8d0d11495ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:02.216614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f58a51aa-c385-4385-82e2-65e3b68b2678 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:02.226013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f58a51aa-c385-4385-82e2-65e3b68b2678 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1510 microversion: 2.1 time: 0.271974 Nov 02 23:11:02.227298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 355/692] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:01 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1510 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:11:02.348810 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-eeac201b-7c32-40f5-b661-dde3837d212c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:02.349425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-eeac201b-7c32-40f5-b661-dde3837d212c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:02.355864 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eeac201b-7c32-40f5-b661-dde3837d212c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:02.356307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eeac201b-7c32-40f5-b661-dde3837d212c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:02.357122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eeac201b-7c32-40f5-b661-dde3837d212c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:02.357552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eeac201b-7c32-40f5-b661-dde3837d212c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:02.519881 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-eeac201b-7c32-40f5-b661-dde3837d212c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:02.528348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-eeac201b-7c32-40f5-b661-dde3837d212c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1318 microversion: 2.1 time: 0.185670 Nov 02 23:11:02.553147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 356/693] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:02 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:02.568139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-01a6d291-cf39-4b1e-8932-1880726a52b1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:02.568864 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-01a6d291-cf39-4b1e-8932-1880726a52b1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:02.579605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-01a6d291-cf39-4b1e-8932-1880726a52b1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:02.580123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-01a6d291-cf39-4b1e-8932-1880726a52b1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:02.580913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-01a6d291-cf39-4b1e-8932-1880726a52b1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:02.581340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-01a6d291-cf39-4b1e-8932-1880726a52b1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:02.776005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-01a6d291-cf39-4b1e-8932-1880726a52b1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:02.785690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-01a6d291-cf39-4b1e-8932-1880726a52b1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1317 microversion: 2.1 time: 0.220459 Nov 02 23:11:02.786762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 357/694] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:02 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:02.794452 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-00a7137e-9e6c-430e-a7b5-ac31fc8cab6e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:02.796437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-00a7137e-9e6c-430e-a7b5-ac31fc8cab6e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:02.808222 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-00a7137e-9e6c-430e-a7b5-ac31fc8cab6e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:02.808997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-00a7137e-9e6c-430e-a7b5-ac31fc8cab6e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:02.809877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-00a7137e-9e6c-430e-a7b5-ac31fc8cab6e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:02.811363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-00a7137e-9e6c-430e-a7b5-ac31fc8cab6e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:03.274154 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e9dd4f01-e7e9-4d23-8567-e8d0d11495ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 1.129343 Nov 02 23:11:03.275579 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 338/695] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:02 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:11:03.280973 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-cfc16b76-b3cb-4304-9673-dc9cb5c9aeac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:03.281660 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-cfc16b76-b3cb-4304-9673-dc9cb5c9aeac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:03.291121 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cfc16b76-b3cb-4304-9673-dc9cb5c9aeac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:03.291882 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cfc16b76-b3cb-4304-9673-dc9cb5c9aeac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:03.292864 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cfc16b76-b3cb-4304-9673-dc9cb5c9aeac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:03.293300 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cfc16b76-b3cb-4304-9673-dc9cb5c9aeac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:03.483617 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-cfc16b76-b3cb-4304-9673-dc9cb5c9aeac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:03.493395 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-cfc16b76-b3cb-4304-9673-dc9cb5c9aeac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1510 microversion: 2.1 time: 0.215091 Nov 02 23:11:03.494213 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 339/696] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:03 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1510 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:03.545565 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-362bef15-9f89-4cca-9034-7731485ba103 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:03.546412 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-362bef15-9f89-4cca-9034-7731485ba103 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:03.562372 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-362bef15-9f89-4cca-9034-7731485ba103 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:03.562960 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-362bef15-9f89-4cca-9034-7731485ba103 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:03.564371 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-362bef15-9f89-4cca-9034-7731485ba103 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:03.564836 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-362bef15-9f89-4cca-9034-7731485ba103 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:03.802646 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-362bef15-9f89-4cca-9034-7731485ba103 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:03.812613 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-362bef15-9f89-4cca-9034-7731485ba103 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1318 microversion: 2.1 time: 0.270674 Nov 02 23:11:03.815580 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 340/697] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:03 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:11:03.820964 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-0fffc8a2-f425-4c1e-a71a-5bb2119a1a89 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:03.823531 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-0fffc8a2-f425-4c1e-a71a-5bb2119a1a89 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:03.830991 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0fffc8a2-f425-4c1e-a71a-5bb2119a1a89 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:03.831758 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0fffc8a2-f425-4c1e-a71a-5bb2119a1a89 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:03.832771 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0fffc8a2-f425-4c1e-a71a-5bb2119a1a89 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:03.833409 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0fffc8a2-f425-4c1e-a71a-5bb2119a1a89 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:03.914391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-00a7137e-9e6c-430e-a7b5-ac31fc8cab6e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 1.126148 Nov 02 23:11:03.916057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 358/698] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:02 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:11:04.019028 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-0fffc8a2-f425-4c1e-a71a-5bb2119a1a89 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:04.028343 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-0fffc8a2-f425-4c1e-a71a-5bb2119a1a89 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1317 microversion: 2.1 time: 0.211060 Nov 02 23:11:04.036332 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 341/699] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:03 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:04.287649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5a5607d2-9d67-4c96-9bf6-78f4206b5c94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:04.288811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5a5607d2-9d67-4c96-9bf6-78f4206b5c94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:04.301258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a5607d2-9d67-4c96-9bf6-78f4206b5c94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:04.302027 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a5607d2-9d67-4c96-9bf6-78f4206b5c94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:04.305196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a5607d2-9d67-4c96-9bf6-78f4206b5c94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:04.305618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a5607d2-9d67-4c96-9bf6-78f4206b5c94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:04.513514 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d330b876-45b9-4580-8e51-28ae9fee2780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:04.514127 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d330b876-45b9-4580-8e51-28ae9fee2780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:04.527647 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d330b876-45b9-4580-8e51-28ae9fee2780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:04.532267 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d330b876-45b9-4580-8e51-28ae9fee2780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:04.533166 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d330b876-45b9-4580-8e51-28ae9fee2780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:04.533787 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d330b876-45b9-4580-8e51-28ae9fee2780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:04.597491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5a5607d2-9d67-4c96-9bf6-78f4206b5c94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.314974 Nov 02 23:11:04.602042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 359/700] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:04 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:11:04.758839 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-d330b876-45b9-4580-8e51-28ae9fee2780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:04.768896 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d330b876-45b9-4580-8e51-28ae9fee2780 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1510 microversion: 2.1 time: 0.260157 Nov 02 23:11:04.781279 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 342/701] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:04 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1510 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:04.836508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-25bc336b-723c-4d6b-9943-3f7c53690858 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:04.837645 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-25bc336b-723c-4d6b-9943-3f7c53690858 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:04.862162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25bc336b-723c-4d6b-9943-3f7c53690858 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:04.866504 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25bc336b-723c-4d6b-9943-3f7c53690858 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:04.867964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25bc336b-723c-4d6b-9943-3f7c53690858 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:04.871341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25bc336b-723c-4d6b-9943-3f7c53690858 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:04.929168 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-1521a955-83cd-484d-a71d-df1514ac58cb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:04.931156 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-1521a955-83cd-484d-a71d-df1514ac58cb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:04.939364 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1521a955-83cd-484d-a71d-df1514ac58cb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:04.942304 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1521a955-83cd-484d-a71d-df1514ac58cb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:04.943705 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1521a955-83cd-484d-a71d-df1514ac58cb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:04.944298 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1521a955-83cd-484d-a71d-df1514ac58cb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:05.098456 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-25bc336b-723c-4d6b-9943-3f7c53690858 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:05.114278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-25bc336b-723c-4d6b-9943-3f7c53690858 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1318 microversion: 2.1 time: 0.285497 Nov 02 23:11:05.123677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 360/702] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:04 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:05.123677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7bdfa6e8-53e0-42ff-a559-447b866f74e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:05.123677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7bdfa6e8-53e0-42ff-a559-447b866f74e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:05.130362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7bdfa6e8-53e0-42ff-a559-447b866f74e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:05.131100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7bdfa6e8-53e0-42ff-a559-447b866f74e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:05.132178 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7bdfa6e8-53e0-42ff-a559-447b866f74e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:05.132817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7bdfa6e8-53e0-42ff-a559-447b866f74e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:05.183122 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-1521a955-83cd-484d-a71d-df1514ac58cb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.257980 Nov 02 23:11:05.184029 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 343/703] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:04 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:11:05.378146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7bdfa6e8-53e0-42ff-a559-447b866f74e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:05.385037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7bdfa6e8-53e0-42ff-a559-447b866f74e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1317 microversion: 2.1 time: 0.268617 Nov 02 23:11:05.395237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 361/704] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:05 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:05.613144 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-5af355a0-1d50-4549-b959-8705578aca19 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:05.615162 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-5af355a0-1d50-4549-b959-8705578aca19 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:05.649751 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5af355a0-1d50-4549-b959-8705578aca19 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:05.651167 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5af355a0-1d50-4549-b959-8705578aca19 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:05.652852 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5af355a0-1d50-4549-b959-8705578aca19 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:05.653689 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5af355a0-1d50-4549-b959-8705578aca19 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:05.787341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3fbdc6c6-e445-4371-83b8-e460d4e04f17 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:05.788050 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3fbdc6c6-e445-4371-83b8-e460d4e04f17 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:05.797324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fbdc6c6-e445-4371-83b8-e460d4e04f17 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:05.799053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fbdc6c6-e445-4371-83b8-e460d4e04f17 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:05.802515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fbdc6c6-e445-4371-83b8-e460d4e04f17 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:05.803288 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fbdc6c6-e445-4371-83b8-e460d4e04f17 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:05.900662 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-5af355a0-1d50-4549-b959-8705578aca19 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.294619 Nov 02 23:11:05.901314 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 344/705] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:05 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:11:05.986897 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3fbdc6c6-e445-4371-83b8-e460d4e04f17 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:05.998108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3fbdc6c6-e445-4371-83b8-e460d4e04f17 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1510 microversion: 2.1 time: 0.214378 Nov 02 23:11:05.998976 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 362/706] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:05 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1510 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:06.133005 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ef75803a-282d-46e2-bade-7bfbcdd28ef7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:06.134006 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ef75803a-282d-46e2-bade-7bfbcdd28ef7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:06.142341 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ef75803a-282d-46e2-bade-7bfbcdd28ef7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:06.143090 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ef75803a-282d-46e2-bade-7bfbcdd28ef7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:06.144048 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ef75803a-282d-46e2-bade-7bfbcdd28ef7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:06.144651 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ef75803a-282d-46e2-bade-7bfbcdd28ef7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:06.194972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2669d717-e0eb-4be7-9002-1922e5b54af2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:06.198824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2669d717-e0eb-4be7-9002-1922e5b54af2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:06.206754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2669d717-e0eb-4be7-9002-1922e5b54af2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:06.207571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2669d717-e0eb-4be7-9002-1922e5b54af2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:06.208613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2669d717-e0eb-4be7-9002-1922e5b54af2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:06.209211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2669d717-e0eb-4be7-9002-1922e5b54af2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:06.334127 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-ef75803a-282d-46e2-bade-7bfbcdd28ef7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:06.342152 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ef75803a-282d-46e2-bade-7bfbcdd28ef7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1318 microversion: 2.1 time: 0.213851 Nov 02 23:11:06.352489 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 345/707] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:06 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:06.391959 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2669d717-e0eb-4be7-9002-1922e5b54af2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.200443 Nov 02 23:11:06.394073 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 363/708] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:06 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:11:06.403321 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-9200c0aa-7919-4c01-a8b4-5f47c83e614e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:06.404011 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-9200c0aa-7919-4c01-a8b4-5f47c83e614e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:06.411536 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9200c0aa-7919-4c01-a8b4-5f47c83e614e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:06.412113 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9200c0aa-7919-4c01-a8b4-5f47c83e614e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:06.413167 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9200c0aa-7919-4c01-a8b4-5f47c83e614e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:06.413665 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9200c0aa-7919-4c01-a8b4-5f47c83e614e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:06.604613 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-9200c0aa-7919-4c01-a8b4-5f47c83e614e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:06.614252 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-9200c0aa-7919-4c01-a8b4-5f47c83e614e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1506 microversion: 2.1 time: 0.214794 Nov 02 23:11:06.614943 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 346/709] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:06 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:11:06.918321 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2101ebb8-8616-4626-ad15-6205025d2373 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:06.921117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2101ebb8-8616-4626-ad15-6205025d2373 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:06.950966 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2101ebb8-8616-4626-ad15-6205025d2373 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:06.951814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2101ebb8-8616-4626-ad15-6205025d2373 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:06.952664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2101ebb8-8616-4626-ad15-6205025d2373 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:06.953106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2101ebb8-8616-4626-ad15-6205025d2373 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:07.021480 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ff699cdd-985d-43fe-876a-7957402b13ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:07.023642 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ff699cdd-985d-43fe-876a-7957402b13ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:07.031012 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ff699cdd-985d-43fe-876a-7957402b13ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:07.031790 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ff699cdd-985d-43fe-876a-7957402b13ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:07.033444 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ff699cdd-985d-43fe-876a-7957402b13ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:07.033899 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ff699cdd-985d-43fe-876a-7957402b13ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:07.106784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2101ebb8-8616-4626-ad15-6205025d2373 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.196734 Nov 02 23:11:07.112541 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 364/710] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:06 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:11:07.245267 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-ff699cdd-985d-43fe-876a-7957402b13ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:07.256412 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ff699cdd-985d-43fe-876a-7957402b13ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1510 microversion: 2.1 time: 0.239741 Nov 02 23:11:07.263015 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 347/711] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:07 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1510 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:11:07.363218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4b4af696-5e57-4885-b6e0-556c91176379 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:07.364205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4b4af696-5e57-4885-b6e0-556c91176379 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:07.377852 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b4af696-5e57-4885-b6e0-556c91176379 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:07.378553 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b4af696-5e57-4885-b6e0-556c91176379 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:07.380073 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b4af696-5e57-4885-b6e0-556c91176379 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:07.380805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b4af696-5e57-4885-b6e0-556c91176379 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:07.407135 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-4f3fe490-511f-4a71-8da0-78f4e22444f4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:07.409745 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-4f3fe490-511f-4a71-8da0-78f4e22444f4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:07.430901 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4f3fe490-511f-4a71-8da0-78f4e22444f4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:07.431613 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4f3fe490-511f-4a71-8da0-78f4e22444f4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:07.433073 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4f3fe490-511f-4a71-8da0-78f4e22444f4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:07.433907 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4f3fe490-511f-4a71-8da0-78f4e22444f4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:07.599850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4b4af696-5e57-4885-b6e0-556c91176379 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:07.612353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4b4af696-5e57-4885-b6e0-556c91176379 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1318 microversion: 2.1 time: 0.255044 Nov 02 23:11:07.627393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 365/712] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:07 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:11:07.695071 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-4f3fe490-511f-4a71-8da0-78f4e22444f4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.294123 Nov 02 23:11:07.697886 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 348/713] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:07 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:11:08.123427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ec985ee9-5cee-4c9d-be05-af5688688bc7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:08.125889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ec985ee9-5cee-4c9d-be05-af5688688bc7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:08.136748 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec985ee9-5cee-4c9d-be05-af5688688bc7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:08.137477 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec985ee9-5cee-4c9d-be05-af5688688bc7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:08.139031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec985ee9-5cee-4c9d-be05-af5688688bc7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:08.139727 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec985ee9-5cee-4c9d-be05-af5688688bc7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:08.281741 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-9a36e431-7dd4-4095-8f09-393bd1d209ab tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:08.283463 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-9a36e431-7dd4-4095-8f09-393bd1d209ab tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:08.295467 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9a36e431-7dd4-4095-8f09-393bd1d209ab tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:08.296150 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9a36e431-7dd4-4095-8f09-393bd1d209ab tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:08.297267 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9a36e431-7dd4-4095-8f09-393bd1d209ab tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:08.298514 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9a36e431-7dd4-4095-8f09-393bd1d209ab tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:08.351921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ec985ee9-5cee-4c9d-be05-af5688688bc7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.234319 Nov 02 23:11:08.353764 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 366/714] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:08 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:11:08.584829 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-9a36e431-7dd4-4095-8f09-393bd1d209ab tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:08.596970 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-9a36e431-7dd4-4095-8f09-393bd1d209ab tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1510 microversion: 2.1 time: 0.321412 Nov 02 23:11:08.612598 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 349/715] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:08 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1510 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:08.641298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5ad73459-94da-497f-aafd-5d6736c46f53 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:08.643063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5ad73459-94da-497f-aafd-5d6736c46f53 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:08.657034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ad73459-94da-497f-aafd-5d6736c46f53 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:08.657034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ad73459-94da-497f-aafd-5d6736c46f53 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:08.658514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ad73459-94da-497f-aafd-5d6736c46f53 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:08.659328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ad73459-94da-497f-aafd-5d6736c46f53 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:08.714118 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-8b249d09-fbd4-4dd0-870d-c0b4a8caa871 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:08.715936 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-8b249d09-fbd4-4dd0-870d-c0b4a8caa871 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:08.739936 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8b249d09-fbd4-4dd0-870d-c0b4a8caa871 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:08.740744 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8b249d09-fbd4-4dd0-870d-c0b4a8caa871 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:08.742229 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8b249d09-fbd4-4dd0-870d-c0b4a8caa871 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:08.746050 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8b249d09-fbd4-4dd0-870d-c0b4a8caa871 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:08.906801 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-8b249d09-fbd4-4dd0-870d-c0b4a8caa871 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.199224 Nov 02 23:11:08.913087 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 350/716] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:08 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:11:09.004295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5ad73459-94da-497f-aafd-5d6736c46f53 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:09.024894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5ad73459-94da-497f-aafd-5d6736c46f53 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1318 microversion: 2.1 time: 0.391520 Nov 02 23:11:09.026130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 367/717] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:08 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:09.196792 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b9642f2d-b18a-465e-9621-6cbe1b04177b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2532b37-cc1f-4abb-bd29-db5446ec2d50"}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:09.199322 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b9642f2d-b18a-465e-9621-6cbe1b04177b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:09.217057 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b9642f2d-b18a-465e-9621-6cbe1b04177b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:09.218131 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b9642f2d-b18a-465e-9621-6cbe1b04177b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:09.220269 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b9642f2d-b18a-465e-9621-6cbe1b04177b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:09.221148 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b9642f2d-b18a-465e-9621-6cbe1b04177b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:09.371078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-58337ffe-56b8-4f50-b1d2-0aa3455dfdfe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:09.373312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-58337ffe-56b8-4f50-b1d2-0aa3455dfdfe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:09.386323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58337ffe-56b8-4f50-b1d2-0aa3455dfdfe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:09.387024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58337ffe-56b8-4f50-b1d2-0aa3455dfdfe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:09.388925 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58337ffe-56b8-4f50-b1d2-0aa3455dfdfe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:09.389700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58337ffe-56b8-4f50-b1d2-0aa3455dfdfe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:09.681359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-58337ffe-56b8-4f50-b1d2-0aa3455dfdfe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.317443 Nov 02 23:11:09.691417 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 368/718] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:09 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:11:09.702054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0860c299-e1e4-4abc-a4ef-479b548ff386 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:09.703733 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0860c299-e1e4-4abc-a4ef-479b548ff386 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:09.716609 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0860c299-e1e4-4abc-a4ef-479b548ff386 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:09.716609 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0860c299-e1e4-4abc-a4ef-479b548ff386 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:09.717470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0860c299-e1e4-4abc-a4ef-479b548ff386 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:09.718526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0860c299-e1e4-4abc-a4ef-479b548ff386 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:09.764835 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b9642f2d-b18a-465e-9621-6cbe1b04177b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "POST /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.575231 Nov 02 23:11:09.766182 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 351/719] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 2 23:11:09 2021] POST /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 194 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:11:09.931203 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-849b4898-28ee-4d5e-ba85-6df6313144fc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:09.939760 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-849b4898-28ee-4d5e-ba85-6df6313144fc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:09.964267 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-849b4898-28ee-4d5e-ba85-6df6313144fc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:09.969200 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-849b4898-28ee-4d5e-ba85-6df6313144fc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:09.971804 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-849b4898-28ee-4d5e-ba85-6df6313144fc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:09.975670 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-849b4898-28ee-4d5e-ba85-6df6313144fc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:10.032241 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0860c299-e1e4-4abc-a4ef-479b548ff386 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:10.041491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0860c299-e1e4-4abc-a4ef-479b548ff386 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1516 microversion: 2.1 time: 0.348177 Nov 02 23:11:10.042486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 369/720] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:09 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1516 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:10.048061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-29190acc-aa55-4dca-925d-b77826cc405d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:10.049259 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-29190acc-aa55-4dca-925d-b77826cc405d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:10.060311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-29190acc-aa55-4dca-925d-b77826cc405d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:10.061099 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-29190acc-aa55-4dca-925d-b77826cc405d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:10.062079 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-29190acc-aa55-4dca-925d-b77826cc405d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:10.062679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-29190acc-aa55-4dca-925d-b77826cc405d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:10.185072 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-849b4898-28ee-4d5e-ba85-6df6313144fc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.265569 Nov 02 23:11:10.186527 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 352/721] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:09 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:11:10.283533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-29190acc-aa55-4dca-925d-b77826cc405d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:10.296144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-29190acc-aa55-4dca-925d-b77826cc405d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1318 microversion: 2.1 time: 0.251952 Nov 02 23:11:10.298278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 370/722] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:10 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:10.698350 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-241e8011-87c2-47f9-a70b-bf449bd1da3c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:10.699904 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-241e8011-87c2-47f9-a70b-bf449bd1da3c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:10.707993 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-241e8011-87c2-47f9-a70b-bf449bd1da3c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:10.708512 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-241e8011-87c2-47f9-a70b-bf449bd1da3c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:10.710276 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-241e8011-87c2-47f9-a70b-bf449bd1da3c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:10.711052 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-241e8011-87c2-47f9-a70b-bf449bd1da3c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:10.841209 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-241e8011-87c2-47f9-a70b-bf449bd1da3c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.146891 Nov 02 23:11:10.842947 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 353/723] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:10 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:11:11.208298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-19507c60-d64f-44bb-a2da-157b853afa68 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:11.211935 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-19507c60-d64f-44bb-a2da-157b853afa68 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:11.224835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19507c60-d64f-44bb-a2da-157b853afa68 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:11.225440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19507c60-d64f-44bb-a2da-157b853afa68 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:11.226245 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19507c60-d64f-44bb-a2da-157b853afa68 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:11.226714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19507c60-d64f-44bb-a2da-157b853afa68 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:11.316982 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-181b8146-01c0-48ec-85a5-4a59b92bd52c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:11.317779 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-181b8146-01c0-48ec-85a5-4a59b92bd52c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:11.326322 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-181b8146-01c0-48ec-85a5-4a59b92bd52c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:11.326770 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-181b8146-01c0-48ec-85a5-4a59b92bd52c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:11.327653 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-181b8146-01c0-48ec-85a5-4a59b92bd52c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:11.328231 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-181b8146-01c0-48ec-85a5-4a59b92bd52c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:11.483030 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-181b8146-01c0-48ec-85a5-4a59b92bd52c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:11.491480 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-19507c60-d64f-44bb-a2da-157b853afa68 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.295478 Nov 02 23:11:11.492262 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-181b8146-01c0-48ec-85a5-4a59b92bd52c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1318 microversion: 2.1 time: 0.180595 Nov 02 23:11:11.492856 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 354/724] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:11 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:11.493263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 371/725] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:11 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:11:11.854823 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-384151a0-c3a7-4833-a1d8-ef777ce5a36d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:11.856929 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-384151a0-c3a7-4833-a1d8-ef777ce5a36d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:11.866340 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-384151a0-c3a7-4833-a1d8-ef777ce5a36d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:11.866839 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-384151a0-c3a7-4833-a1d8-ef777ce5a36d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:11.867923 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-384151a0-c3a7-4833-a1d8-ef777ce5a36d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:11.868519 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-384151a0-c3a7-4833-a1d8-ef777ce5a36d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:12.027468 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-384151a0-c3a7-4833-a1d8-ef777ce5a36d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.176336 Nov 02 23:11:12.032211 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 355/726] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:11 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:11:12.523428 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e9ab8fe0-1b95-4860-9de9-b7e529e5ca27 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:12.527264 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-2678ae37-7938-494c-b33b-b9ae4c28c6d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:12.530355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e9ab8fe0-1b95-4860-9de9-b7e529e5ca27 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:12.531707 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-2678ae37-7938-494c-b33b-b9ae4c28c6d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:12.548828 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2678ae37-7938-494c-b33b-b9ae4c28c6d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:12.549819 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2678ae37-7938-494c-b33b-b9ae4c28c6d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:12.550981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9ab8fe0-1b95-4860-9de9-b7e529e5ca27 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:12.551766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9ab8fe0-1b95-4860-9de9-b7e529e5ca27 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:12.552835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9ab8fe0-1b95-4860-9de9-b7e529e5ca27 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:12.553082 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2678ae37-7938-494c-b33b-b9ae4c28c6d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:12.553742 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2678ae37-7938-494c-b33b-b9ae4c28c6d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:12.554549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9ab8fe0-1b95-4860-9de9-b7e529e5ca27 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:12.711503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e9ab8fe0-1b95-4860-9de9-b7e529e5ca27 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.202919 Nov 02 23:11:12.713190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 372/727] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:12 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:11:12.721358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ea1cd771-90ad-4fe8-a1f5-754ae1fe7960 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:12.725947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ea1cd771-90ad-4fe8-a1f5-754ae1fe7960 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:12.745791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea1cd771-90ad-4fe8-a1f5-754ae1fe7960 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:12.747161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea1cd771-90ad-4fe8-a1f5-754ae1fe7960 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:12.748287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea1cd771-90ad-4fe8-a1f5-754ae1fe7960 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:12.753497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea1cd771-90ad-4fe8-a1f5-754ae1fe7960 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:12.890413 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-2678ae37-7938-494c-b33b-b9ae4c28c6d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:12.903170 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-2678ae37-7938-494c-b33b-b9ae4c28c6d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1318 microversion: 2.1 time: 0.395322 Nov 02 23:11:12.917124 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 356/728] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:12 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:12.927384 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [req-30d7a18d-e5dc-4090-9b94-1941071c64d0 req-72a92727-f4c9-401b-af40-83a6a31cbe5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21eb9b39-67de-489a-aa38-4f0b94947a68", "name": "network-vif-plugged", "status": "completed", "tag": "8c7d0507-2ba2-4059-80b8-14aa3f7ce582"}]} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:12.933479 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:11:12.933479 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: warnings.warn(msg) Nov 02 23:11:12.934088 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ea1cd771-90ad-4fe8-a1f5-754ae1fe7960 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:12.944261 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ea1cd771-90ad-4fe8-a1f5-754ae1fe7960 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1516 microversion: 2.1 time: 0.229361 Nov 02 23:11:12.945107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 373/729] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:12 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:12.960059 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-30d7a18d-e5dc-4090-9b94-1941071c64d0 req-72a92727-f4c9-401b-af40-83a6a31cbe5f service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:12.960839 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [req-30d7a18d-e5dc-4090-9b94-1941071c64d0 req-72a92727-f4c9-401b-af40-83a6a31cbe5f service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:12.962772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7c2dbb67-7dee-4274-bb25-a4a1ce78707e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "178679d2-46b2-4e2b-a4c0-7a57a8bcad3a"}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:12.964173 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7c2dbb67-7dee-4274-bb25-a4a1ce78707e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:12.975233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7c2dbb67-7dee-4274-bb25-a4a1ce78707e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:12.976851 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.compute.server_external_events [req-30d7a18d-e5dc-4090-9b94-1941071c64d0 req-72a92727-f4c9-401b-af40-83a6a31cbe5f service nova] Creating event network-vif-plugged:8c7d0507-2ba2-4059-80b8-14aa3f7ce582 for instance 21eb9b39-67de-489a-aa38-4f0b94947a68 on hv-cinder-81584 Nov 02 23:11:12.978407 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7c2dbb67-7dee-4274-bb25-a4a1ce78707e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:12.982289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7c2dbb67-7dee-4274-bb25-a4a1ce78707e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:12.983405 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [req-30d7a18d-e5dc-4090-9b94-1941071c64d0 req-72a92727-f4c9-401b-af40-83a6a31cbe5f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064064 Nov 02 23:11:12.985005 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 357/730] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:11:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:11:12.996192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7c2dbb67-7dee-4274-bb25-a4a1ce78707e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:13.045829 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-81a1a577-a762-4dfd-8708-b6bb764e0179 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:13.046567 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-81a1a577-a762-4dfd-8708-b6bb764e0179 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:13.061103 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-81a1a577-a762-4dfd-8708-b6bb764e0179 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:13.061828 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-81a1a577-a762-4dfd-8708-b6bb764e0179 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:13.062866 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-81a1a577-a762-4dfd-8708-b6bb764e0179 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:13.063389 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-81a1a577-a762-4dfd-8708-b6bb764e0179 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:13.190237 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-81a1a577-a762-4dfd-8708-b6bb764e0179 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.150537 Nov 02 23:11:13.191187 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 358/731] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:13 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:11:13.483944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7c2dbb67-7dee-4274-bb25-a4a1ce78707e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "POST /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.525005 Nov 02 23:11:13.484650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 374/732] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 2 23:11:12 2021] POST /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 194 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:11:13.723966 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b5b53d0c-b02a-456e-8f67-bdad6b571e99 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:13.725151 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b5b53d0c-b02a-456e-8f67-bdad6b571e99 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:13.732731 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b5b53d0c-b02a-456e-8f67-bdad6b571e99 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:13.733263 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b5b53d0c-b02a-456e-8f67-bdad6b571e99 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:13.734121 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b5b53d0c-b02a-456e-8f67-bdad6b571e99 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:13.734555 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b5b53d0c-b02a-456e-8f67-bdad6b571e99 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:13.922571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-446b96b6-45ac-4143-a912-a27cb49b2385 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:13.923287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-446b96b6-45ac-4143-a912-a27cb49b2385 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:13.929869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-446b96b6-45ac-4143-a912-a27cb49b2385 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:13.930306 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-446b96b6-45ac-4143-a912-a27cb49b2385 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:13.931124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-446b96b6-45ac-4143-a912-a27cb49b2385 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:13.931557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-446b96b6-45ac-4143-a912-a27cb49b2385 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:14.102108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-446b96b6-45ac-4143-a912-a27cb49b2385 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:14.109636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-446b96b6-45ac-4143-a912-a27cb49b2385 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1318 microversion: 2.1 time: 0.191903 Nov 02 23:11:14.110940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 375/733] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:13 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:14.115216 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e6cea80f-e8f1-4daf-9dff-3dfa52e22a07 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Action: 'create', calling method: .version_select at 0x7fd858329430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1720955239"}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:14.132470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-e6cea80f-e8f1-4daf-9dff-3dfa52e22a07 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Getting quotas for project 26cae71da96545c8b527cdec8f41fdb1. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:11:14.136213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-e6cea80f-e8f1-4daf-9dff-3dfa52e22a07 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Getting quotas for user 6c3e66db1e6e4d65a151470af0fd6615 and project 26cae71da96545c8b527cdec8f41fdb1. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:11:14.286248 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b5b53d0c-b02a-456e-8f67-bdad6b571e99 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.566137 Nov 02 23:11:14.287565 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 359/734] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:13 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:11:14.292775 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-bbab1bdb-38f0-413e-bebb-5b19d1c584dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:14.293772 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-bbab1bdb-38f0-413e-bebb-5b19d1c584dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:14.301515 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bbab1bdb-38f0-413e-bebb-5b19d1c584dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:14.301969 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bbab1bdb-38f0-413e-bebb-5b19d1c584dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:14.302761 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bbab1bdb-38f0-413e-bebb-5b19d1c584dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:14.303218 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bbab1bdb-38f0-413e-bebb-5b19d1c584dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:14.397699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-e6cea80f-e8f1-4daf-9dff-3dfa52e22a07 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Getting quotas for project 26cae71da96545c8b527cdec8f41fdb1. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:11:14.401370 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-e6cea80f-e8f1-4daf-9dff-3dfa52e22a07 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Getting quotas for user 6c3e66db1e6e4d65a151470af0fd6615 and project 26cae71da96545c8b527cdec8f41fdb1. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:11:14.415807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e6cea80f-e8f1-4daf-9dff-3dfa52e22a07 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.303835 Nov 02 23:11:14.416582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 376/735] 10.222.0.41 () {60 vars in 1157 bytes} [Tue Nov 2 23:11:14 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:14.459328 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-bbab1bdb-38f0-413e-bebb-5b19d1c584dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.170144 Nov 02 23:11:14.464759 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 360/736] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:14 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:11:14.470610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7a5c634a-803d-4c97-9e4d-39cc40435d3c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2123941673", "imageRef": "12bf318c-6953-402e-8c9d-7ea4d26aaabe", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1720955239", "networks": [{"uuid": "085ca18e-e69d-42dd-b5fe-ad3e46e1f7ae"}]}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:14.529922 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.network.neutron [None req-7a5c634a-803d-4c97-9e4d-39cc40435d3c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] validate_networks() for [('085ca18e-e69d-42dd-b5fe-ad3e46e1f7ae', None, None, None, None, None)] {{(pid=115800) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 23:11:14.911964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-7a5c634a-803d-4c97-9e4d-39cc40435d3c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Flavor limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 23:11:14.912586 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-7a5c634a-803d-4c97-9e4d-39cc40435d3c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Image limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 23:11:14.913101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-7a5c634a-803d-4c97-9e4d-39cc40435d3c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Flavor pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 23:11:14.913548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-7a5c634a-803d-4c97-9e4d-39cc40435d3c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Image pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 23:11:14.914000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-7a5c634a-803d-4c97-9e4d-39cc40435d3c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 23:11:14.923111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7a5c634a-803d-4c97-9e4d-39cc40435d3c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:14.923818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7a5c634a-803d-4c97-9e4d-39cc40435d3c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:14.924347 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7a5c634a-803d-4c97-9e4d-39cc40435d3c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:14.924780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7a5c634a-803d-4c97-9e4d-39cc40435d3c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:14.941196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-7a5c634a-803d-4c97-9e4d-39cc40435d3c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Getting quotas for project 26cae71da96545c8b527cdec8f41fdb1. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:11:14.945196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-7a5c634a-803d-4c97-9e4d-39cc40435d3c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Getting quotas for user 6c3e66db1e6e4d65a151470af0fd6615 and project 26cae71da96545c8b527cdec8f41fdb1. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:11:14.957112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7a5c634a-803d-4c97-9e4d-39cc40435d3c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Going to run 1 instances... {{(pid=115800) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 23:11:14.959408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7a5c634a-803d-4c97-9e4d-39cc40435d3c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12bf318c-6953-402e-8c9d-7ea4d26aaabe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 23:11:15.008729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7a5c634a-803d-4c97-9e4d-39cc40435d3c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542545 Nov 02 23:11:15.008729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 377/737] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 2 23:11:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 23:11:15.025506 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-7f5845ce-e48d-49c9-bf7d-9095ee1809b4 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:15.026964 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-7f5845ce-e48d-49c9-bf7d-9095ee1809b4 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:15.094248 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-7f5845ce-e48d-49c9-bf7d-9095ee1809b4 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e66db1e6e4d65a151470af0fd6615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cae71da96545c8b527cdec8f41fdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:15.106333 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-7f5845ce-e48d-49c9-bf7d-9095ee1809b4 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 200 len: 1259 microversion: 2.1 time: 0.088583 Nov 02 23:11:15.107355 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 361/738] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:15 2021] GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 1259 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:15.136551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a4cd5c7f-6025-44c0-8290-64d14b8db6df tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:15.136962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a4cd5c7f-6025-44c0-8290-64d14b8db6df tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:15.143836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a4cd5c7f-6025-44c0-8290-64d14b8db6df tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:15.144474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a4cd5c7f-6025-44c0-8290-64d14b8db6df tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:15.145264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a4cd5c7f-6025-44c0-8290-64d14b8db6df tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:15.145841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a4cd5c7f-6025-44c0-8290-64d14b8db6df tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:15.299388 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a4cd5c7f-6025-44c0-8290-64d14b8db6df tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:15.302150 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-28ccc0e0-4dbf-4106-b7bc-76bc22ad1adf tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:15.304040 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-28ccc0e0-4dbf-4106-b7bc-76bc22ad1adf tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:15.307385 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a4cd5c7f-6025-44c0-8290-64d14b8db6df tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1318 microversion: 2.1 time: 0.175283 Nov 02 23:11:15.308398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 378/739] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:15 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:11:15.312752 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-28ccc0e0-4dbf-4106-b7bc-76bc22ad1adf tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:15.313346 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-28ccc0e0-4dbf-4106-b7bc-76bc22ad1adf tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:15.314238 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-28ccc0e0-4dbf-4106-b7bc-76bc22ad1adf tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:15.314776 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-28ccc0e0-4dbf-4106-b7bc-76bc22ad1adf tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:15.427121 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-28ccc0e0-4dbf-4106-b7bc-76bc22ad1adf tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.131859 Nov 02 23:11:15.433088 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 362/740] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:15 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:11:15.472129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9daffd42-222b-45cc-823a-c37934421bf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:15.473212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9daffd42-222b-45cc-823a-c37934421bf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:15.479959 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9daffd42-222b-45cc-823a-c37934421bf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:15.480419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9daffd42-222b-45cc-823a-c37934421bf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:15.481181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9daffd42-222b-45cc-823a-c37934421bf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:15.481615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9daffd42-222b-45cc-823a-c37934421bf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:15.601341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9daffd42-222b-45cc-823a-c37934421bf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.133504 Nov 02 23:11:15.601916 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 379/741] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:15 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:11:16.131338 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-296fe5b1-7ced-4c81-9597-d07517454225 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:16.132033 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-296fe5b1-7ced-4c81-9597-d07517454225 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:16.138815 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-296fe5b1-7ced-4c81-9597-d07517454225 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:16.139300 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-296fe5b1-7ced-4c81-9597-d07517454225 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:16.140101 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-296fe5b1-7ced-4c81-9597-d07517454225 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:16.140529 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-296fe5b1-7ced-4c81-9597-d07517454225 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:16.203303 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-296fe5b1-7ced-4c81-9597-d07517454225 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e66db1e6e4d65a151470af0fd6615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cae71da96545c8b527cdec8f41fdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:16.211713 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-296fe5b1-7ced-4c81-9597-d07517454225 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 200 len: 1311 microversion: 2.1 time: 0.084384 Nov 02 23:11:16.212282 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 363/742] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:16 2021] GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 1311 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:16.324581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-98f4e34f-e59f-4bb0-927e-ba037f2b88a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:16.325264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-98f4e34f-e59f-4bb0-927e-ba037f2b88a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:16.333532 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98f4e34f-e59f-4bb0-927e-ba037f2b88a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:16.333970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98f4e34f-e59f-4bb0-927e-ba037f2b88a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:16.334739 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98f4e34f-e59f-4bb0-927e-ba037f2b88a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:16.335194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98f4e34f-e59f-4bb0-927e-ba037f2b88a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:16.441591 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-49a463eb-e5dc-4dc3-83aa-e130c69f01c6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:16.442517 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-49a463eb-e5dc-4dc3-83aa-e130c69f01c6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:16.449551 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-49a463eb-e5dc-4dc3-83aa-e130c69f01c6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:16.450032 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-49a463eb-e5dc-4dc3-83aa-e130c69f01c6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:16.451075 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-49a463eb-e5dc-4dc3-83aa-e130c69f01c6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:16.451511 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-49a463eb-e5dc-4dc3-83aa-e130c69f01c6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:16.482281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-98f4e34f-e59f-4bb0-927e-ba037f2b88a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:16.494236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-98f4e34f-e59f-4bb0-927e-ba037f2b88a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1508 microversion: 2.1 time: 0.173636 Nov 02 23:11:16.494898 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 380/743] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:16 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:16.510859 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-93ef3850-7acc-4823-b04b-bddfa648f6d4 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2fb37f5-345f-4638-aa9d-a3907f81cec4", "device": "/dev/sdb"}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:16.511972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-93ef3850-7acc-4823-b04b-bddfa648f6d4 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:16.517852 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93ef3850-7acc-4823-b04b-bddfa648f6d4 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:16.518298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93ef3850-7acc-4823-b04b-bddfa648f6d4 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:16.519097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93ef3850-7acc-4823-b04b-bddfa648f6d4 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:16.519688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93ef3850-7acc-4823-b04b-bddfa648f6d4 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:16.597517 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-49a463eb-e5dc-4dc3-83aa-e130c69f01c6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 28621 microversion: 2.1 time: 0.160058 Nov 02 23:11:16.598160 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 364/744] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:16 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 28621 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:11:16.615992 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-09813203-b437-4fd0-abe6-47e4a60018fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:16.617106 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-09813203-b437-4fd0-abe6-47e4a60018fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:16.627694 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-09813203-b437-4fd0-abe6-47e4a60018fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:16.628263 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-09813203-b437-4fd0-abe6-47e4a60018fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:16.630001 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-09813203-b437-4fd0-abe6-47e4a60018fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:16.630671 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-09813203-b437-4fd0-abe6-47e4a60018fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:16.775197 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-09813203-b437-4fd0-abe6-47e4a60018fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 28630 microversion: 2.20 time: 0.165457 Nov 02 23:11:16.775961 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 365/745] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:16 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 28630 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:11:16.880791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-93ef3850-7acc-4823-b04b-bddfa648f6d4 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "POST /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372928 Nov 02 23:11:16.886525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 381/746] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 2 23:11:16 2021] POST /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:11:17.234309 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-50461996-d036-44f6-844f-c4364830b216 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:17.235175 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-50461996-d036-44f6-844f-c4364830b216 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:17.244760 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-50461996-d036-44f6-844f-c4364830b216 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:17.245597 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-50461996-d036-44f6-844f-c4364830b216 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:17.246614 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-50461996-d036-44f6-844f-c4364830b216 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:17.247292 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-50461996-d036-44f6-844f-c4364830b216 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:17.535559 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-50461996-d036-44f6-844f-c4364830b216 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e66db1e6e4d65a151470af0fd6615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cae71da96545c8b527cdec8f41fdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:17.554640 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-50461996-d036-44f6-844f-c4364830b216 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 200 len: 1359 microversion: 2.1 time: 0.329608 Nov 02 23:11:17.566380 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 366/747] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:17 2021] GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 1359 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:17.612388 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-87af8a9f-972d-41e4-a489-d7fcc91b7f68 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:17.613370 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-87af8a9f-972d-41e4-a489-d7fcc91b7f68 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:17.619579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87af8a9f-972d-41e4-a489-d7fcc91b7f68 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:17.620021 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87af8a9f-972d-41e4-a489-d7fcc91b7f68 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:17.620791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87af8a9f-972d-41e4-a489-d7fcc91b7f68 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:17.621220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87af8a9f-972d-41e4-a489-d7fcc91b7f68 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:17.787040 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-29879aa0-67a0-439c-b72d-2563ac253da9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:17.787962 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-29879aa0-67a0-439c-b72d-2563ac253da9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:17.794016 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-29879aa0-67a0-439c-b72d-2563ac253da9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:17.794461 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-29879aa0-67a0-439c-b72d-2563ac253da9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:17.795331 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-29879aa0-67a0-439c-b72d-2563ac253da9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:17.795762 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-29879aa0-67a0-439c-b72d-2563ac253da9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:42.455924 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-29879aa0-67a0-439c-b72d-2563ac253da9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 33115 microversion: 2.20 time: 24.672377 Nov 02 23:11:42.460431 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 367/748] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:17 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 33115 bytes in 24678 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:11:42.465809 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-96738a86-d6fd-4719-bd31-1f5693d95e79 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:42.466515 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-96738a86-d6fd-4719-bd31-1f5693d95e79 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:42.474650 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-96738a86-d6fd-4719-bd31-1f5693d95e79 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:42.475141 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-96738a86-d6fd-4719-bd31-1f5693d95e79 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:42.475982 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-96738a86-d6fd-4719-bd31-1f5693d95e79 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:42.476406 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-96738a86-d6fd-4719-bd31-1f5693d95e79 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:42.520760 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-87af8a9f-972d-41e4-a489-d7fcc91b7f68 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 33290 microversion: 2.1 time: 24.912500 Nov 02 23:11:42.527138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 382/749] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:17 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 33290 bytes in 24920 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:11:42.661783 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-96738a86-d6fd-4719-bd31-1f5693d95e79 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e66db1e6e4d65a151470af0fd6615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cae71da96545c8b527cdec8f41fdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:42.673750 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-96738a86-d6fd-4719-bd31-1f5693d95e79 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 200 len: 1359 microversion: 2.1 time: 0.211929 Nov 02 23:11:42.686270 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 368/750] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:42 2021] GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:43.276150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-74e48306-f588-4cc2-9e08-781f1b9dfbe4 req-ece10d26-907f-4df2-8caf-2af31505e8aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd3c0a6-a083-498f-af1d-564f9e455712", "tag": "1a56d8fd-f9cb-4bd2-adbb-88916a2de5a4"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:43.278240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:11:43.278240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:11:43.296258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-74e48306-f588-4cc2-9e08-781f1b9dfbe4 req-ece10d26-907f-4df2-8caf-2af31505e8aa service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:43.296627 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-74e48306-f588-4cc2-9e08-781f1b9dfbe4 req-ece10d26-907f-4df2-8caf-2af31505e8aa service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:43.319562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-74e48306-f588-4cc2-9e08-781f1b9dfbe4 req-ece10d26-907f-4df2-8caf-2af31505e8aa service nova] Creating event network-changed:1a56d8fd-f9cb-4bd2-adbb-88916a2de5a4 for instance 3cd3c0a6-a083-498f-af1d-564f9e455712 on hv-cinder-81584 Nov 02 23:11:43.330399 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-74e48306-f588-4cc2-9e08-781f1b9dfbe4 req-ece10d26-907f-4df2-8caf-2af31505e8aa service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059518 Nov 02 23:11:43.332047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 383/751] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:11:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:11:43.468470 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-83d39a48-19cd-477f-82f2-d2812c6f4766 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:43.469379 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-83d39a48-19cd-477f-82f2-d2812c6f4766 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:43.475685 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-83d39a48-19cd-477f-82f2-d2812c6f4766 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:43.476125 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-83d39a48-19cd-477f-82f2-d2812c6f4766 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:43.476884 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-83d39a48-19cd-477f-82f2-d2812c6f4766 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:43.477307 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-83d39a48-19cd-477f-82f2-d2812c6f4766 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:43.535200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-97858664-2cc4-4187-b5c7-7fe7f7e61fff tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:43.536237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-97858664-2cc4-4187-b5c7-7fe7f7e61fff tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:43.542767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-97858664-2cc4-4187-b5c7-7fe7f7e61fff tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:43.543489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-97858664-2cc4-4187-b5c7-7fe7f7e61fff tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:43.544813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-97858664-2cc4-4187-b5c7-7fe7f7e61fff tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:43.544813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-97858664-2cc4-4187-b5c7-7fe7f7e61fff tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:43.777921 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-83d39a48-19cd-477f-82f2-d2812c6f4766 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 33591 microversion: 2.20 time: 0.313396 Nov 02 23:11:43.779025 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 369/752] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:43 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 33591 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:11:43.784155 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a0b616ac-179c-465a-badb-02758dc9f30c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:43.785061 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a0b616ac-179c-465a-badb-02758dc9f30c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:43.792837 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a0b616ac-179c-465a-badb-02758dc9f30c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:43.793406 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a0b616ac-179c-465a-badb-02758dc9f30c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:43.794462 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a0b616ac-179c-465a-badb-02758dc9f30c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:43.795151 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a0b616ac-179c-465a-badb-02758dc9f30c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:43.837828 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-97858664-2cc4-4187-b5c7-7fe7f7e61fff tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 34022 microversion: 2.1 time: 0.307079 Nov 02 23:11:43.839455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 384/753] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:43 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 34022 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:11:43.930415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-60dd91f5-a9ce-4cac-aa3c-9113b7ad15c9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:43.931025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-60dd91f5-a9ce-4cac-aa3c-9113b7ad15c9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:43.937710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-60dd91f5-a9ce-4cac-aa3c-9113b7ad15c9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:43.938375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-60dd91f5-a9ce-4cac-aa3c-9113b7ad15c9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:43.939203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-60dd91f5-a9ce-4cac-aa3c-9113b7ad15c9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:43.939641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-60dd91f5-a9ce-4cac-aa3c-9113b7ad15c9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:43.982089 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-a0b616ac-179c-465a-badb-02758dc9f30c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e66db1e6e4d65a151470af0fd6615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cae71da96545c8b527cdec8f41fdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:43.990223 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a0b616ac-179c-465a-badb-02758dc9f30c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 200 len: 1359 microversion: 2.1 time: 0.210178 Nov 02 23:11:43.990814 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 370/754] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:43 2021] GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:44.023801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.objects.instance [None req-60dd91f5-a9ce-4cac-aa3c-9113b7ad15c9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lazy-loading 'services' on Instance uuid 70df37d3-8cae-4366-a8c6-fc59e334cfd6 {{(pid=115800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 23:11:44.101115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-60dd91f5-a9ce-4cac-aa3c-9113b7ad15c9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "DELETE /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments/a2532b37-cc1f-4abb-bd29-db5446ec2d50" status: 202 len: 0 microversion: 2.1 time: 0.174564 Nov 02 23:11:44.101728 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 385/755] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 2 23:11:43 2021] DELETE /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments/a2532b37-cc1f-4abb-bd29-db5446ec2d50 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:11:44.116773 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-98d2652d-4909-4ed0-9d08-7024a7832434 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:44.118764 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-98d2652d-4909-4ed0-9d08-7024a7832434 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:44.129999 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-98d2652d-4909-4ed0-9d08-7024a7832434 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:44.131077 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-98d2652d-4909-4ed0-9d08-7024a7832434 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:44.132424 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-98d2652d-4909-4ed0-9d08-7024a7832434 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:44.133060 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-98d2652d-4909-4ed0-9d08-7024a7832434 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:44.164789 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-98d2652d-4909-4ed0-9d08-7024a7832434 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058138 Nov 02 23:11:44.165814 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 371/756] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:11:44 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:11:44.790248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e61d22b8-4fee-4de8-be55-9d2898f17afd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:44.791318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e61d22b8-4fee-4de8-be55-9d2898f17afd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:44.798491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e61d22b8-4fee-4de8-be55-9d2898f17afd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:44.798948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e61d22b8-4fee-4de8-be55-9d2898f17afd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:44.799722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e61d22b8-4fee-4de8-be55-9d2898f17afd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:44.800182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e61d22b8-4fee-4de8-be55-9d2898f17afd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:44.850717 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-bd52a379-0951-4029-91e0-b1891c456923 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:44.851655 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-bd52a379-0951-4029-91e0-b1891c456923 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:44.857928 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bd52a379-0951-4029-91e0-b1891c456923 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:44.858378 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bd52a379-0951-4029-91e0-b1891c456923 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:44.859221 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bd52a379-0951-4029-91e0-b1891c456923 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:44.860195 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bd52a379-0951-4029-91e0-b1891c456923 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:45.353253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e61d22b8-4fee-4de8-be55-9d2898f17afd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 34649 microversion: 2.20 time: 0.566922 Nov 02 23:11:45.353905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 386/757] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:44 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 34649 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:11:45.358662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2fe1c5dc-f07e-4ddd-ab31-7fa1d20faa60 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:45.359994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2fe1c5dc-f07e-4ddd-ab31-7fa1d20faa60 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:45.366944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2fe1c5dc-f07e-4ddd-ab31-7fa1d20faa60 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:45.367363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2fe1c5dc-f07e-4ddd-ab31-7fa1d20faa60 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:45.368133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2fe1c5dc-f07e-4ddd-ab31-7fa1d20faa60 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:45.368562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2fe1c5dc-f07e-4ddd-ab31-7fa1d20faa60 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:45.405674 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-bd52a379-0951-4029-91e0-b1891c456923 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 34977 microversion: 2.1 time: 0.558407 Nov 02 23:11:45.407646 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 372/758] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:44 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 34977 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:11:45.413040 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ec286f88-8692-43b6-962a-6b26cb80306b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:45.414065 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ec286f88-8692-43b6-962a-6b26cb80306b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:45.421183 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ec286f88-8692-43b6-962a-6b26cb80306b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:45.421709 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ec286f88-8692-43b6-962a-6b26cb80306b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:45.422942 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ec286f88-8692-43b6-962a-6b26cb80306b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:45.423451 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ec286f88-8692-43b6-962a-6b26cb80306b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:45.455373 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ec286f88-8692-43b6-962a-6b26cb80306b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046267 Nov 02 23:11:45.455950 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 373/759] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:11:45 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:11:45.508489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2fe1c5dc-f07e-4ddd-ab31-7fa1d20faa60 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e66db1e6e4d65a151470af0fd6615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cae71da96545c8b527cdec8f41fdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:45.515929 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2fe1c5dc-f07e-4ddd-ab31-7fa1d20faa60 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 200 len: 1359 microversion: 2.1 time: 0.160913 Nov 02 23:11:45.516509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 387/760] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:45 2021] GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:46.365754 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-272dde2d-bf23-499b-b8cc-bb6f4302ef83 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:46.366664 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-272dde2d-bf23-499b-b8cc-bb6f4302ef83 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:46.373324 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-272dde2d-bf23-499b-b8cc-bb6f4302ef83 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:46.373784 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-272dde2d-bf23-499b-b8cc-bb6f4302ef83 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:46.374566 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-272dde2d-bf23-499b-b8cc-bb6f4302ef83 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:46.375042 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-272dde2d-bf23-499b-b8cc-bb6f4302ef83 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:46.418103 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fae73ab7-1fe2-4ca0-93ac-a30ee75d5557 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:46.419064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fae73ab7-1fe2-4ca0-93ac-a30ee75d5557 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:46.425481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fae73ab7-1fe2-4ca0-93ac-a30ee75d5557 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:46.425932 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fae73ab7-1fe2-4ca0-93ac-a30ee75d5557 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:46.426710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fae73ab7-1fe2-4ca0-93ac-a30ee75d5557 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:46.427177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fae73ab7-1fe2-4ca0-93ac-a30ee75d5557 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:46.603982 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-272dde2d-bf23-499b-b8cc-bb6f4302ef83 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 35451 microversion: 2.20 time: 0.241762 Nov 02 23:11:46.604943 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 374/761] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:46 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 35451 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:11:46.609681 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ea68dac0-dc56-4ffb-a6cc-13f0fd0888ac tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:46.610675 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ea68dac0-dc56-4ffb-a6cc-13f0fd0888ac tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:46.617553 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ea68dac0-dc56-4ffb-a6cc-13f0fd0888ac tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:46.617997 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ea68dac0-dc56-4ffb-a6cc-13f0fd0888ac tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:46.618783 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ea68dac0-dc56-4ffb-a6cc-13f0fd0888ac tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:46.619238 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ea68dac0-dc56-4ffb-a6cc-13f0fd0888ac tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:46.652595 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ea68dac0-dc56-4ffb-a6cc-13f0fd0888ac tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046698 Nov 02 23:11:46.657113 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 375/762] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:11:46 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:11:46.658337 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-75627001-ed40-43ce-824f-a42990c761e2 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:46.658975 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-75627001-ed40-43ce-824f-a42990c761e2 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:46.664788 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-75627001-ed40-43ce-824f-a42990c761e2 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:46.665265 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-75627001-ed40-43ce-824f-a42990c761e2 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:46.666046 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-75627001-ed40-43ce-824f-a42990c761e2 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:46.666482 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-75627001-ed40-43ce-824f-a42990c761e2 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:46.703633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fae73ab7-1fe2-4ca0-93ac-a30ee75d5557 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 35908 microversion: 2.1 time: 0.288368 Nov 02 23:11:46.705022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 388/763] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:46 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 35908 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:11:46.816235 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-75627001-ed40-43ce-824f-a42990c761e2 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e66db1e6e4d65a151470af0fd6615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cae71da96545c8b527cdec8f41fdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:46.823779 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-75627001-ed40-43ce-824f-a42990c761e2 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 200 len: 1359 microversion: 2.1 time: 0.169676 Nov 02 23:11:46.824382 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 376/764] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:46 2021] GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:47.389893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cd03bb47-9fee-4c83-bb71-dfc247f7736b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:47.391462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cd03bb47-9fee-4c83-bb71-dfc247f7736b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:47.399038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd03bb47-9fee-4c83-bb71-dfc247f7736b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:47.399494 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd03bb47-9fee-4c83-bb71-dfc247f7736b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:47.400308 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd03bb47-9fee-4c83-bb71-dfc247f7736b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:47.400744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd03bb47-9fee-4c83-bb71-dfc247f7736b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:47.428189 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.objects.instance [None req-cd03bb47-9fee-4c83-bb71-dfc247f7736b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lazy-loading 'flavor' on Instance uuid e7bf8316-893d-4fad-b5f0-4ecad89120b3 {{(pid=115800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 23:11:47.588028 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cd03bb47-9fee-4c83-bb71-dfc247f7736b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "POST /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/action" status: 200 len: 32 microversion: 2.1 time: 0.202318 Nov 02 23:11:47.588700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 389/765] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:47 2021] POST /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/action => generated 32 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 23:11:47.597619 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-82d3ff77-47b6-416b-921d-d8b77d69102d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:47.598369 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-82d3ff77-47b6-416b-921d-d8b77d69102d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:47.604700 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-82d3ff77-47b6-416b-921d-d8b77d69102d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:47.605150 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-82d3ff77-47b6-416b-921d-d8b77d69102d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:47.605921 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-82d3ff77-47b6-416b-921d-d8b77d69102d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:47.606441 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-82d3ff77-47b6-416b-921d-d8b77d69102d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:47.615687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6dc62fed-4b27-4454-aabc-d46969bee13a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:47.616740 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6dc62fed-4b27-4454-aabc-d46969bee13a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:47.622694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6dc62fed-4b27-4454-aabc-d46969bee13a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:47.623259 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6dc62fed-4b27-4454-aabc-d46969bee13a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:47.624023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6dc62fed-4b27-4454-aabc-d46969bee13a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:47.624443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6dc62fed-4b27-4454-aabc-d46969bee13a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:47.738400 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-82d3ff77-47b6-416b-921d-d8b77d69102d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:47.754260 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-82d3ff77-47b6-416b-921d-d8b77d69102d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1568 microversion: 2.1 time: 0.160218 Nov 02 23:11:47.754854 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 377/766] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:47 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:47.759344 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-5a4b4e06-4c99-4df9-8115-3c278861652a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:47.760246 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-5a4b4e06-4c99-4df9-8115-3c278861652a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:47.766356 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5a4b4e06-4c99-4df9-8115-3c278861652a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:47.766799 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5a4b4e06-4c99-4df9-8115-3c278861652a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:47.767609 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5a4b4e06-4c99-4df9-8115-3c278861652a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:47.768041 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5a4b4e06-4c99-4df9-8115-3c278861652a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:47.798701 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-5a4b4e06-4c99-4df9-8115-3c278861652a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042750 Nov 02 23:11:47.799303 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 378/767] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:11:47 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:11:47.803626 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-5e52c0dc-788c-478c-a7ac-c91159accb65 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:47.804538 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-5e52c0dc-788c-478c-a7ac-c91159accb65 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:47.811083 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5e52c0dc-788c-478c-a7ac-c91159accb65 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:47.811615 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5e52c0dc-788c-478c-a7ac-c91159accb65 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:47.812486 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5e52c0dc-788c-478c-a7ac-c91159accb65 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:47.813006 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5e52c0dc-788c-478c-a7ac-c91159accb65 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:48.040515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6dc62fed-4b27-4454-aabc-d46969bee13a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 36511 microversion: 2.20 time: 0.428564 Nov 02 23:11:48.041178 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 390/768] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:47 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 36511 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:11:48.046174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2d3f2d45-9834-40a4-a014-d0728bae19ac tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:48.046860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2d3f2d45-9834-40a4-a014-d0728bae19ac tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:48.053521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d3f2d45-9834-40a4-a014-d0728bae19ac tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:48.053965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d3f2d45-9834-40a4-a014-d0728bae19ac tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:48.054726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d3f2d45-9834-40a4-a014-d0728bae19ac tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:48.055182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d3f2d45-9834-40a4-a014-d0728bae19ac tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:48.097535 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-5e52c0dc-788c-478c-a7ac-c91159accb65 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 36805 microversion: 2.1 time: 0.296984 Nov 02 23:11:48.098956 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 379/769] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:47 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 36805 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:11:48.189764 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2d3f2d45-9834-40a4-a014-d0728bae19ac tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e66db1e6e4d65a151470af0fd6615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cae71da96545c8b527cdec8f41fdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:48.197046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2d3f2d45-9834-40a4-a014-d0728bae19ac tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 200 len: 1359 microversion: 2.1 time: 0.154574 Nov 02 23:11:48.197615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 391/770] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:48 2021] GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:48.772328 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-5aeecb3a-5c9b-4d0a-98ed-a244a3aebf63 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:48.773007 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-5aeecb3a-5c9b-4d0a-98ed-a244a3aebf63 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:48.779782 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5aeecb3a-5c9b-4d0a-98ed-a244a3aebf63 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:48.780230 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5aeecb3a-5c9b-4d0a-98ed-a244a3aebf63 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:48.781032 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5aeecb3a-5c9b-4d0a-98ed-a244a3aebf63 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:48.781992 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5aeecb3a-5c9b-4d0a-98ed-a244a3aebf63 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:48.809504 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-187f8c64-56f7-430b-9ee5-2f010403f558 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:48.810437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-187f8c64-56f7-430b-9ee5-2f010403f558 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:48.816742 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-187f8c64-56f7-430b-9ee5-2f010403f558 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:48.817186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-187f8c64-56f7-430b-9ee5-2f010403f558 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:48.817951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-187f8c64-56f7-430b-9ee5-2f010403f558 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:48.818377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-187f8c64-56f7-430b-9ee5-2f010403f558 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:48.849592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-187f8c64-56f7-430b-9ee5-2f010403f558 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043666 Nov 02 23:11:48.850167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 392/771] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:11:48 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:11:48.913011 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-5aeecb3a-5c9b-4d0a-98ed-a244a3aebf63 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:48.921203 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-5aeecb3a-5c9b-4d0a-98ed-a244a3aebf63 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1568 microversion: 2.1 time: 0.152929 Nov 02 23:11:48.921846 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 380/772] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:48 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:49.052257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4ccc3016-0bc7-4b23-8f5c-ca89432a9030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:49.053167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4ccc3016-0bc7-4b23-8f5c-ca89432a9030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:49.059016 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ccc3016-0bc7-4b23-8f5c-ca89432a9030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:49.059465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ccc3016-0bc7-4b23-8f5c-ca89432a9030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:49.060229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ccc3016-0bc7-4b23-8f5c-ca89432a9030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:49.060663 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ccc3016-0bc7-4b23-8f5c-ca89432a9030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:49.109329 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b4068a5e-68a5-4536-8823-a56cbbddef8a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:49.110234 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b4068a5e-68a5-4536-8823-a56cbbddef8a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:49.116551 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b4068a5e-68a5-4536-8823-a56cbbddef8a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:49.116936 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b4068a5e-68a5-4536-8823-a56cbbddef8a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:49.117702 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b4068a5e-68a5-4536-8823-a56cbbddef8a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:49.118129 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b4068a5e-68a5-4536-8823-a56cbbddef8a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:49.235212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4ccc3016-0bc7-4b23-8f5c-ca89432a9030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 37220 microversion: 2.20 time: 0.186339 Nov 02 23:11:49.235891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 393/773] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:49 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 37220 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:11:49.240654 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a3580951-251e-4f7d-95d9-95c38c471afc tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:49.241340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a3580951-251e-4f7d-95d9-95c38c471afc tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:49.248138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3580951-251e-4f7d-95d9-95c38c471afc tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:49.248583 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3580951-251e-4f7d-95d9-95c38c471afc tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:49.249352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3580951-251e-4f7d-95d9-95c38c471afc tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:49.250275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3580951-251e-4f7d-95d9-95c38c471afc tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:49.371036 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b4068a5e-68a5-4536-8823-a56cbbddef8a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 37764 microversion: 2.1 time: 0.265110 Nov 02 23:11:49.371629 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 381/774] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:49 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 37764 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:11:49.382453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a3580951-251e-4f7d-95d9-95c38c471afc tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e66db1e6e4d65a151470af0fd6615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cae71da96545c8b527cdec8f41fdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:49.389782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a3580951-251e-4f7d-95d9-95c38c471afc tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 200 len: 1359 microversion: 2.1 time: 0.152779 Nov 02 23:11:49.390409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 394/775] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:49 2021] GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:49.861401 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-3aa22cc1-73c1-46b2-ad65-1ad60470116b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:49.862402 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-3aa22cc1-73c1-46b2-ad65-1ad60470116b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:49.869364 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-3aa22cc1-73c1-46b2-ad65-1ad60470116b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:49.869805 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-3aa22cc1-73c1-46b2-ad65-1ad60470116b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:49.870578 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-3aa22cc1-73c1-46b2-ad65-1ad60470116b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:49.871043 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-3aa22cc1-73c1-46b2-ad65-1ad60470116b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:49.906791 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-3aa22cc1-73c1-46b2-ad65-1ad60470116b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049453 Nov 02 23:11:49.907337 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 382/776] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:11:49 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:11:49.938237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9d637d42-5ba0-43c2-81ea-39d90c861dce tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:49.938858 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9d637d42-5ba0-43c2-81ea-39d90c861dce tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:49.945892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d637d42-5ba0-43c2-81ea-39d90c861dce tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:49.946344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d637d42-5ba0-43c2-81ea-39d90c861dce tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:49.947198 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d637d42-5ba0-43c2-81ea-39d90c861dce tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:49.947641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d637d42-5ba0-43c2-81ea-39d90c861dce tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:50.081426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9d637d42-5ba0-43c2-81ea-39d90c861dce tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:50.089439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9d637d42-5ba0-43c2-81ea-39d90c861dce tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1568 microversion: 2.1 time: 0.155579 Nov 02 23:11:50.090010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 395/777] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:49 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:50.247379 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-995df96f-f3ee-45b4-958a-6f19b6ae195f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:50.248285 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-995df96f-f3ee-45b4-958a-6f19b6ae195f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:50.255169 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-995df96f-f3ee-45b4-958a-6f19b6ae195f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:50.255617 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-995df96f-f3ee-45b4-958a-6f19b6ae195f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:50.256385 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-995df96f-f3ee-45b4-958a-6f19b6ae195f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:50.256811 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-995df96f-f3ee-45b4-958a-6f19b6ae195f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:50.385587 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b3ab47ec-2026-42de-8b48-a1f15ff68c4e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:50.386567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b3ab47ec-2026-42de-8b48-a1f15ff68c4e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:50.393444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3ab47ec-2026-42de-8b48-a1f15ff68c4e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:50.393904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3ab47ec-2026-42de-8b48-a1f15ff68c4e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:50.394709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3ab47ec-2026-42de-8b48-a1f15ff68c4e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:50.395172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3ab47ec-2026-42de-8b48-a1f15ff68c4e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:50.398930 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-995df96f-f3ee-45b4-958a-6f19b6ae195f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 38165 microversion: 2.20 time: 0.155302 Nov 02 23:11:50.400623 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 383/778] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:50 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 38165 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:11:50.405720 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-9377daeb-b89a-4374-bb43-b098370a793e tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:50.407124 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-9377daeb-b89a-4374-bb43-b098370a793e tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:50.413963 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9377daeb-b89a-4374-bb43-b098370a793e tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:50.414902 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9377daeb-b89a-4374-bb43-b098370a793e tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:50.415739 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9377daeb-b89a-4374-bb43-b098370a793e tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:50.416206 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9377daeb-b89a-4374-bb43-b098370a793e tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:50.520183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b3ab47ec-2026-42de-8b48-a1f15ff68c4e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 38136 microversion: 2.1 time: 0.140078 Nov 02 23:11:50.524474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 396/779] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:50 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 38136 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:11:50.556909 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-9377daeb-b89a-4374-bb43-b098370a793e tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e66db1e6e4d65a151470af0fd6615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cae71da96545c8b527cdec8f41fdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:50.564858 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-9377daeb-b89a-4374-bb43-b098370a793e tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 200 len: 1359 microversion: 2.1 time: 0.162893 Nov 02 23:11:50.565437 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 384/780] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:50 2021] GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:50.918113 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e2244b5d-c441-4862-9457-9f059ca2c284 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:50.919278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e2244b5d-c441-4862-9457-9f059ca2c284 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:50.926161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e2244b5d-c441-4862-9457-9f059ca2c284 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:50.926610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e2244b5d-c441-4862-9457-9f059ca2c284 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:50.927416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e2244b5d-c441-4862-9457-9f059ca2c284 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:50.927850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e2244b5d-c441-4862-9457-9f059ca2c284 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:50.959223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e2244b5d-c441-4862-9457-9f059ca2c284 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045179 Nov 02 23:11:50.959910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 397/781] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:11:50 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:11:51.105678 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ff40fba0-6357-4e45-b078-e4875312d899 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:51.106217 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ff40fba0-6357-4e45-b078-e4875312d899 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:51.113053 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ff40fba0-6357-4e45-b078-e4875312d899 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:51.113493 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ff40fba0-6357-4e45-b078-e4875312d899 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:51.114247 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ff40fba0-6357-4e45-b078-e4875312d899 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:51.114669 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ff40fba0-6357-4e45-b078-e4875312d899 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:51.244314 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-ff40fba0-6357-4e45-b078-e4875312d899 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:51.252179 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ff40fba0-6357-4e45-b078-e4875312d899 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1568 microversion: 2.1 time: 0.150195 Nov 02 23:11:51.252749 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 385/782] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:51 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:51.411451 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-83ec695f-0409-4566-b59a-e62c4459b382 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:51.412344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-83ec695f-0409-4566-b59a-e62c4459b382 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:51.418952 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83ec695f-0409-4566-b59a-e62c4459b382 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:51.419425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83ec695f-0409-4566-b59a-e62c4459b382 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:51.420210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83ec695f-0409-4566-b59a-e62c4459b382 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:51.420650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83ec695f-0409-4566-b59a-e62c4459b382 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:51.532372 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b82f21ec-9c88-4025-8bc2-d7b4243e9a18 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:51.533318 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b82f21ec-9c88-4025-8bc2-d7b4243e9a18 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:51.534317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-83ec695f-0409-4566-b59a-e62c4459b382 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 38165 microversion: 2.20 time: 0.126588 Nov 02 23:11:51.536070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 398/783] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:51 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 38165 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:11:51.540252 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b82f21ec-9c88-4025-8bc2-d7b4243e9a18 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:51.540707 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b82f21ec-9c88-4025-8bc2-d7b4243e9a18 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:51.541500 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b82f21ec-9c88-4025-8bc2-d7b4243e9a18 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:51.541932 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b82f21ec-9c88-4025-8bc2-d7b4243e9a18 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:51.582945 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-82b88d2f-f3e0-4f94-b91b-c8747cfa2186 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:51.583668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-82b88d2f-f3e0-4f94-b91b-c8747cfa2186 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:51.591133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82b88d2f-f3e0-4f94-b91b-c8747cfa2186 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:51.591722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82b88d2f-f3e0-4f94-b91b-c8747cfa2186 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:51.592540 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82b88d2f-f3e0-4f94-b91b-c8747cfa2186 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:51.593044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82b88d2f-f3e0-4f94-b91b-c8747cfa2186 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:51.652492 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b82f21ec-9c88-4025-8bc2-d7b4243e9a18 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 38136 microversion: 2.1 time: 0.123741 Nov 02 23:11:51.654162 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 386/784] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:51 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 38136 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:11:51.726815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-82b88d2f-f3e0-4f94-b91b-c8747cfa2186 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e66db1e6e4d65a151470af0fd6615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cae71da96545c8b527cdec8f41fdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:51.735413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-82b88d2f-f3e0-4f94-b91b-c8747cfa2186 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 200 len: 1359 microversion: 2.1 time: 0.157276 Nov 02 23:11:51.744721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 399/785] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:51 2021] GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:11:51.971343 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ea060768-39f6-4392-9345-de29482b915b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:51.972353 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ea060768-39f6-4392-9345-de29482b915b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:51.979155 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ea060768-39f6-4392-9345-de29482b915b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:51.979607 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ea060768-39f6-4392-9345-de29482b915b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:51.980365 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ea060768-39f6-4392-9345-de29482b915b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:51.980792 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ea060768-39f6-4392-9345-de29482b915b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:52.009416 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ea060768-39f6-4392-9345-de29482b915b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042830 Nov 02 23:11:52.009957 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 387/786] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:11:51 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:11:52.269300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-21ce4c1f-d1f5-4c45-9011-6a059adc06be tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:52.269840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-21ce4c1f-d1f5-4c45-9011-6a059adc06be tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:52.276510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21ce4c1f-d1f5-4c45-9011-6a059adc06be tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:52.276955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21ce4c1f-d1f5-4c45-9011-6a059adc06be tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:52.277749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21ce4c1f-d1f5-4c45-9011-6a059adc06be tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:52.278178 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21ce4c1f-d1f5-4c45-9011-6a059adc06be tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:52.409271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-21ce4c1f-d1f5-4c45-9011-6a059adc06be tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:52.416921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-21ce4c1f-d1f5-4c45-9011-6a059adc06be tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1568 microversion: 2.1 time: 0.151595 Nov 02 23:11:52.417493 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 400/787] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:52 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:52.545636 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-78904d7a-ee30-48a6-9536-18a9314f3ef2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:52.547072 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-78904d7a-ee30-48a6-9536-18a9314f3ef2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:52.553243 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-78904d7a-ee30-48a6-9536-18a9314f3ef2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:52.553682 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-78904d7a-ee30-48a6-9536-18a9314f3ef2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:52.554438 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-78904d7a-ee30-48a6-9536-18a9314f3ef2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:52.554864 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-78904d7a-ee30-48a6-9536-18a9314f3ef2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:52.664972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5261efd4-4736-4ac0-9afd-0d777a8bb0ab tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:52.665886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5261efd4-4736-4ac0-9afd-0d777a8bb0ab tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:52.672908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5261efd4-4736-4ac0-9afd-0d777a8bb0ab tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:52.673355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5261efd4-4736-4ac0-9afd-0d777a8bb0ab tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:52.674129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5261efd4-4736-4ac0-9afd-0d777a8bb0ab tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:52.674561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5261efd4-4736-4ac0-9afd-0d777a8bb0ab tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:52.735533 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-78904d7a-ee30-48a6-9536-18a9314f3ef2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 38165 microversion: 2.20 time: 0.193297 Nov 02 23:11:52.736330 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 388/788] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:52 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 38165 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:11:52.752775 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-640e17e8-2fc8-441d-998f-cd2e3acd440c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:52.753453 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-640e17e8-2fc8-441d-998f-cd2e3acd440c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:52.760293 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-640e17e8-2fc8-441d-998f-cd2e3acd440c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:52.760730 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-640e17e8-2fc8-441d-998f-cd2e3acd440c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:52.761492 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-640e17e8-2fc8-441d-998f-cd2e3acd440c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:52.761913 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-640e17e8-2fc8-441d-998f-cd2e3acd440c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:52.833916 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5261efd4-4736-4ac0-9afd-0d777a8bb0ab tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 38245 microversion: 2.1 time: 0.171710 Nov 02 23:11:52.834957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 401/789] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:52 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 38245 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:11:52.898180 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-640e17e8-2fc8-441d-998f-cd2e3acd440c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e66db1e6e4d65a151470af0fd6615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cae71da96545c8b527cdec8f41fdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:52.905548 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-640e17e8-2fc8-441d-998f-cd2e3acd440c tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 200 len: 1359 microversion: 2.1 time: 0.157286 Nov 02 23:11:52.906145 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 389/790] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:52 2021] GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:11:53.021311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4d0390e8-4552-48dc-99eb-933e646e2f52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:53.022307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4d0390e8-4552-48dc-99eb-933e646e2f52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:53.029108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d0390e8-4552-48dc-99eb-933e646e2f52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:53.029553 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d0390e8-4552-48dc-99eb-933e646e2f52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:53.030308 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d0390e8-4552-48dc-99eb-933e646e2f52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:53.030738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d0390e8-4552-48dc-99eb-933e646e2f52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:53.060268 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4d0390e8-4552-48dc-99eb-933e646e2f52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043001 Nov 02 23:11:53.060752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 402/791] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:11:53 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:11:53.433867 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-db6a30d2-6617-449a-b4ad-6c0a5bf343cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:53.434387 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-db6a30d2-6617-449a-b4ad-6c0a5bf343cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:53.440753 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-db6a30d2-6617-449a-b4ad-6c0a5bf343cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:53.441196 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-db6a30d2-6617-449a-b4ad-6c0a5bf343cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:53.441962 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-db6a30d2-6617-449a-b4ad-6c0a5bf343cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:53.442387 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-db6a30d2-6617-449a-b4ad-6c0a5bf343cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:53.574437 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-db6a30d2-6617-449a-b4ad-6c0a5bf343cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:53.583152 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-db6a30d2-6617-449a-b4ad-6c0a5bf343cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1568 microversion: 2.1 time: 0.152979 Nov 02 23:11:53.583717 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 390/792] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:53 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:53.747846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-16a70d3e-8655-4728-99fc-efbf54bc792b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:53.748768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-16a70d3e-8655-4728-99fc-efbf54bc792b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:53.755738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-16a70d3e-8655-4728-99fc-efbf54bc792b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:53.756206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-16a70d3e-8655-4728-99fc-efbf54bc792b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:53.757026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-16a70d3e-8655-4728-99fc-efbf54bc792b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:53.757513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-16a70d3e-8655-4728-99fc-efbf54bc792b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:53.848946 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-393ca5f6-e4b7-4e5d-90fb-133c3696b5a1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:53.849947 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-393ca5f6-e4b7-4e5d-90fb-133c3696b5a1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:53.856320 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-393ca5f6-e4b7-4e5d-90fb-133c3696b5a1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:53.856772 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-393ca5f6-e4b7-4e5d-90fb-133c3696b5a1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:53.857550 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-393ca5f6-e4b7-4e5d-90fb-133c3696b5a1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:53.857985 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-393ca5f6-e4b7-4e5d-90fb-133c3696b5a1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:54.165728 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-16a70d3e-8655-4728-99fc-efbf54bc792b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 200 len: 38305 microversion: 2.20 time: 0.421333 Nov 02 23:11:54.166289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 403/793] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:53 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 38305 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:11:54.171115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-19cb2aab-1950-4075-a598-bc657c37c2fa tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:54.172965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-19cb2aab-1950-4075-a598-bc657c37c2fa tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:54.179772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19cb2aab-1950-4075-a598-bc657c37c2fa tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:54.180223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19cb2aab-1950-4075-a598-bc657c37c2fa tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:54.181013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19cb2aab-1950-4075-a598-bc657c37c2fa tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:54.181451 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19cb2aab-1950-4075-a598-bc657c37c2fa tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:54.206297 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-393ca5f6-e4b7-4e5d-90fb-133c3696b5a1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action" status: 200 len: 38267 microversion: 2.1 time: 0.360979 Nov 02 23:11:54.212173 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 391/794] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:11:53 2021] POST /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/action => generated 38267 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:11:54.212875 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b964a59b-3092-45f5-bac5-da32912ed637 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:54.213413 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b964a59b-3092-45f5-bac5-da32912ed637 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:54.221013 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b964a59b-3092-45f5-bac5-da32912ed637 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:54.221473 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b964a59b-3092-45f5-bac5-da32912ed637 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:54.222256 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b964a59b-3092-45f5-bac5-da32912ed637 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:54.222691 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b964a59b-3092-45f5-bac5-da32912ed637 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:54.253204 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b964a59b-3092-45f5-bac5-da32912ed637 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044819 Nov 02 23:11:54.253777 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 392/795] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:11:54 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:11:54.258113 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-934b2b80-88d8-4273-a135-ecb1ec7d5118 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:54.258604 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-934b2b80-88d8-4273-a135-ecb1ec7d5118 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:54.264683 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-934b2b80-88d8-4273-a135-ecb1ec7d5118 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:54.265131 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-934b2b80-88d8-4273-a135-ecb1ec7d5118 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:54.265904 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-934b2b80-88d8-4273-a135-ecb1ec7d5118 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:54.266361 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-934b2b80-88d8-4273-a135-ecb1ec7d5118 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:54.290273 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-934b2b80-88d8-4273-a135-ecb1ec7d5118 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/ips" status: 200 len: 152 microversion: 2.20 time: 0.035402 Nov 02 23:11:54.290862 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 393/796] 10.222.0.41 () {60 vars in 1288 bytes} [Tue Nov 2 23:11:54 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:11:54.295058 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-364f20d7-fabb-4a71-b579-ce4be43bf969 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:54.295537 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-364f20d7-fabb-4a71-b579-ce4be43bf969 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:54.301785 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-364f20d7-fabb-4a71-b579-ce4be43bf969 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:54.302246 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-364f20d7-fabb-4a71-b579-ce4be43bf969 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:54.303127 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-364f20d7-fabb-4a71-b579-ce4be43bf969 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:54.303540 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-364f20d7-fabb-4a71-b579-ce4be43bf969 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:54.325284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-19cb2aab-1950-4075-a598-bc657c37c2fa tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e66db1e6e4d65a151470af0fd6615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cae71da96545c8b527cdec8f41fdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:54.329227 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-364f20d7-fabb-4a71-b579-ce4be43bf969 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/ips" status: 200 len: 146 microversion: 2.1 time: 0.037076 Nov 02 23:11:54.329902 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 394/797] 10.222.0.41 () {58 vars in 1247 bytes} [Tue Nov 2 23:11:54 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:11:54.335187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-19cb2aab-1950-4075-a598-bc657c37c2fa tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 200 len: 1359 microversion: 2.1 time: 0.167674 Nov 02 23:11:54.335844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 404/798] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:54 2021] GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:54.601370 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-c4c3b9cc-6e28-4065-bc0c-2281490639f8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:54.602652 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-c4c3b9cc-6e28-4065-bc0c-2281490639f8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:54.609551 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c4c3b9cc-6e28-4065-bc0c-2281490639f8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:54.609992 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c4c3b9cc-6e28-4065-bc0c-2281490639f8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:54.610760 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c4c3b9cc-6e28-4065-bc0c-2281490639f8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:54.611253 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c4c3b9cc-6e28-4065-bc0c-2281490639f8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:54.742769 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-c4c3b9cc-6e28-4065-bc0c-2281490639f8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:54.752515 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-c4c3b9cc-6e28-4065-bc0c-2281490639f8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1568 microversion: 2.1 time: 0.156028 Nov 02 23:11:54.753099 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 395/799] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:54 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:54.897758 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-d2e43fe3-4c10-4be0-840e-98d8349d30e6 req-d0e5cffa-db8a-488a-ac1e-57397c2122e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd3c0a6-a083-498f-af1d-564f9e455712", "name": "network-vif-plugged", "status": "completed", "tag": "1a56d8fd-f9cb-4bd2-adbb-88916a2de5a4"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:54.900105 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:11:54.900105 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:11:54.909491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-d2e43fe3-4c10-4be0-840e-98d8349d30e6 req-d0e5cffa-db8a-488a-ac1e-57397c2122e8 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:54.910107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-d2e43fe3-4c10-4be0-840e-98d8349d30e6 req-d0e5cffa-db8a-488a-ac1e-57397c2122e8 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:54.924137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-d2e43fe3-4c10-4be0-840e-98d8349d30e6 req-d0e5cffa-db8a-488a-ac1e-57397c2122e8 service nova] Creating event network-vif-plugged:1a56d8fd-f9cb-4bd2-adbb-88916a2de5a4 for instance 3cd3c0a6-a083-498f-af1d-564f9e455712 on hv-cinder-81584 Nov 02 23:11:54.929078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-d2e43fe3-4c10-4be0-840e-98d8349d30e6 req-d0e5cffa-db8a-488a-ac1e-57397c2122e8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035222 Nov 02 23:11:54.929694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 405/800] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:11:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:11:55.266296 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-55ab21d5-ceb9-4d3f-b182-86010d6ec45d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:55.267243 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-55ab21d5-ceb9-4d3f-b182-86010d6ec45d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:55.273731 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-55ab21d5-ceb9-4d3f-b182-86010d6ec45d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:55.274171 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-55ab21d5-ceb9-4d3f-b182-86010d6ec45d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:55.274969 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-55ab21d5-ceb9-4d3f-b182-86010d6ec45d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:55.275408 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-55ab21d5-ceb9-4d3f-b182-86010d6ec45d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:55.307283 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-55ab21d5-ceb9-4d3f-b182-86010d6ec45d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046055 Nov 02 23:11:55.307854 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 396/801] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:11:55 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:11:55.352547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a5e139fe-9f76-41c0-9ec4-cf24b4f199c5 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:55.353247 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a5e139fe-9f76-41c0-9ec4-cf24b4f199c5 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:55.359773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5e139fe-9f76-41c0-9ec4-cf24b4f199c5 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:55.360213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5e139fe-9f76-41c0-9ec4-cf24b4f199c5 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:55.360972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5e139fe-9f76-41c0-9ec4-cf24b4f199c5 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:55.361401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5e139fe-9f76-41c0-9ec4-cf24b4f199c5 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:55.494141 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a5e139fe-9f76-41c0-9ec4-cf24b4f199c5 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e66db1e6e4d65a151470af0fd6615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cae71da96545c8b527cdec8f41fdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:55.502016 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a5e139fe-9f76-41c0-9ec4-cf24b4f199c5 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 200 len: 1359 microversion: 2.1 time: 0.153858 Nov 02 23:11:55.502792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 406/802] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:55 2021] GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:55.769407 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-302b0a20-7164-49e6-b479-d2ccaabb4d0a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:55.770017 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-302b0a20-7164-49e6-b479-d2ccaabb4d0a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:55.775933 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-302b0a20-7164-49e6-b479-d2ccaabb4d0a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:55.776377 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-302b0a20-7164-49e6-b479-d2ccaabb4d0a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:55.777184 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-302b0a20-7164-49e6-b479-d2ccaabb4d0a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:55.777610 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-302b0a20-7164-49e6-b479-d2ccaabb4d0a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:55.921970 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-302b0a20-7164-49e6-b479-d2ccaabb4d0a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:55.930146 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-302b0a20-7164-49e6-b479-d2ccaabb4d0a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1568 microversion: 2.1 time: 0.165041 Nov 02 23:11:55.930725 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 397/803] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:55 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:56.323884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-51944521-4f3b-489c-9996-7705573f8fa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:56.324799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-51944521-4f3b-489c-9996-7705573f8fa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:56.331876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-51944521-4f3b-489c-9996-7705573f8fa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:56.332328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-51944521-4f3b-489c-9996-7705573f8fa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:56.333101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-51944521-4f3b-489c-9996-7705573f8fa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:56.333538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-51944521-4f3b-489c-9996-7705573f8fa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:56.361943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-51944521-4f3b-489c-9996-7705573f8fa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041811 Nov 02 23:11:56.362485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 407/804] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:11:56 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:11:56.519396 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-86eb6e80-b698-44e0-92e3-8894c361dc11 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:56.520007 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-86eb6e80-b698-44e0-92e3-8894c361dc11 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:56.525886 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-86eb6e80-b698-44e0-92e3-8894c361dc11 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:56.526351 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-86eb6e80-b698-44e0-92e3-8894c361dc11 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:56.527145 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-86eb6e80-b698-44e0-92e3-8894c361dc11 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:56.527582 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-86eb6e80-b698-44e0-92e3-8894c361dc11 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:56.660835 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-86eb6e80-b698-44e0-92e3-8894c361dc11 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e66db1e6e4d65a151470af0fd6615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cae71da96545c8b527cdec8f41fdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:56.669109 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-86eb6e80-b698-44e0-92e3-8894c361dc11 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 200 len: 1359 microversion: 2.1 time: 0.154010 Nov 02 23:11:56.669790 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 398/805] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:56 2021] GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:56.946773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dcc6d71d-f4c2-4d27-ac85-9abfd541be3a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:56.947481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dcc6d71d-f4c2-4d27-ac85-9abfd541be3a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:56.954328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dcc6d71d-f4c2-4d27-ac85-9abfd541be3a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:56.954884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dcc6d71d-f4c2-4d27-ac85-9abfd541be3a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:56.955695 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dcc6d71d-f4c2-4d27-ac85-9abfd541be3a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:56.956122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dcc6d71d-f4c2-4d27-ac85-9abfd541be3a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:57.090882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dcc6d71d-f4c2-4d27-ac85-9abfd541be3a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:57.098640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dcc6d71d-f4c2-4d27-ac85-9abfd541be3a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1568 microversion: 2.1 time: 0.155427 Nov 02 23:11:57.099246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 408/806] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:56 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:57.373395 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-69f2624a-1178-40d4-b06a-eb9aa8843526 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:57.374210 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-69f2624a-1178-40d4-b06a-eb9aa8843526 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:57.380507 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-69f2624a-1178-40d4-b06a-eb9aa8843526 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:57.380943 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-69f2624a-1178-40d4-b06a-eb9aa8843526 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:57.381729 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-69f2624a-1178-40d4-b06a-eb9aa8843526 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:57.382152 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-69f2624a-1178-40d4-b06a-eb9aa8843526 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:57.410316 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-69f2624a-1178-40d4-b06a-eb9aa8843526 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040757 Nov 02 23:11:57.410858 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 399/807] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:11:57 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:11:57.685649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b5cd5fc0-3f11-49fa-8c85-6158c8132633 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:57.686341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b5cd5fc0-3f11-49fa-8c85-6158c8132633 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:57.692318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5cd5fc0-3f11-49fa-8c85-6158c8132633 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:57.692756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5cd5fc0-3f11-49fa-8c85-6158c8132633 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:57.693523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5cd5fc0-3f11-49fa-8c85-6158c8132633 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:57.693946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5cd5fc0-3f11-49fa-8c85-6158c8132633 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:57.824631 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b5cd5fc0-3f11-49fa-8c85-6158c8132633 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e66db1e6e4d65a151470af0fd6615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cae71da96545c8b527cdec8f41fdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:57.833335 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b5cd5fc0-3f11-49fa-8c85-6158c8132633 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 200 len: 1359 microversion: 2.1 time: 0.151268 Nov 02 23:11:57.833909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 409/808] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:57 2021] GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:58.087171 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-65b530fc-7e3f-47b4-a23d-ce99ac0e6671 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:11:58.087691 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-65b530fc-7e3f-47b4-a23d-ce99ac0e6671 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:58.093664 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-65b530fc-7e3f-47b4-a23d-ce99ac0e6671 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:58.094104 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-65b530fc-7e3f-47b4-a23d-ce99ac0e6671 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:58.094863 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-65b530fc-7e3f-47b4-a23d-ce99ac0e6671 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:58.095324 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-65b530fc-7e3f-47b4-a23d-ce99ac0e6671 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:58.115425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9a122c3a-d9ab-453e-b5eb-175b519098b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:58.116057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9a122c3a-d9ab-453e-b5eb-175b519098b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:58.118345 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.objects.instance [None req-65b530fc-7e3f-47b4-a23d-ce99ac0e6671 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lazy-loading 'flavor' on Instance uuid 15750fff-dec6-4bcc-a69c-0f9576f7970e {{(pid=115799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 23:11:58.121806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a122c3a-d9ab-453e-b5eb-175b519098b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:58.122252 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a122c3a-d9ab-453e-b5eb-175b519098b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:58.123049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a122c3a-d9ab-453e-b5eb-175b519098b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:58.123480 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a122c3a-d9ab-453e-b5eb-175b519098b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:58.258285 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9a122c3a-d9ab-453e-b5eb-175b519098b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:58.266901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9a122c3a-d9ab-453e-b5eb-175b519098b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1568 microversion: 2.1 time: 0.155161 Nov 02 23:11:58.267724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 410/809] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:58 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:11:58.384888 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-65b530fc-7e3f-47b4-a23d-ce99ac0e6671 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 202 len: 0 microversion: 2.20 time: 0.301311 Nov 02 23:11:58.385611 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 400/810] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:11:58 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 23:11:58.394441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-26634308-a2a5-4132-a7fc-9d95328edb47 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:58.395093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-26634308-a2a5-4132-a7fc-9d95328edb47 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:58.401267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26634308-a2a5-4132-a7fc-9d95328edb47 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:58.401839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26634308-a2a5-4132-a7fc-9d95328edb47 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:58.402836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26634308-a2a5-4132-a7fc-9d95328edb47 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:58.403330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26634308-a2a5-4132-a7fc-9d95328edb47 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:58.422796 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-1a939574-e68c-4b0a-9369-3abf54adc502 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:58.423829 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-1a939574-e68c-4b0a-9369-3abf54adc502 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:58.430218 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1a939574-e68c-4b0a-9369-3abf54adc502 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:58.430670 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1a939574-e68c-4b0a-9369-3abf54adc502 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:58.431489 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1a939574-e68c-4b0a-9369-3abf54adc502 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:58.431926 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1a939574-e68c-4b0a-9369-3abf54adc502 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:58.463893 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-1a939574-e68c-4b0a-9369-3abf54adc502 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045617 Nov 02 23:11:58.464383 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 401/811] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:11:58 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:11:58.541779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-26634308-a2a5-4132-a7fc-9d95328edb47 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:58.550501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-26634308-a2a5-4132-a7fc-9d95328edb47 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:58.552026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-26634308-a2a5-4132-a7fc-9d95328edb47 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:58.553167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-26634308-a2a5-4132-a7fc-9d95328edb47 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1723 microversion: 2.20 time: 0.163270 Nov 02 23:11:58.553721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 411/812] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:11:58 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:11:58.849742 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-4f64af02-6f57-4998-bbe2-8d0abe0220c3 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:58.850338 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-4f64af02-6f57-4998-bbe2-8d0abe0220c3 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:58.856400 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4f64af02-6f57-4998-bbe2-8d0abe0220c3 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:58.856845 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4f64af02-6f57-4998-bbe2-8d0abe0220c3 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:58.857606 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4f64af02-6f57-4998-bbe2-8d0abe0220c3 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:58.858031 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4f64af02-6f57-4998-bbe2-8d0abe0220c3 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:58.990131 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-4f64af02-6f57-4998-bbe2-8d0abe0220c3 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e66db1e6e4d65a151470af0fd6615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cae71da96545c8b527cdec8f41fdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:58.997411 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-4f64af02-6f57-4998-bbe2-8d0abe0220c3 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 200 len: 1549 microversion: 2.1 time: 0.151295 Nov 02 23:11:58.997977 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 402/813] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:58 2021] GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:59.014554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-78bb5fb6-fef4-47c5-8229-8e0554c8aed3 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:59.015724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-78bb5fb6-fef4-47c5-8229-8e0554c8aed3 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:59.022038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78bb5fb6-fef4-47c5-8229-8e0554c8aed3 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:59.022478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78bb5fb6-fef4-47c5-8229-8e0554c8aed3 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:59.023275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78bb5fb6-fef4-47c5-8229-8e0554c8aed3 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:59.023708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78bb5fb6-fef4-47c5-8229-8e0554c8aed3 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:59.160371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-78bb5fb6-fef4-47c5-8229-8e0554c8aed3 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e66db1e6e4d65a151470af0fd6615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cae71da96545c8b527cdec8f41fdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:59.168070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-78bb5fb6-fef4-47c5-8229-8e0554c8aed3 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 200 len: 1549 microversion: 2.1 time: 0.157725 Nov 02 23:11:59.168665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 412/814] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:59 2021] GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:11:59.184580 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-025f25d2-5f94-4479-8315-74840df32d7e tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:59.188584 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:11:59.188584 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: warnings.warn(msg) Nov 02 23:11:59.189613 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-025f25d2-5f94-4479-8315-74840df32d7e tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6c3e66db1e6e4d65a151470af0fd6615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cae71da96545c8b527cdec8f41fdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:59.190267 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-025f25d2-5f94-4479-8315-74840df32d7e tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Searching by: {'deleted': False, 'project_id': '26cae71da96545c8b527cdec8f41fdb1'} {{(pid=115799) get_all /opt/stack/nova/nova/compute/api.py:2905}} Nov 02 23:11:59.197154 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-025f25d2-5f94-4479-8315-74840df32d7e tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:59.197588 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-025f25d2-5f94-4479-8315-74840df32d7e tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:59.198373 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-025f25d2-5f94-4479-8315-74840df32d7e tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:59.198792 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-025f25d2-5f94-4479-8315-74840df32d7e tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:59.283686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7d6a1096-f32e-45eb-8f92-c3fb87b06299 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:59.284278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7d6a1096-f32e-45eb-8f92-c3fb87b06299 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:59.290287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7d6a1096-f32e-45eb-8f92-c3fb87b06299 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:59.290727 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7d6a1096-f32e-45eb-8f92-c3fb87b06299 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:59.291533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7d6a1096-f32e-45eb-8f92-c3fb87b06299 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:59.291891 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.multi_cell_list [None req-025f25d2-5f94-4479-8315-74840df32d7e tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=115799) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 02 23:11:59.292008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7d6a1096-f32e-45eb-8f92-c3fb87b06299 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:59.390720 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-025f25d2-5f94-4479-8315-74840df32d7e tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.209691 Nov 02 23:11:59.391616 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 403/815] 10.222.0.41 () {58 vars in 1124 bytes} [Tue Nov 2 23:11:59 2021] GET /compute/v2.1/servers => generated 343 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:11:59.401295 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b88653ad-fb2c-4f81-8d18-6252ac337df7 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:59.401909 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b88653ad-fb2c-4f81-8d18-6252ac337df7 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:59.407655 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b88653ad-fb2c-4f81-8d18-6252ac337df7 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:59.408143 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b88653ad-fb2c-4f81-8d18-6252ac337df7 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:59.408929 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b88653ad-fb2c-4f81-8d18-6252ac337df7 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:59.409362 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b88653ad-fb2c-4f81-8d18-6252ac337df7 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:59.427917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7d6a1096-f32e-45eb-8f92-c3fb87b06299 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:59.435605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7d6a1096-f32e-45eb-8f92-c3fb87b06299 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1568 microversion: 2.1 time: 0.155515 Nov 02 23:11:59.436181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 413/816] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:59 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:11:59.475240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3c8d6fb6-e18c-448c-86f6-2ce669554547 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:59.476225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3c8d6fb6-e18c-448c-86f6-2ce669554547 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:59.482208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c8d6fb6-e18c-448c-86f6-2ce669554547 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:59.482651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c8d6fb6-e18c-448c-86f6-2ce669554547 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:59.483439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c8d6fb6-e18c-448c-86f6-2ce669554547 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:59.484430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c8d6fb6-e18c-448c-86f6-2ce669554547 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:59.513445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3c8d6fb6-e18c-448c-86f6-2ce669554547 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041911 Nov 02 23:11:59.514010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 414/817] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:11:59 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:11:59.538609 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-b88653ad-fb2c-4f81-8d18-6252ac337df7 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e66db1e6e4d65a151470af0fd6615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cae71da96545c8b527cdec8f41fdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:59.545846 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b88653ad-fb2c-4f81-8d18-6252ac337df7 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 200 len: 1549 microversion: 2.1 time: 0.148209 Nov 02 23:11:59.547006 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 404/818] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:11:59 2021] GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:11:59.570889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b1e1e96b-2f4f-41e8-b992-afd8451c2040 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:11:59.571509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b1e1e96b-2f4f-41e8-b992-afd8451c2040 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:11:59.577120 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b1e1e96b-2f4f-41e8-b992-afd8451c2040 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:59.577555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b1e1e96b-2f4f-41e8-b992-afd8451c2040 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:59.578304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b1e1e96b-2f4f-41e8-b992-afd8451c2040 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:11:59.579014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b1e1e96b-2f4f-41e8-b992-afd8451c2040 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:11:59.711776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b1e1e96b-2f4f-41e8-b992-afd8451c2040 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:59.720469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b1e1e96b-2f4f-41e8-b992-afd8451c2040 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:59.721961 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b1e1e96b-2f4f-41e8-b992-afd8451c2040 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:11:59.723166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b1e1e96b-2f4f-41e8-b992-afd8451c2040 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1723 microversion: 2.20 time: 0.156025 Nov 02 23:11:59.723733 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 415/819] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:11:59 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:00.453896 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e72da242-f824-4fa3-b01a-0298e3dfd25e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:00.454526 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e72da242-f824-4fa3-b01a-0298e3dfd25e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:00.460721 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e72da242-f824-4fa3-b01a-0298e3dfd25e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:00.461104 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e72da242-f824-4fa3-b01a-0298e3dfd25e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:00.461859 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e72da242-f824-4fa3-b01a-0298e3dfd25e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:00.462305 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e72da242-f824-4fa3-b01a-0298e3dfd25e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:00.524592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-007720ef-00ac-4734-8f35-0e1e9ffb2f2b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:00.525670 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-007720ef-00ac-4734-8f35-0e1e9ffb2f2b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:00.532135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-007720ef-00ac-4734-8f35-0e1e9ffb2f2b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:00.532336 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-007720ef-00ac-4734-8f35-0e1e9ffb2f2b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:00.533200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-007720ef-00ac-4734-8f35-0e1e9ffb2f2b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:00.533805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-007720ef-00ac-4734-8f35-0e1e9ffb2f2b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:00.563119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-007720ef-00ac-4734-8f35-0e1e9ffb2f2b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042098 Nov 02 23:12:00.564039 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 416/820] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:00 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:00.593730 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e72da242-f824-4fa3-b01a-0298e3dfd25e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:00.601423 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e72da242-f824-4fa3-b01a-0298e3dfd25e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1568 microversion: 2.1 time: 0.152178 Nov 02 23:12:00.601992 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 405/821] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:12:00 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:12:00.741362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f12611f3-ced2-445f-89ef-ddf7e2d3dd53 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:00.741362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f12611f3-ced2-445f-89ef-ddf7e2d3dd53 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:00.747922 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f12611f3-ced2-445f-89ef-ddf7e2d3dd53 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:00.748368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f12611f3-ced2-445f-89ef-ddf7e2d3dd53 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:00.749148 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f12611f3-ced2-445f-89ef-ddf7e2d3dd53 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:00.750301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f12611f3-ced2-445f-89ef-ddf7e2d3dd53 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:00.882654 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f12611f3-ced2-445f-89ef-ddf7e2d3dd53 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:00.890299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f12611f3-ced2-445f-89ef-ddf7e2d3dd53 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:00.891831 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f12611f3-ced2-445f-89ef-ddf7e2d3dd53 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:00.892974 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f12611f3-ced2-445f-89ef-ddf7e2d3dd53 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1723 microversion: 2.20 time: 0.155331 Nov 02 23:12:00.893530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 417/822] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:00 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:01.574269 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e690cc98-85fc-4e5a-9c22-df4ebb15e5e8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:01.575239 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e690cc98-85fc-4e5a-9c22-df4ebb15e5e8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:01.582673 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e690cc98-85fc-4e5a-9c22-df4ebb15e5e8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:01.583166 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e690cc98-85fc-4e5a-9c22-df4ebb15e5e8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:01.583959 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e690cc98-85fc-4e5a-9c22-df4ebb15e5e8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:01.584412 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e690cc98-85fc-4e5a-9c22-df4ebb15e5e8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:01.615213 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e690cc98-85fc-4e5a-9c22-df4ebb15e5e8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044615 Nov 02 23:12:01.615785 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 406/823] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:01 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:01.618424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-87301ec2-453e-473a-96f5-3ab200f38024 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:01.619086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-87301ec2-453e-473a-96f5-3ab200f38024 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:01.625456 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87301ec2-453e-473a-96f5-3ab200f38024 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:01.625903 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87301ec2-453e-473a-96f5-3ab200f38024 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:01.626666 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87301ec2-453e-473a-96f5-3ab200f38024 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:01.627136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87301ec2-453e-473a-96f5-3ab200f38024 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:01.766551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-87301ec2-453e-473a-96f5-3ab200f38024 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:01.774403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-87301ec2-453e-473a-96f5-3ab200f38024 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1568 microversion: 2.1 time: 0.159598 Nov 02 23:12:01.774999 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 418/824] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:12:01 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:12:01.910941 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d2a25681-eaeb-434a-a559-8f27d29b0667 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:01.911546 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d2a25681-eaeb-434a-a559-8f27d29b0667 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:01.923425 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d2a25681-eaeb-434a-a559-8f27d29b0667 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:01.923870 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d2a25681-eaeb-434a-a559-8f27d29b0667 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:01.924650 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d2a25681-eaeb-434a-a559-8f27d29b0667 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:01.925076 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d2a25681-eaeb-434a-a559-8f27d29b0667 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:02.055742 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-d2a25681-eaeb-434a-a559-8f27d29b0667 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:02.063742 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-d2a25681-eaeb-434a-a559-8f27d29b0667 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:02.065210 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-d2a25681-eaeb-434a-a559-8f27d29b0667 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:02.066341 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d2a25681-eaeb-434a-a559-8f27d29b0667 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1723 microversion: 2.20 time: 0.159121 Nov 02 23:12:02.066889 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 407/825] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:01 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:02.626435 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fce40a82-5f9d-4eaa-910f-1cd6148a0ad2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:02.627459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fce40a82-5f9d-4eaa-910f-1cd6148a0ad2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:02.633857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fce40a82-5f9d-4eaa-910f-1cd6148a0ad2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:02.634307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fce40a82-5f9d-4eaa-910f-1cd6148a0ad2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:02.635130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fce40a82-5f9d-4eaa-910f-1cd6148a0ad2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:02.635566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fce40a82-5f9d-4eaa-910f-1cd6148a0ad2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:02.665472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fce40a82-5f9d-4eaa-910f-1cd6148a0ad2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042693 Nov 02 23:12:02.666072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 419/826] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:02 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:02.791927 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-5cdadd31-4372-4385-850d-a3125abfd421 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:02.792458 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-5cdadd31-4372-4385-850d-a3125abfd421 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:02.800081 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5cdadd31-4372-4385-850d-a3125abfd421 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:02.800529 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5cdadd31-4372-4385-850d-a3125abfd421 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:02.801312 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5cdadd31-4372-4385-850d-a3125abfd421 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:02.801744 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5cdadd31-4372-4385-850d-a3125abfd421 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:02.938650 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-5cdadd31-4372-4385-850d-a3125abfd421 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:02.947279 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-5cdadd31-4372-4385-850d-a3125abfd421 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1568 microversion: 2.1 time: 0.159133 Nov 02 23:12:02.958528 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 408/827] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:12:02 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:12:03.084180 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-74f318a2-bb3d-4428-a601-d9ccfc4c4cf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:03.084697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-74f318a2-bb3d-4428-a601-d9ccfc4c4cf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:03.090602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74f318a2-bb3d-4428-a601-d9ccfc4c4cf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:03.091097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74f318a2-bb3d-4428-a601-d9ccfc4c4cf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:03.091871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74f318a2-bb3d-4428-a601-d9ccfc4c4cf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:03.092306 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74f318a2-bb3d-4428-a601-d9ccfc4c4cf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:03.223602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-74f318a2-bb3d-4428-a601-d9ccfc4c4cf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:03.231571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-74f318a2-bb3d-4428-a601-d9ccfc4c4cf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:03.233067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-74f318a2-bb3d-4428-a601-d9ccfc4c4cf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:03.234225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-74f318a2-bb3d-4428-a601-d9ccfc4c4cf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1723 microversion: 2.20 time: 0.154109 Nov 02 23:12:03.234784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 420/828] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:03 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:03.677588 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d4aba916-3f01-4e66-98a1-3d8f41ccdba0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:03.678535 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d4aba916-3f01-4e66-98a1-3d8f41ccdba0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:03.684517 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d4aba916-3f01-4e66-98a1-3d8f41ccdba0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:03.684949 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d4aba916-3f01-4e66-98a1-3d8f41ccdba0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:03.685707 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d4aba916-3f01-4e66-98a1-3d8f41ccdba0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:03.686132 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d4aba916-3f01-4e66-98a1-3d8f41ccdba0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:03.715354 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d4aba916-3f01-4e66-98a1-3d8f41ccdba0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041467 Nov 02 23:12:03.715913 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 409/829] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:03 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:03.964936 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5d72b29e-c50b-4272-ad9e-eee91b5917ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:03.965489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5d72b29e-c50b-4272-ad9e-eee91b5917ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:03.972625 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d72b29e-c50b-4272-ad9e-eee91b5917ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:03.973074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d72b29e-c50b-4272-ad9e-eee91b5917ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:03.973868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d72b29e-c50b-4272-ad9e-eee91b5917ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:03.974336 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d72b29e-c50b-4272-ad9e-eee91b5917ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:04.123593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5d72b29e-c50b-4272-ad9e-eee91b5917ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:04.132634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5d72b29e-c50b-4272-ad9e-eee91b5917ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1568 microversion: 2.1 time: 0.171327 Nov 02 23:12:04.133230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 421/830] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:12:03 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:12:04.252959 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-3f8443cf-14a5-4436-b5de-6abff32a56dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:04.253698 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-3f8443cf-14a5-4436-b5de-6abff32a56dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:04.260156 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-3f8443cf-14a5-4436-b5de-6abff32a56dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:04.260690 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-3f8443cf-14a5-4436-b5de-6abff32a56dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:04.261575 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-3f8443cf-14a5-4436-b5de-6abff32a56dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:04.262008 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-3f8443cf-14a5-4436-b5de-6abff32a56dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:04.403591 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-3f8443cf-14a5-4436-b5de-6abff32a56dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:04.412185 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-3f8443cf-14a5-4436-b5de-6abff32a56dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:04.413657 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-3f8443cf-14a5-4436-b5de-6abff32a56dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:04.414830 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-3f8443cf-14a5-4436-b5de-6abff32a56dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1723 microversion: 2.20 time: 0.166179 Nov 02 23:12:04.415453 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 410/831] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:04 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:12:04.727051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fafae432-03de-4ab0-afa9-9af8b3860c41 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:04.727951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fafae432-03de-4ab0-afa9-9af8b3860c41 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:04.734071 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fafae432-03de-4ab0-afa9-9af8b3860c41 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:04.734573 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fafae432-03de-4ab0-afa9-9af8b3860c41 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:04.735497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fafae432-03de-4ab0-afa9-9af8b3860c41 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:04.736066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fafae432-03de-4ab0-afa9-9af8b3860c41 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:04.767171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fafae432-03de-4ab0-afa9-9af8b3860c41 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043926 Nov 02 23:12:04.767743 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 422/832] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:04 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:05.150159 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-5ef3f333-f537-41ca-8b5c-682156eefa6c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:05.150868 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-5ef3f333-f537-41ca-8b5c-682156eefa6c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:05.157748 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5ef3f333-f537-41ca-8b5c-682156eefa6c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:05.158240 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5ef3f333-f537-41ca-8b5c-682156eefa6c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:05.159139 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5ef3f333-f537-41ca-8b5c-682156eefa6c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:05.159629 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5ef3f333-f537-41ca-8b5c-682156eefa6c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:05.309364 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-5ef3f333-f537-41ca-8b5c-682156eefa6c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:05.318752 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-5ef3f333-f537-41ca-8b5c-682156eefa6c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1568 microversion: 2.1 time: 0.172144 Nov 02 23:12:05.319623 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 411/833] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:12:05 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:12:05.434910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bf81e2be-0dba-431f-a582-4571632d3075 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:05.435770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bf81e2be-0dba-431f-a582-4571632d3075 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:05.443885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf81e2be-0dba-431f-a582-4571632d3075 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:05.444338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf81e2be-0dba-431f-a582-4571632d3075 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:05.445249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf81e2be-0dba-431f-a582-4571632d3075 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:05.445745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf81e2be-0dba-431f-a582-4571632d3075 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:05.600151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bf81e2be-0dba-431f-a582-4571632d3075 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:05.613652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bf81e2be-0dba-431f-a582-4571632d3075 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:05.616559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bf81e2be-0dba-431f-a582-4571632d3075 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:05.618702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bf81e2be-0dba-431f-a582-4571632d3075 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1723 microversion: 2.20 time: 0.188599 Nov 02 23:12:05.619739 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 423/834] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:05 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:05.779341 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a450211d-3299-4c10-af4e-56d1bd38942a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:05.780275 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a450211d-3299-4c10-af4e-56d1bd38942a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:05.787255 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a450211d-3299-4c10-af4e-56d1bd38942a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:05.787756 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a450211d-3299-4c10-af4e-56d1bd38942a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:05.788577 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a450211d-3299-4c10-af4e-56d1bd38942a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:05.789050 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a450211d-3299-4c10-af4e-56d1bd38942a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:05.823683 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a450211d-3299-4c10-af4e-56d1bd38942a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048078 Nov 02 23:12:05.824402 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 412/835] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:05 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:06.338042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-701f3102-a604-4ed3-ad94-5d42e1096a82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:06.338712 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-701f3102-a604-4ed3-ad94-5d42e1096a82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:06.345698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-701f3102-a604-4ed3-ad94-5d42e1096a82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:06.346181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-701f3102-a604-4ed3-ad94-5d42e1096a82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:06.347072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-701f3102-a604-4ed3-ad94-5d42e1096a82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:06.347634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-701f3102-a604-4ed3-ad94-5d42e1096a82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:06.498323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-701f3102-a604-4ed3-ad94-5d42e1096a82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:06.506752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-701f3102-a604-4ed3-ad94-5d42e1096a82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1548 microversion: 2.1 time: 0.172469 Nov 02 23:12:06.507379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 424/836] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:12:06 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1548 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:12:06.526659 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-58c0acfb-f505-4ff2-a94f-43ce39ce66f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:06.527544 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-58c0acfb-f505-4ff2-a94f-43ce39ce66f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:06.538807 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-58c0acfb-f505-4ff2-a94f-43ce39ce66f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:06.539627 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-58c0acfb-f505-4ff2-a94f-43ce39ce66f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:06.541007 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-58c0acfb-f505-4ff2-a94f-43ce39ce66f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:06.541786 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-58c0acfb-f505-4ff2-a94f-43ce39ce66f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:06.625572 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.wsgi [None req-58c0acfb-f505-4ff2-a94f-43ce39ce66f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] HTTP exception thrown: Cannot 'detach_volume' instance e7bf8316-893d-4fad-b5f0-4ecad89120b3 while it is in vm_state rescued Nov 02 23:12:06.626206 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-58c0acfb-f505-4ff2-a94f-43ce39ce66f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Returning 409 to user: Cannot 'detach_volume' instance e7bf8316-893d-4fad-b5f0-4ecad89120b3 while it is in vm_state rescued {{(pid=115799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:12:06.627087 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-58c0acfb-f505-4ff2-a94f-43ce39ce66f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "DELETE /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments/178679d2-46b2-4e2b-a4c0-7a57a8bcad3a" status: 409 len: 152 microversion: 2.1 time: 0.107473 Nov 02 23:12:06.627666 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 413/837] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 2 23:12:06 2021] DELETE /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments/178679d2-46b2-4e2b-a4c0-7a57a8bcad3a => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 23:12:06.635878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-92f694a8-ae19-49cd-a15e-88a7db95ef28 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:12:06.636418 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-92f694a8-ae19-49cd-a15e-88a7db95ef28 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:06.642935 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-6b7bc039-f07c-42c9-a670-0589c4deb085 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:06.643210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92f694a8-ae19-49cd-a15e-88a7db95ef28 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:06.643562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92f694a8-ae19-49cd-a15e-88a7db95ef28 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:06.644204 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-6b7bc039-f07c-42c9-a670-0589c4deb085 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:06.644346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92f694a8-ae19-49cd-a15e-88a7db95ef28 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:06.644775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92f694a8-ae19-49cd-a15e-88a7db95ef28 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:06.654946 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6b7bc039-f07c-42c9-a670-0589c4deb085 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:06.655791 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6b7bc039-f07c-42c9-a670-0589c4deb085 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:06.657206 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6b7bc039-f07c-42c9-a670-0589c4deb085 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:06.657979 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6b7bc039-f07c-42c9-a670-0589c4deb085 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:06.718890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-92f694a8-ae19-49cd-a15e-88a7db95ef28 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "POST /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/action" status: 202 len: 0 microversion: 2.1 time: 0.086454 Nov 02 23:12:06.720124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 425/838] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:12:06 2021] POST /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:12:06.732026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a2d06a6b-ce06-46a6-a82d-18c5f363fe0b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:06.734241 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a2d06a6b-ce06-46a6-a82d-18c5f363fe0b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:06.746562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2d06a6b-ce06-46a6-a82d-18c5f363fe0b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:06.747483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2d06a6b-ce06-46a6-a82d-18c5f363fe0b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:06.749009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2d06a6b-ce06-46a6-a82d-18c5f363fe0b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:06.749847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2d06a6b-ce06-46a6-a82d-18c5f363fe0b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:06.865262 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6b7bc039-f07c-42c9-a670-0589c4deb085 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:06.880266 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6b7bc039-f07c-42c9-a670-0589c4deb085 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:06.883363 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6b7bc039-f07c-42c9-a670-0589c4deb085 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:06.885533 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-6b7bc039-f07c-42c9-a670-0589c4deb085 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1723 microversion: 2.20 time: 0.249732 Nov 02 23:12:06.886536 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 414/839] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:06 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:06.896916 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a5426796-7754-4ef6-a69f-4fe0e6ab175a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:06.898805 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a5426796-7754-4ef6-a69f-4fe0e6ab175a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:06.905331 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a5426796-7754-4ef6-a69f-4fe0e6ab175a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:06.905994 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a5426796-7754-4ef6-a69f-4fe0e6ab175a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:06.906895 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a5426796-7754-4ef6-a69f-4fe0e6ab175a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:06.907508 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a5426796-7754-4ef6-a69f-4fe0e6ab175a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:06.941871 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a5426796-7754-4ef6-a69f-4fe0e6ab175a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053823 Nov 02 23:12:06.943461 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 415/840] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:06 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:06.966384 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a2d06a6b-ce06-46a6-a82d-18c5f363fe0b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:06.980489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a2d06a6b-ce06-46a6-a82d-18c5f363fe0b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1556 microversion: 2.1 time: 0.254818 Nov 02 23:12:06.981573 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 426/841] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:12:06 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1556 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:12:07.903932 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-60c1345a-8498-49ab-aead-9db0cf0fed48 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:07.904670 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-60c1345a-8498-49ab-aead-9db0cf0fed48 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:07.912395 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-60c1345a-8498-49ab-aead-9db0cf0fed48 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:07.912841 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-60c1345a-8498-49ab-aead-9db0cf0fed48 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:07.913670 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-60c1345a-8498-49ab-aead-9db0cf0fed48 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:07.914111 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-60c1345a-8498-49ab-aead-9db0cf0fed48 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:07.955867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-070f3b4a-f510-43a5-827c-46b3b1834c1f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:07.956869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-070f3b4a-f510-43a5-827c-46b3b1834c1f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:07.963950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-070f3b4a-f510-43a5-827c-46b3b1834c1f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:07.964405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-070f3b4a-f510-43a5-827c-46b3b1834c1f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:07.966264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-070f3b4a-f510-43a5-827c-46b3b1834c1f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:07.966705 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-070f3b4a-f510-43a5-827c-46b3b1834c1f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:08.003168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-070f3b4a-f510-43a5-827c-46b3b1834c1f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052498 Nov 02 23:12:08.004092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 427/842] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:07 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:08.008497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a2fd6442-6cf4-4022-b4d6-1cf755415ddd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:08.009419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a2fd6442-6cf4-4022-b4d6-1cf755415ddd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:08.016487 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2fd6442-6cf4-4022-b4d6-1cf755415ddd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:08.016943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2fd6442-6cf4-4022-b4d6-1cf755415ddd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:08.017736 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2fd6442-6cf4-4022-b4d6-1cf755415ddd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:08.018181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2fd6442-6cf4-4022-b4d6-1cf755415ddd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:08.068626 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-60c1345a-8498-49ab-aead-9db0cf0fed48 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:08.077040 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-60c1345a-8498-49ab-aead-9db0cf0fed48 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:08.078885 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-60c1345a-8498-49ab-aead-9db0cf0fed48 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:08.080104 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-60c1345a-8498-49ab-aead-9db0cf0fed48 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1723 microversion: 2.20 time: 0.180121 Nov 02 23:12:08.082710 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 416/843] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:07 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:08.193656 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a2fd6442-6cf4-4022-b4d6-1cf755415ddd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:08.201764 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a2fd6442-6cf4-4022-b4d6-1cf755415ddd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1556 microversion: 2.1 time: 0.196549 Nov 02 23:12:08.202749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 428/844] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:12:08 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1556 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:12:09.017947 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-81906072-e03f-4234-a0cf-d67bbd9a1263 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:09.018876 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-81906072-e03f-4234-a0cf-d67bbd9a1263 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:09.025193 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-81906072-e03f-4234-a0cf-d67bbd9a1263 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:09.025627 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-81906072-e03f-4234-a0cf-d67bbd9a1263 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:09.026399 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-81906072-e03f-4234-a0cf-d67bbd9a1263 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:09.026822 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-81906072-e03f-4234-a0cf-d67bbd9a1263 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:09.056332 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-81906072-e03f-4234-a0cf-d67bbd9a1263 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042677 Nov 02 23:12:09.056894 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 417/845] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:09 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:09.098618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c83888e6-c0cc-410d-87d7-66574fb0e8aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:09.099282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c83888e6-c0cc-410d-87d7-66574fb0e8aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:09.105641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c83888e6-c0cc-410d-87d7-66574fb0e8aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:09.106087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c83888e6-c0cc-410d-87d7-66574fb0e8aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:09.106864 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c83888e6-c0cc-410d-87d7-66574fb0e8aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:09.107323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c83888e6-c0cc-410d-87d7-66574fb0e8aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:09.219302 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-0e64726b-5675-4c4e-a504-b88e0f0cc586 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:09.220148 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-0e64726b-5675-4c4e-a504-b88e0f0cc586 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:09.226008 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0e64726b-5675-4c4e-a504-b88e0f0cc586 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:09.226528 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0e64726b-5675-4c4e-a504-b88e0f0cc586 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:09.227434 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0e64726b-5675-4c4e-a504-b88e0f0cc586 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:09.227940 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0e64726b-5675-4c4e-a504-b88e0f0cc586 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:09.242042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c83888e6-c0cc-410d-87d7-66574fb0e8aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:09.251024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c83888e6-c0cc-410d-87d7-66574fb0e8aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:09.252530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c83888e6-c0cc-410d-87d7-66574fb0e8aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:09.253704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c83888e6-c0cc-410d-87d7-66574fb0e8aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1723 microversion: 2.20 time: 0.158806 Nov 02 23:12:09.254293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 429/846] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:09 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:09.365235 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-0e64726b-5675-4c4e-a504-b88e0f0cc586 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:09.372937 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-0e64726b-5675-4c4e-a504-b88e0f0cc586 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1556 microversion: 2.1 time: 0.157792 Nov 02 23:12:09.373509 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 418/847] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:12:09 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:12:10.068576 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fbe1b7ec-cadd-437d-8272-a75d6cb5a0cb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:10.069529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fbe1b7ec-cadd-437d-8272-a75d6cb5a0cb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:10.075854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbe1b7ec-cadd-437d-8272-a75d6cb5a0cb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:10.076298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbe1b7ec-cadd-437d-8272-a75d6cb5a0cb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:10.077085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbe1b7ec-cadd-437d-8272-a75d6cb5a0cb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:10.078151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbe1b7ec-cadd-437d-8272-a75d6cb5a0cb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:10.117379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fbe1b7ec-cadd-437d-8272-a75d6cb5a0cb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052660 Nov 02 23:12:10.118153 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 430/848] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:10 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:10.271886 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-0e550ef2-b802-4137-ad0d-2ba54653546b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:10.272509 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-0e550ef2-b802-4137-ad0d-2ba54653546b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:10.278677 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0e550ef2-b802-4137-ad0d-2ba54653546b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:10.279146 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0e550ef2-b802-4137-ad0d-2ba54653546b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:10.279901 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0e550ef2-b802-4137-ad0d-2ba54653546b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:10.280325 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0e550ef2-b802-4137-ad0d-2ba54653546b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:10.389787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-afb34d0b-2b43-43dd-87ed-25a07da466a6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:10.390392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-afb34d0b-2b43-43dd-87ed-25a07da466a6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:10.396901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-afb34d0b-2b43-43dd-87ed-25a07da466a6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:10.397346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-afb34d0b-2b43-43dd-87ed-25a07da466a6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:10.398194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-afb34d0b-2b43-43dd-87ed-25a07da466a6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:10.398626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-afb34d0b-2b43-43dd-87ed-25a07da466a6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:10.414231 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-0e550ef2-b802-4137-ad0d-2ba54653546b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:10.422801 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-0e550ef2-b802-4137-ad0d-2ba54653546b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:10.424471 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-0e550ef2-b802-4137-ad0d-2ba54653546b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:10.425673 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-0e550ef2-b802-4137-ad0d-2ba54653546b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1723 microversion: 2.20 time: 0.157466 Nov 02 23:12:10.426238 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 419/849] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:10 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:10.529826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-afb34d0b-2b43-43dd-87ed-25a07da466a6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:10.537612 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-afb34d0b-2b43-43dd-87ed-25a07da466a6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1556 microversion: 2.1 time: 0.151563 Nov 02 23:12:10.540004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 431/850] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:12:10 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:12:11.129029 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d04214c9-f28f-4386-9e3e-3213bb19f2d7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:11.129935 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d04214c9-f28f-4386-9e3e-3213bb19f2d7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:11.135888 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d04214c9-f28f-4386-9e3e-3213bb19f2d7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:11.136331 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d04214c9-f28f-4386-9e3e-3213bb19f2d7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:11.137105 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d04214c9-f28f-4386-9e3e-3213bb19f2d7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:11.137530 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d04214c9-f28f-4386-9e3e-3213bb19f2d7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:11.167077 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d04214c9-f28f-4386-9e3e-3213bb19f2d7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041709 Nov 02 23:12:11.167638 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 420/851] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:11 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:11.443644 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4ab4ec48-76e6-4ae1-bb5e-c90bfb9e0c98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:11.444621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4ab4ec48-76e6-4ae1-bb5e-c90bfb9e0c98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:11.451877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ab4ec48-76e6-4ae1-bb5e-c90bfb9e0c98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:11.452819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ab4ec48-76e6-4ae1-bb5e-c90bfb9e0c98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:11.453837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ab4ec48-76e6-4ae1-bb5e-c90bfb9e0c98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:11.454266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ab4ec48-76e6-4ae1-bb5e-c90bfb9e0c98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:11.554473 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d7acec82-b108-4b3a-8a48-e5b9d74392fe tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:11.555249 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d7acec82-b108-4b3a-8a48-e5b9d74392fe tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:11.561576 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d7acec82-b108-4b3a-8a48-e5b9d74392fe tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:11.562505 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d7acec82-b108-4b3a-8a48-e5b9d74392fe tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:11.563450 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d7acec82-b108-4b3a-8a48-e5b9d74392fe tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:11.563871 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d7acec82-b108-4b3a-8a48-e5b9d74392fe tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:11.698708 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-d7acec82-b108-4b3a-8a48-e5b9d74392fe tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:11.707383 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d7acec82-b108-4b3a-8a48-e5b9d74392fe tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1556 microversion: 2.1 time: 0.156471 Nov 02 23:12:11.708044 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 421/852] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:12:11 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:12:11.762008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4ab4ec48-76e6-4ae1-bb5e-c90bfb9e0c98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:11.770362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4ab4ec48-76e6-4ae1-bb5e-c90bfb9e0c98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:11.771864 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4ab4ec48-76e6-4ae1-bb5e-c90bfb9e0c98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:11.772998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4ab4ec48-76e6-4ae1-bb5e-c90bfb9e0c98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1744 microversion: 2.20 time: 0.333087 Nov 02 23:12:11.773555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 432/853] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:11 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1744 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:12.178180 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-353e4847-00a0-4bb6-84c4-0fbc25264134 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:12.179141 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-353e4847-00a0-4bb6-84c4-0fbc25264134 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:12.185015 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-353e4847-00a0-4bb6-84c4-0fbc25264134 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:12.185463 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-353e4847-00a0-4bb6-84c4-0fbc25264134 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:12.186233 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-353e4847-00a0-4bb6-84c4-0fbc25264134 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:12.186702 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-353e4847-00a0-4bb6-84c4-0fbc25264134 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:12.216750 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-353e4847-00a0-4bb6-84c4-0fbc25264134 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042342 Nov 02 23:12:12.217314 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 422/854] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:12 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:12.724602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9e6272e4-a517-44ce-9ff8-5e0ce9af6d4e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:12.725226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9e6272e4-a517-44ce-9ff8-5e0ce9af6d4e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:12.731368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e6272e4-a517-44ce-9ff8-5e0ce9af6d4e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:12.731809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e6272e4-a517-44ce-9ff8-5e0ce9af6d4e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:12.732576 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e6272e4-a517-44ce-9ff8-5e0ce9af6d4e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:12.732998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e6272e4-a517-44ce-9ff8-5e0ce9af6d4e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:12.791328 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-7bea0dd4-b8e5-479d-ae73-885186ea479a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:12.791875 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-7bea0dd4-b8e5-479d-ae73-885186ea479a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:12.798128 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7bea0dd4-b8e5-479d-ae73-885186ea479a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:12.798564 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7bea0dd4-b8e5-479d-ae73-885186ea479a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:12.799359 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7bea0dd4-b8e5-479d-ae73-885186ea479a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:12.799787 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7bea0dd4-b8e5-479d-ae73-885186ea479a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:12.864968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9e6272e4-a517-44ce-9ff8-5e0ce9af6d4e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:12.872790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9e6272e4-a517-44ce-9ff8-5e0ce9af6d4e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1562 microversion: 2.1 time: 0.151741 Nov 02 23:12:12.884009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 433/855] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:12:12 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:12:12.941887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c372a7ce-0164-4379-9de9-b59e1248d977 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:12.942380 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c372a7ce-0164-4379-9de9-b59e1248d977 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:12.948128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c372a7ce-0164-4379-9de9-b59e1248d977 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:12.948581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c372a7ce-0164-4379-9de9-b59e1248d977 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:12.949359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c372a7ce-0164-4379-9de9-b59e1248d977 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:12.949790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c372a7ce-0164-4379-9de9-b59e1248d977 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:12.995565 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-7bea0dd4-b8e5-479d-ae73-885186ea479a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:13.004152 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-7bea0dd4-b8e5-479d-ae73-885186ea479a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:13.005621 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-7bea0dd4-b8e5-479d-ae73-885186ea479a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:13.006991 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-7bea0dd4-b8e5-479d-ae73-885186ea479a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1744 microversion: 2.20 time: 0.219371 Nov 02 23:12:13.007562 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 423/856] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:12 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1744 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:12:13.037427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.objects.instance [None req-c372a7ce-0164-4379-9de9-b59e1248d977 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lazy-loading 'services' on Instance uuid e7bf8316-893d-4fad-b5f0-4ecad89120b3 {{(pid=115800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 23:12:13.107282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c372a7ce-0164-4379-9de9-b59e1248d977 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "DELETE /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments/178679d2-46b2-4e2b-a4c0-7a57a8bcad3a" status: 202 len: 0 microversion: 2.1 time: 0.168865 Nov 02 23:12:13.107882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 434/857] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 2 23:12:12 2021] DELETE /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments/178679d2-46b2-4e2b-a4c0-7a57a8bcad3a => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:12:13.118281 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-40386e15-d4ce-4ed8-b184-bc7d44c279dc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:13.119734 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-40386e15-d4ce-4ed8-b184-bc7d44c279dc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:13.126559 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-40386e15-d4ce-4ed8-b184-bc7d44c279dc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:13.127135 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-40386e15-d4ce-4ed8-b184-bc7d44c279dc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:13.128123 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-40386e15-d4ce-4ed8-b184-bc7d44c279dc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:13.128729 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-40386e15-d4ce-4ed8-b184-bc7d44c279dc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:13.158451 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-40386e15-d4ce-4ed8-b184-bc7d44c279dc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045378 Nov 02 23:12:13.159039 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 424/858] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:13 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:13.229279 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dc4e895d-6859-4687-97ae-7424b4657c3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:13.231495 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dc4e895d-6859-4687-97ae-7424b4657c3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:13.238599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dc4e895d-6859-4687-97ae-7424b4657c3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:13.239089 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dc4e895d-6859-4687-97ae-7424b4657c3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:13.239863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dc4e895d-6859-4687-97ae-7424b4657c3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:13.240320 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dc4e895d-6859-4687-97ae-7424b4657c3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:13.270740 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dc4e895d-6859-4687-97ae-7424b4657c3b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045533 Nov 02 23:12:13.271323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 435/859] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:13 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:14.025245 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-6f1cd563-cd79-487e-b790-1dda06c22346 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:14.025826 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-6f1cd563-cd79-487e-b790-1dda06c22346 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:14.032133 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6f1cd563-cd79-487e-b790-1dda06c22346 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:14.032584 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6f1cd563-cd79-487e-b790-1dda06c22346 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:14.033359 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6f1cd563-cd79-487e-b790-1dda06c22346 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:14.033791 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6f1cd563-cd79-487e-b790-1dda06c22346 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:14.167079 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6f1cd563-cd79-487e-b790-1dda06c22346 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:14.169524 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3c4ed36a-8155-422f-b7cf-0e77aa6776bd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:14.170425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3c4ed36a-8155-422f-b7cf-0e77aa6776bd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:14.176762 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6f1cd563-cd79-487e-b790-1dda06c22346 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:14.177342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c4ed36a-8155-422f-b7cf-0e77aa6776bd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:14.177780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c4ed36a-8155-422f-b7cf-0e77aa6776bd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:14.178268 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6f1cd563-cd79-487e-b790-1dda06c22346 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:14.178560 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c4ed36a-8155-422f-b7cf-0e77aa6776bd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:14.179121 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c4ed36a-8155-422f-b7cf-0e77aa6776bd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:14.179479 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-6f1cd563-cd79-487e-b790-1dda06c22346 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1744 microversion: 2.20 time: 0.158143 Nov 02 23:12:14.180033 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 425/860] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:14 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:14.209084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3c4ed36a-8155-422f-b7cf-0e77aa6776bd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043174 Nov 02 23:12:14.209655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 436/861] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:14 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:14.282164 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-8621477c-7601-4273-977e-364d11c95955 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:14.283009 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-8621477c-7601-4273-977e-364d11c95955 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:14.288925 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8621477c-7601-4273-977e-364d11c95955 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:14.289374 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8621477c-7601-4273-977e-364d11c95955 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:14.290144 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8621477c-7601-4273-977e-364d11c95955 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:14.290575 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8621477c-7601-4273-977e-364d11c95955 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:14.320454 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-8621477c-7601-4273-977e-364d11c95955 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042025 Nov 02 23:12:14.321017 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 426/862] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:14 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:15.076087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-d464556c-c902-417c-935e-11a01f8429d3 req-e8af26ec-d04a-41c8-a50e-3f1638b17728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15750fff-dec6-4bcc-a69c-0f9576f7970e", "name": "network-vif-plugged", "status": "completed", "tag": "1be9ce23-4225-4b98-9740-ed6ade9ebf4a"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:12:15.078125 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:12:15.078125 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:12:15.085609 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-d464556c-c902-417c-935e-11a01f8429d3 req-e8af26ec-d04a-41c8-a50e-3f1638b17728 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:15.086063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-d464556c-c902-417c-935e-11a01f8429d3 req-e8af26ec-d04a-41c8-a50e-3f1638b17728 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:15.100891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-d464556c-c902-417c-935e-11a01f8429d3 req-e8af26ec-d04a-41c8-a50e-3f1638b17728 service nova] Creating event network-vif-plugged:1be9ce23-4225-4b98-9740-ed6ade9ebf4a for instance 15750fff-dec6-4bcc-a69c-0f9576f7970e on hv-cinder-81584 Nov 02 23:12:15.106049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-d464556c-c902-417c-935e-11a01f8429d3 req-e8af26ec-d04a-41c8-a50e-3f1638b17728 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033719 Nov 02 23:12:15.106873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 437/863] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:12:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:15.197778 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-af05992d-e913-456d-8bc9-dc18b0741695 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:15.198495 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-af05992d-e913-456d-8bc9-dc18b0741695 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:15.205973 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-af05992d-e913-456d-8bc9-dc18b0741695 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:15.206430 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-af05992d-e913-456d-8bc9-dc18b0741695 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:15.207274 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-af05992d-e913-456d-8bc9-dc18b0741695 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:15.207742 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-af05992d-e913-456d-8bc9-dc18b0741695 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:15.226623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c7a5869a-1b66-4163-9bdc-8676bacc11a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:15.229256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c7a5869a-1b66-4163-9bdc-8676bacc11a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:15.239951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7a5869a-1b66-4163-9bdc-8676bacc11a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:15.240710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7a5869a-1b66-4163-9bdc-8676bacc11a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:15.242002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7a5869a-1b66-4163-9bdc-8676bacc11a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:15.242708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7a5869a-1b66-4163-9bdc-8676bacc11a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:15.286608 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c7a5869a-1b66-4163-9bdc-8676bacc11a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067115 Nov 02 23:12:15.287409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 438/864] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:15 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:15.367831 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-af05992d-e913-456d-8bc9-dc18b0741695 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:15.378373 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-af05992d-e913-456d-8bc9-dc18b0741695 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:15.380297 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-af05992d-e913-456d-8bc9-dc18b0741695 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:15.381623 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-af05992d-e913-456d-8bc9-dc18b0741695 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1744 microversion: 2.20 time: 0.187709 Nov 02 23:12:15.392709 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 427/865] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:15 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1744 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:12:15.455405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-362c6ffa-ce85-4fec-b796-e052e5784f79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:15.457009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-362c6ffa-ce85-4fec-b796-e052e5784f79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:15.467183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-362c6ffa-ce85-4fec-b796-e052e5784f79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:15.468481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-362c6ffa-ce85-4fec-b796-e052e5784f79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:15.469865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-362c6ffa-ce85-4fec-b796-e052e5784f79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:15.470603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-362c6ffa-ce85-4fec-b796-e052e5784f79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:15.525189 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-362c6ffa-ce85-4fec-b796-e052e5784f79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196969 Nov 02 23:12:15.526281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 439/866] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:15 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:16.298025 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-1b0b2553-6460-4aaf-97e6-75e83683e5ca tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:16.299026 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-1b0b2553-6460-4aaf-97e6-75e83683e5ca tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:16.305820 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1b0b2553-6460-4aaf-97e6-75e83683e5ca tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:16.306318 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1b0b2553-6460-4aaf-97e6-75e83683e5ca tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:16.307178 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1b0b2553-6460-4aaf-97e6-75e83683e5ca tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:16.307658 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1b0b2553-6460-4aaf-97e6-75e83683e5ca tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:16.339921 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-1b0b2553-6460-4aaf-97e6-75e83683e5ca tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045814 Nov 02 23:12:16.340507 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 428/867] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:16 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:16.400475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e1df73d5-ba6f-41d3-b62c-a759d9c8e0b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:16.401083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e1df73d5-ba6f-41d3-b62c-a759d9c8e0b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:16.407477 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e1df73d5-ba6f-41d3-b62c-a759d9c8e0b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:16.407925 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e1df73d5-ba6f-41d3-b62c-a759d9c8e0b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:16.408735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e1df73d5-ba6f-41d3-b62c-a759d9c8e0b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:16.409171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e1df73d5-ba6f-41d3-b62c-a759d9c8e0b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:16.538018 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-072713d8-b614-4674-878d-7512d4bb1f03 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:16.539416 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-072713d8-b614-4674-878d-7512d4bb1f03 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:16.550158 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-072713d8-b614-4674-878d-7512d4bb1f03 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:16.550957 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-072713d8-b614-4674-878d-7512d4bb1f03 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:16.552586 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-072713d8-b614-4674-878d-7512d4bb1f03 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:16.553030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e1df73d5-ba6f-41d3-b62c-a759d9c8e0b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:16.553314 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-072713d8-b614-4674-878d-7512d4bb1f03 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:16.566350 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e1df73d5-ba6f-41d3-b62c-a759d9c8e0b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:16.569099 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e1df73d5-ba6f-41d3-b62c-a759d9c8e0b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:16.571132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e1df73d5-ba6f-41d3-b62c-a759d9c8e0b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1744 microversion: 2.20 time: 0.174124 Nov 02 23:12:16.572081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 440/868] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:16 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1744 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:12:16.601900 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-072713d8-b614-4674-878d-7512d4bb1f03 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067805 Nov 02 23:12:16.602522 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 429/869] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:16 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:17.350694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4851b6d2-3d4b-4859-8326-dcdba0dec411 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:17.351730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4851b6d2-3d4b-4859-8326-dcdba0dec411 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:17.357998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4851b6d2-3d4b-4859-8326-dcdba0dec411 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:17.358968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4851b6d2-3d4b-4859-8326-dcdba0dec411 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:17.359768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4851b6d2-3d4b-4859-8326-dcdba0dec411 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:17.360205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4851b6d2-3d4b-4859-8326-dcdba0dec411 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:17.391692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4851b6d2-3d4b-4859-8326-dcdba0dec411 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044839 Nov 02 23:12:17.392275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 441/870] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:17 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:17.600086 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ada2d855-4349-480d-bddd-37ac9339b0c6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:17.600732 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ada2d855-4349-480d-bddd-37ac9339b0c6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:17.607582 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ada2d855-4349-480d-bddd-37ac9339b0c6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:17.608033 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ada2d855-4349-480d-bddd-37ac9339b0c6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:17.609441 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ada2d855-4349-480d-bddd-37ac9339b0c6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:17.609881 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ada2d855-4349-480d-bddd-37ac9339b0c6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:17.616429 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c660d796-731d-4a15-bd14-d8a665bce7e2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:17.617800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c660d796-731d-4a15-bd14-d8a665bce7e2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:17.625475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c660d796-731d-4a15-bd14-d8a665bce7e2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:17.626038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c660d796-731d-4a15-bd14-d8a665bce7e2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:17.626975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c660d796-731d-4a15-bd14-d8a665bce7e2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:17.627679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c660d796-731d-4a15-bd14-d8a665bce7e2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:17.683097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c660d796-731d-4a15-bd14-d8a665bce7e2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070300 Nov 02 23:12:17.684108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 442/871] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:17 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:17.776986 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-ada2d855-4349-480d-bddd-37ac9339b0c6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:17.785816 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-ada2d855-4349-480d-bddd-37ac9339b0c6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:17.787369 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-ada2d855-4349-480d-bddd-37ac9339b0c6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:17.788570 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ada2d855-4349-480d-bddd-37ac9339b0c6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1744 microversion: 2.20 time: 0.192331 Nov 02 23:12:17.789137 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 430/872] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:17 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1744 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:12:18.403771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-06b45cea-de54-4f41-bcfa-77808597e4c3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:18.404771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-06b45cea-de54-4f41-bcfa-77808597e4c3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:18.411950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06b45cea-de54-4f41-bcfa-77808597e4c3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:18.412401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06b45cea-de54-4f41-bcfa-77808597e4c3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:18.413212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06b45cea-de54-4f41-bcfa-77808597e4c3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:18.413649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06b45cea-de54-4f41-bcfa-77808597e4c3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:18.446022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-06b45cea-de54-4f41-bcfa-77808597e4c3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046193 Nov 02 23:12:18.446618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 443/873] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:18 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:18.700106 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-278feb1b-c267-46a5-b782-4ddec2972b02 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:18.700932 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-278feb1b-c267-46a5-b782-4ddec2972b02 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:18.708422 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-278feb1b-c267-46a5-b782-4ddec2972b02 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:18.708869 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-278feb1b-c267-46a5-b782-4ddec2972b02 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:18.709657 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-278feb1b-c267-46a5-b782-4ddec2972b02 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:18.710091 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-278feb1b-c267-46a5-b782-4ddec2972b02 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:18.743608 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-278feb1b-c267-46a5-b782-4ddec2972b02 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047326 Nov 02 23:12:18.744879 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 431/874] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:18 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:18.807080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6ff1071e-6b85-42fd-8748-89706a6fe570 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:18.807681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6ff1071e-6b85-42fd-8748-89706a6fe570 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:18.814279 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ff1071e-6b85-42fd-8748-89706a6fe570 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:18.814774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ff1071e-6b85-42fd-8748-89706a6fe570 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:18.815641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ff1071e-6b85-42fd-8748-89706a6fe570 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:18.816187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ff1071e-6b85-42fd-8748-89706a6fe570 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:18.955898 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6ff1071e-6b85-42fd-8748-89706a6fe570 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:18.964671 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6ff1071e-6b85-42fd-8748-89706a6fe570 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:18.966228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6ff1071e-6b85-42fd-8748-89706a6fe570 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:18.967477 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6ff1071e-6b85-42fd-8748-89706a6fe570 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1744 microversion: 2.20 time: 0.164242 Nov 02 23:12:18.968150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 444/875] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:18 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:12:19.459802 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d52792c8-2cc6-4afa-9bb6-0a4fa5caaaf0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:19.460624 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d52792c8-2cc6-4afa-9bb6-0a4fa5caaaf0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:19.466946 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d52792c8-2cc6-4afa-9bb6-0a4fa5caaaf0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:19.467407 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d52792c8-2cc6-4afa-9bb6-0a4fa5caaaf0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:19.468277 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d52792c8-2cc6-4afa-9bb6-0a4fa5caaaf0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:19.468716 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d52792c8-2cc6-4afa-9bb6-0a4fa5caaaf0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:19.500135 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d52792c8-2cc6-4afa-9bb6-0a4fa5caaaf0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043651 Nov 02 23:12:19.500709 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 432/876] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:19 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:19.758464 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-82d662c0-34d5-4478-a9d3-4d7039f0eed6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:19.759435 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-82d662c0-34d5-4478-a9d3-4d7039f0eed6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:19.765625 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82d662c0-34d5-4478-a9d3-4d7039f0eed6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:19.766070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82d662c0-34d5-4478-a9d3-4d7039f0eed6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:19.766859 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82d662c0-34d5-4478-a9d3-4d7039f0eed6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:19.767326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82d662c0-34d5-4478-a9d3-4d7039f0eed6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:19.802010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-82d662c0-34d5-4478-a9d3-4d7039f0eed6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047678 Nov 02 23:12:19.802446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 445/877] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:19 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:19.991690 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e7115e18-d20c-4354-99d8-c49c0615a1a4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:19.992740 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e7115e18-d20c-4354-99d8-c49c0615a1a4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:20.005325 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e7115e18-d20c-4354-99d8-c49c0615a1a4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:20.006129 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e7115e18-d20c-4354-99d8-c49c0615a1a4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:20.007536 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e7115e18-d20c-4354-99d8-c49c0615a1a4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:20.008319 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e7115e18-d20c-4354-99d8-c49c0615a1a4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:20.247094 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e7115e18-d20c-4354-99d8-c49c0615a1a4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:20.263783 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e7115e18-d20c-4354-99d8-c49c0615a1a4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:20.268229 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e7115e18-d20c-4354-99d8-c49c0615a1a4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:20.270412 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e7115e18-d20c-4354-99d8-c49c0615a1a4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1739 microversion: 2.20 time: 0.286459 Nov 02 23:12:20.271978 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 433/878] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:19 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1739 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:20.515246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a1350875-736b-4853-af1e-6cfb49287bd0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:20.516577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a1350875-736b-4853-af1e-6cfb49287bd0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:20.528448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a1350875-736b-4853-af1e-6cfb49287bd0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:20.529108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a1350875-736b-4853-af1e-6cfb49287bd0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:20.530074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a1350875-736b-4853-af1e-6cfb49287bd0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:20.531379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a1350875-736b-4853-af1e-6cfb49287bd0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:20.583679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a1350875-736b-4853-af1e-6cfb49287bd0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074069 Nov 02 23:12:20.585548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 446/879] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:20 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:20.820527 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-33b63bbc-0239-45b3-9755-7bcd5a19dd09 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:20.822153 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-33b63bbc-0239-45b3-9755-7bcd5a19dd09 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:20.833526 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-33b63bbc-0239-45b3-9755-7bcd5a19dd09 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:20.834525 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-33b63bbc-0239-45b3-9755-7bcd5a19dd09 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:20.836046 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-33b63bbc-0239-45b3-9755-7bcd5a19dd09 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:20.836761 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-33b63bbc-0239-45b3-9755-7bcd5a19dd09 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:20.914176 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-33b63bbc-0239-45b3-9755-7bcd5a19dd09 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100272 Nov 02 23:12:20.915154 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 434/880] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:20 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:21.290355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f18bf971-66e2-44bb-9af1-60ad5022ce31 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:21.291487 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f18bf971-66e2-44bb-9af1-60ad5022ce31 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:21.307157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f18bf971-66e2-44bb-9af1-60ad5022ce31 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:21.307955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f18bf971-66e2-44bb-9af1-60ad5022ce31 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:21.308861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f18bf971-66e2-44bb-9af1-60ad5022ce31 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:21.309301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f18bf971-66e2-44bb-9af1-60ad5022ce31 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:21.578206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f18bf971-66e2-44bb-9af1-60ad5022ce31 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:21.594485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f18bf971-66e2-44bb-9af1-60ad5022ce31 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:21.597334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f18bf971-66e2-44bb-9af1-60ad5022ce31 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:21.599007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f18bf971-66e2-44bb-9af1-60ad5022ce31 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1739 microversion: 2.20 time: 0.312325 Nov 02 23:12:21.601399 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d7b0ed05-95d6-40dd-ac4e-b0a3d7c4ec13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:21.605120 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d7b0ed05-95d6-40dd-ac4e-b0a3d7c4ec13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:21.611849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 447/881] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:21 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1739 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:21.622391 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d7b0ed05-95d6-40dd-ac4e-b0a3d7c4ec13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:21.623613 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d7b0ed05-95d6-40dd-ac4e-b0a3d7c4ec13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:21.625594 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d7b0ed05-95d6-40dd-ac4e-b0a3d7c4ec13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:21.626380 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d7b0ed05-95d6-40dd-ac4e-b0a3d7c4ec13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:21.684335 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d7b0ed05-95d6-40dd-ac4e-b0a3d7c4ec13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089043 Nov 02 23:12:21.685388 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 435/882] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:21 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:21.932132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1878dfef-0d85-49f3-8caf-150d3c9c1749 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:21.938623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1878dfef-0d85-49f3-8caf-150d3c9c1749 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:21.952192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1878dfef-0d85-49f3-8caf-150d3c9c1749 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:21.953321 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1878dfef-0d85-49f3-8caf-150d3c9c1749 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:21.955136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1878dfef-0d85-49f3-8caf-150d3c9c1749 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:21.958395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1878dfef-0d85-49f3-8caf-150d3c9c1749 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:22.003112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1878dfef-0d85-49f3-8caf-150d3c9c1749 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078342 Nov 02 23:12:22.003710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 448/883] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:21 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:22.657384 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-dabf5bcd-6284-4c6c-8942-bac794468cad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:22.659987 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-dabf5bcd-6284-4c6c-8942-bac794468cad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:22.670256 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dabf5bcd-6284-4c6c-8942-bac794468cad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:22.671591 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dabf5bcd-6284-4c6c-8942-bac794468cad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:22.673333 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dabf5bcd-6284-4c6c-8942-bac794468cad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:22.674480 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dabf5bcd-6284-4c6c-8942-bac794468cad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:22.706665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-86e58434-e75f-43b8-a152-bcbe4ef27328 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:22.707621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-86e58434-e75f-43b8-a152-bcbe4ef27328 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:22.719341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86e58434-e75f-43b8-a152-bcbe4ef27328 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:22.720059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86e58434-e75f-43b8-a152-bcbe4ef27328 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:22.722419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86e58434-e75f-43b8-a152-bcbe4ef27328 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:22.722856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86e58434-e75f-43b8-a152-bcbe4ef27328 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:22.777263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-86e58434-e75f-43b8-a152-bcbe4ef27328 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074534 Nov 02 23:12:22.780855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 449/884] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:22 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:22.871382 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-dabf5bcd-6284-4c6c-8942-bac794468cad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:22.883755 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-dabf5bcd-6284-4c6c-8942-bac794468cad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:22.886595 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-dabf5bcd-6284-4c6c-8942-bac794468cad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:22.888555 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-dabf5bcd-6284-4c6c-8942-bac794468cad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1739 microversion: 2.20 time: 0.265443 Nov 02 23:12:22.889760 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 436/885] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:22 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1739 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:23.018519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f7ca9dd1-c397-432d-aa30-903c253cb388 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:23.019466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f7ca9dd1-c397-432d-aa30-903c253cb388 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:23.027877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f7ca9dd1-c397-432d-aa30-903c253cb388 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:23.028467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f7ca9dd1-c397-432d-aa30-903c253cb388 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:23.029461 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f7ca9dd1-c397-432d-aa30-903c253cb388 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:23.029991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f7ca9dd1-c397-432d-aa30-903c253cb388 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:23.081891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f7ca9dd1-c397-432d-aa30-903c253cb388 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070261 Nov 02 23:12:23.082476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 450/886] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:23 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:23.790891 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f3b92a1e-c69a-4ef3-88c7-98b9bef318a7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:23.791747 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f3b92a1e-c69a-4ef3-88c7-98b9bef318a7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:23.799088 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f3b92a1e-c69a-4ef3-88c7-98b9bef318a7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:23.799883 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f3b92a1e-c69a-4ef3-88c7-98b9bef318a7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:23.800893 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f3b92a1e-c69a-4ef3-88c7-98b9bef318a7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:23.801318 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f3b92a1e-c69a-4ef3-88c7-98b9bef318a7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:23.836083 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f3b92a1e-c69a-4ef3-88c7-98b9bef318a7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049376 Nov 02 23:12:23.839184 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 437/887] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:23 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:24.032929 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cf5f9a32-ba25-45a0-bba2-055d478c2cfb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:24.033545 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cf5f9a32-ba25-45a0-bba2-055d478c2cfb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:24.039750 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf5f9a32-ba25-45a0-bba2-055d478c2cfb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:24.040236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf5f9a32-ba25-45a0-bba2-055d478c2cfb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:24.041088 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf5f9a32-ba25-45a0-bba2-055d478c2cfb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:24.041453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf5f9a32-ba25-45a0-bba2-055d478c2cfb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:24.095879 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-93c3fe80-808d-4b78-996b-80b0a2702f10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:24.095879 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-93c3fe80-808d-4b78-996b-80b0a2702f10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:24.102004 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-93c3fe80-808d-4b78-996b-80b0a2702f10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:24.102458 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-93c3fe80-808d-4b78-996b-80b0a2702f10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:24.103353 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-93c3fe80-808d-4b78-996b-80b0a2702f10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:24.103797 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-93c3fe80-808d-4b78-996b-80b0a2702f10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:24.150230 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-93c3fe80-808d-4b78-996b-80b0a2702f10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059666 Nov 02 23:12:24.151111 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 438/888] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:24 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:24.229777 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cf5f9a32-ba25-45a0-bba2-055d478c2cfb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:24.238197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cf5f9a32-ba25-45a0-bba2-055d478c2cfb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:24.239779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cf5f9a32-ba25-45a0-bba2-055d478c2cfb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:24.240959 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cf5f9a32-ba25-45a0-bba2-055d478c2cfb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1739 microversion: 2.20 time: 0.335695 Nov 02 23:12:24.241517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 451/889] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:23 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1739 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:24.847936 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-2f1c9e8f-d15f-486b-a59b-f47b4bad30f6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:24.848743 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-2f1c9e8f-d15f-486b-a59b-f47b4bad30f6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:24.855205 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2f1c9e8f-d15f-486b-a59b-f47b4bad30f6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:24.855679 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2f1c9e8f-d15f-486b-a59b-f47b4bad30f6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:24.856463 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2f1c9e8f-d15f-486b-a59b-f47b4bad30f6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:24.856892 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2f1c9e8f-d15f-486b-a59b-f47b4bad30f6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:24.887997 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-2f1c9e8f-d15f-486b-a59b-f47b4bad30f6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043840 Nov 02 23:12:24.888576 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 439/890] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:24 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:25.167616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b6a9e720-d364-4f6f-ab56-fc8830c1ccab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:25.170169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b6a9e720-d364-4f6f-ab56-fc8830c1ccab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:25.183251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6a9e720-d364-4f6f-ab56-fc8830c1ccab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:25.184541 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6a9e720-d364-4f6f-ab56-fc8830c1ccab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:25.187037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6a9e720-d364-4f6f-ab56-fc8830c1ccab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:25.188126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6a9e720-d364-4f6f-ab56-fc8830c1ccab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:25.252999 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b6a9e720-d364-4f6f-ab56-fc8830c1ccab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091321 Nov 02 23:12:25.254393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 452/891] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:25 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:25.262622 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-0739d1d6-d8d6-4c0e-a693-0638a75d4098 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:25.263699 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-0739d1d6-d8d6-4c0e-a693-0638a75d4098 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:25.273865 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0739d1d6-d8d6-4c0e-a693-0638a75d4098 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:25.274604 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0739d1d6-d8d6-4c0e-a693-0638a75d4098 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:25.275834 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0739d1d6-d8d6-4c0e-a693-0638a75d4098 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:25.276530 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0739d1d6-d8d6-4c0e-a693-0638a75d4098 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:25.469019 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-0739d1d6-d8d6-4c0e-a693-0638a75d4098 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:25.477418 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-0739d1d6-d8d6-4c0e-a693-0638a75d4098 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:25.479001 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-0739d1d6-d8d6-4c0e-a693-0638a75d4098 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:25.480159 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-0739d1d6-d8d6-4c0e-a693-0638a75d4098 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1739 microversion: 2.20 time: 0.223282 Nov 02 23:12:25.484594 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 440/892] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:25 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:25.902628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dc0fe428-8989-4199-8ff0-cffa6db26190 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:25.903615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dc0fe428-8989-4199-8ff0-cffa6db26190 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:25.910785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dc0fe428-8989-4199-8ff0-cffa6db26190 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:25.911260 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dc0fe428-8989-4199-8ff0-cffa6db26190 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:25.912042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dc0fe428-8989-4199-8ff0-cffa6db26190 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:25.912474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dc0fe428-8989-4199-8ff0-cffa6db26190 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:25.960565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dc0fe428-8989-4199-8ff0-cffa6db26190 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062093 Nov 02 23:12:25.962143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 453/893] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:25 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:26.274201 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-623d9e0f-b9ec-47d9-9cca-e3ff2447f0b5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:26.281789 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-623d9e0f-b9ec-47d9-9cca-e3ff2447f0b5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:26.298176 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-623d9e0f-b9ec-47d9-9cca-e3ff2447f0b5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:26.299577 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-623d9e0f-b9ec-47d9-9cca-e3ff2447f0b5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:26.301415 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-623d9e0f-b9ec-47d9-9cca-e3ff2447f0b5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:26.302566 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-623d9e0f-b9ec-47d9-9cca-e3ff2447f0b5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:26.352425 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-623d9e0f-b9ec-47d9-9cca-e3ff2447f0b5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086458 Nov 02 23:12:26.353126 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 441/894] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:26 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:26.502593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5df08c93-7dce-4329-a7c5-64a0ed90d04a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:26.504603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5df08c93-7dce-4329-a7c5-64a0ed90d04a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:26.514825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5df08c93-7dce-4329-a7c5-64a0ed90d04a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:26.516403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5df08c93-7dce-4329-a7c5-64a0ed90d04a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:26.517679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5df08c93-7dce-4329-a7c5-64a0ed90d04a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:26.518519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5df08c93-7dce-4329-a7c5-64a0ed90d04a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:26.724545 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5df08c93-7dce-4329-a7c5-64a0ed90d04a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:26.736053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5df08c93-7dce-4329-a7c5-64a0ed90d04a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:26.738191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5df08c93-7dce-4329-a7c5-64a0ed90d04a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:26.739776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5df08c93-7dce-4329-a7c5-64a0ed90d04a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1739 microversion: 2.20 time: 0.243890 Nov 02 23:12:26.751150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 454/895] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:26 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:12:26.976557 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-cfbdf657-aaf6-4e1e-ad8c-b6cef8391225 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:26.977706 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-cfbdf657-aaf6-4e1e-ad8c-b6cef8391225 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:26.988082 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cfbdf657-aaf6-4e1e-ad8c-b6cef8391225 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:26.988683 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cfbdf657-aaf6-4e1e-ad8c-b6cef8391225 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:26.989611 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cfbdf657-aaf6-4e1e-ad8c-b6cef8391225 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:26.990143 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cfbdf657-aaf6-4e1e-ad8c-b6cef8391225 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:27.043989 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-cfbdf657-aaf6-4e1e-ad8c-b6cef8391225 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066812 Nov 02 23:12:27.043989 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 442/896] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:26 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:27.365377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ea1f41b0-3977-40ea-943e-38c289ba2ec7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:27.366333 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ea1f41b0-3977-40ea-943e-38c289ba2ec7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:27.373034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea1f41b0-3977-40ea-943e-38c289ba2ec7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:27.375172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea1f41b0-3977-40ea-943e-38c289ba2ec7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:27.375172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea1f41b0-3977-40ea-943e-38c289ba2ec7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:27.375172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea1f41b0-3977-40ea-943e-38c289ba2ec7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:27.411308 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ea1f41b0-3977-40ea-943e-38c289ba2ec7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049657 Nov 02 23:12:27.412266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 455/897] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:27 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:27.760890 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-1cc8d509-986d-49cb-892b-079cfc4f8d77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:27.762398 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-1cc8d509-986d-49cb-892b-079cfc4f8d77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:27.773572 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1cc8d509-986d-49cb-892b-079cfc4f8d77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:27.774711 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1cc8d509-986d-49cb-892b-079cfc4f8d77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:27.776025 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1cc8d509-986d-49cb-892b-079cfc4f8d77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:27.776669 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1cc8d509-986d-49cb-892b-079cfc4f8d77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:28.011329 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-1cc8d509-986d-49cb-892b-079cfc4f8d77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:28.024634 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-1cc8d509-986d-49cb-892b-079cfc4f8d77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:28.026703 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-1cc8d509-986d-49cb-892b-079cfc4f8d77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:28.028019 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-1cc8d509-986d-49cb-892b-079cfc4f8d77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1739 microversion: 2.20 time: 0.273390 Nov 02 23:12:28.028613 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 443/898] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:27 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1739 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:28.056122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-58de5cba-800b-41c4-973e-6d755c59822b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:28.059598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-58de5cba-800b-41c4-973e-6d755c59822b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:28.071860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58de5cba-800b-41c4-973e-6d755c59822b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:28.072561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58de5cba-800b-41c4-973e-6d755c59822b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:28.074183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58de5cba-800b-41c4-973e-6d755c59822b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:28.075230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58de5cba-800b-41c4-973e-6d755c59822b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:28.140031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-58de5cba-800b-41c4-973e-6d755c59822b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090520 Nov 02 23:12:28.142414 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 456/899] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:28 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:28.425886 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-fb5b22ee-abf1-46ba-9272-4076450ab107 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:28.426719 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-fb5b22ee-abf1-46ba-9272-4076450ab107 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:28.437013 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fb5b22ee-abf1-46ba-9272-4076450ab107 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:28.438253 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fb5b22ee-abf1-46ba-9272-4076450ab107 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:28.440157 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fb5b22ee-abf1-46ba-9272-4076450ab107 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:28.441240 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fb5b22ee-abf1-46ba-9272-4076450ab107 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:28.506982 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-fb5b22ee-abf1-46ba-9272-4076450ab107 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084172 Nov 02 23:12:28.508301 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 444/900] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:28 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:29.063133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bfbe19ee-fe3f-4071-9663-80589525b7e7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:29.065453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bfbe19ee-fe3f-4071-9663-80589525b7e7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:29.077549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bfbe19ee-fe3f-4071-9663-80589525b7e7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:29.078965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bfbe19ee-fe3f-4071-9663-80589525b7e7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:29.080672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bfbe19ee-fe3f-4071-9663-80589525b7e7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:29.081633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bfbe19ee-fe3f-4071-9663-80589525b7e7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:29.153944 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f88d27b1-ff70-4fd3-9a00-0486154b11a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:29.157096 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f88d27b1-ff70-4fd3-9a00-0486154b11a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:29.164881 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f88d27b1-ff70-4fd3-9a00-0486154b11a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:29.165676 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f88d27b1-ff70-4fd3-9a00-0486154b11a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:29.166690 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f88d27b1-ff70-4fd3-9a00-0486154b11a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:29.167169 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f88d27b1-ff70-4fd3-9a00-0486154b11a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:29.212412 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f88d27b1-ff70-4fd3-9a00-0486154b11a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062509 Nov 02 23:12:29.228867 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 445/901] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:29 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:29.318590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bfbe19ee-fe3f-4071-9663-80589525b7e7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:29.334987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bfbe19ee-fe3f-4071-9663-80589525b7e7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:29.337633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bfbe19ee-fe3f-4071-9663-80589525b7e7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:29.339895 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bfbe19ee-fe3f-4071-9663-80589525b7e7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1739 microversion: 2.20 time: 0.284706 Nov 02 23:12:29.340851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 457/902] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:29 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:29.531188 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-dc8708e3-9afd-4d1a-99d1-fb6eb78c0b9c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:29.532799 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-dc8708e3-9afd-4d1a-99d1-fb6eb78c0b9c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:29.544201 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dc8708e3-9afd-4d1a-99d1-fb6eb78c0b9c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:29.545038 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dc8708e3-9afd-4d1a-99d1-fb6eb78c0b9c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:29.546955 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dc8708e3-9afd-4d1a-99d1-fb6eb78c0b9c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:29.548379 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dc8708e3-9afd-4d1a-99d1-fb6eb78c0b9c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:29.619693 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-dc8708e3-9afd-4d1a-99d1-fb6eb78c0b9c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094773 Nov 02 23:12:29.619693 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 446/903] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:29 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:30.242342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c3376e89-d673-4ca7-913b-1301e6ef87c4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:30.244240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c3376e89-d673-4ca7-913b-1301e6ef87c4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:30.260781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3376e89-d673-4ca7-913b-1301e6ef87c4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:30.261531 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3376e89-d673-4ca7-913b-1301e6ef87c4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:30.262994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3376e89-d673-4ca7-913b-1301e6ef87c4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:30.263813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3376e89-d673-4ca7-913b-1301e6ef87c4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:30.314150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c3376e89-d673-4ca7-913b-1301e6ef87c4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077562 Nov 02 23:12:30.320104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 458/904] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:30 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:30.372442 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-c4455922-e67f-4827-ae9b-80747ef417b6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:30.374216 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-c4455922-e67f-4827-ae9b-80747ef417b6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:30.388046 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c4455922-e67f-4827-ae9b-80747ef417b6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:30.388843 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c4455922-e67f-4827-ae9b-80747ef417b6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:30.390976 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c4455922-e67f-4827-ae9b-80747ef417b6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:30.391779 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c4455922-e67f-4827-ae9b-80747ef417b6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:30.589958 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-c4455922-e67f-4827-ae9b-80747ef417b6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:30.599063 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-c4455922-e67f-4827-ae9b-80747ef417b6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:30.600603 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-c4455922-e67f-4827-ae9b-80747ef417b6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:30.601776 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-c4455922-e67f-4827-ae9b-80747ef417b6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1739 microversion: 2.20 time: 0.237464 Nov 02 23:12:30.602338 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 447/905] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:30 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:30.646861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-37ee3072-1f84-433e-9420-9981f13854e2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:30.649210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-37ee3072-1f84-433e-9420-9981f13854e2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:30.662880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-37ee3072-1f84-433e-9420-9981f13854e2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:30.663970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-37ee3072-1f84-433e-9420-9981f13854e2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:30.665580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-37ee3072-1f84-433e-9420-9981f13854e2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:30.666355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-37ee3072-1f84-433e-9420-9981f13854e2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:30.751474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-37ee3072-1f84-433e-9420-9981f13854e2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124020 Nov 02 23:12:30.752957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 459/906] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:30 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:31.336485 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-8aefb054-2482-4d55-8666-bb0538ceb0e3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:31.338236 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-8aefb054-2482-4d55-8666-bb0538ceb0e3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:31.350715 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8aefb054-2482-4d55-8666-bb0538ceb0e3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:31.351798 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8aefb054-2482-4d55-8666-bb0538ceb0e3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:31.353173 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8aefb054-2482-4d55-8666-bb0538ceb0e3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:31.353952 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8aefb054-2482-4d55-8666-bb0538ceb0e3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:31.411407 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-8aefb054-2482-4d55-8666-bb0538ceb0e3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081067 Nov 02 23:12:31.417332 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 448/907] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:31 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:31.624501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6823df9e-130f-46fd-a322-ac4032107cb1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:31.626442 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6823df9e-130f-46fd-a322-ac4032107cb1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:31.634977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6823df9e-130f-46fd-a322-ac4032107cb1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:31.635737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6823df9e-130f-46fd-a322-ac4032107cb1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:31.636542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6823df9e-130f-46fd-a322-ac4032107cb1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:31.636973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6823df9e-130f-46fd-a322-ac4032107cb1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:31.763907 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-8c378f7c-bce2-4649-8b93-99a3d3a00210 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:31.765484 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-8c378f7c-bce2-4649-8b93-99a3d3a00210 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:31.773023 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8c378f7c-bce2-4649-8b93-99a3d3a00210 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:31.773685 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8c378f7c-bce2-4649-8b93-99a3d3a00210 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:31.774721 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8c378f7c-bce2-4649-8b93-99a3d3a00210 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:31.775529 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8c378f7c-bce2-4649-8b93-99a3d3a00210 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:31.842044 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-8c378f7c-bce2-4649-8b93-99a3d3a00210 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081834 Nov 02 23:12:31.847722 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 449/908] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:31 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:31.847980 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6823df9e-130f-46fd-a322-ac4032107cb1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:31.862416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6823df9e-130f-46fd-a322-ac4032107cb1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:31.866101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6823df9e-130f-46fd-a322-ac4032107cb1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:31.868552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6823df9e-130f-46fd-a322-ac4032107cb1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1739 microversion: 2.20 time: 0.250610 Nov 02 23:12:31.870229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 460/909] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:31 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:12:32.429934 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b5091bb0-f417-4e5f-8de7-c935a164a3f9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:32.431723 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b5091bb0-f417-4e5f-8de7-c935a164a3f9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:32.443798 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b5091bb0-f417-4e5f-8de7-c935a164a3f9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:32.444732 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b5091bb0-f417-4e5f-8de7-c935a164a3f9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:32.446317 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b5091bb0-f417-4e5f-8de7-c935a164a3f9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:32.447147 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b5091bb0-f417-4e5f-8de7-c935a164a3f9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:32.498076 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b5091bb0-f417-4e5f-8de7-c935a164a3f9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075496 Nov 02 23:12:32.499673 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 450/910] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:32 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:32.863212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8caf8b55-9005-4815-9c12-bc677d9ea782 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:32.866545 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8caf8b55-9005-4815-9c12-bc677d9ea782 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:32.879536 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8caf8b55-9005-4815-9c12-bc677d9ea782 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:32.880855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8caf8b55-9005-4815-9c12-bc677d9ea782 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:32.882878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8caf8b55-9005-4815-9c12-bc677d9ea782 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:32.883929 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8caf8b55-9005-4815-9c12-bc677d9ea782 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:32.894606 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-8ddc770f-b8a2-4edc-862c-422c91e8bf24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:32.896124 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-8ddc770f-b8a2-4edc-862c-422c91e8bf24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:32.918569 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8ddc770f-b8a2-4edc-862c-422c91e8bf24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:32.919908 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8ddc770f-b8a2-4edc-862c-422c91e8bf24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:32.922300 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8ddc770f-b8a2-4edc-862c-422c91e8bf24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:32.923336 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8ddc770f-b8a2-4edc-862c-422c91e8bf24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:32.966230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8caf8b55-9005-4815-9c12-bc677d9ea782 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111670 Nov 02 23:12:32.968182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 461/911] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:32 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:33.127935 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-8ddc770f-b8a2-4edc-862c-422c91e8bf24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:33.145690 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-8ddc770f-b8a2-4edc-862c-422c91e8bf24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:33.149039 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-8ddc770f-b8a2-4edc-862c-422c91e8bf24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:33.150477 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-8ddc770f-b8a2-4edc-862c-422c91e8bf24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1739 microversion: 2.20 time: 0.263904 Nov 02 23:12:33.166880 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 451/912] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:32 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1739 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:33.515864 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-38521063-bf7e-4021-b4be-1a74202963ff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:33.517721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-38521063-bf7e-4021-b4be-1a74202963ff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:33.528663 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-38521063-bf7e-4021-b4be-1a74202963ff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:33.529384 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-38521063-bf7e-4021-b4be-1a74202963ff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:33.531276 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-38521063-bf7e-4021-b4be-1a74202963ff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:33.532003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-38521063-bf7e-4021-b4be-1a74202963ff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:33.599179 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-38521063-bf7e-4021-b4be-1a74202963ff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090345 Nov 02 23:12:33.599909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 462/913] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:33 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:33.980779 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-acfb675f-cd04-43e4-a2e1-2a6dfd41509c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:33.981694 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-acfb675f-cd04-43e4-a2e1-2a6dfd41509c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:33.988808 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-acfb675f-cd04-43e4-a2e1-2a6dfd41509c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:33.989259 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-acfb675f-cd04-43e4-a2e1-2a6dfd41509c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:33.990045 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-acfb675f-cd04-43e4-a2e1-2a6dfd41509c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:33.990481 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-acfb675f-cd04-43e4-a2e1-2a6dfd41509c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:34.021360 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-acfb675f-cd04-43e4-a2e1-2a6dfd41509c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044210 Nov 02 23:12:34.021969 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 452/914] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:33 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:34.175377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6e98eb96-4b00-4504-8647-fc6de3b8b077 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:34.176005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6e98eb96-4b00-4504-8647-fc6de3b8b077 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:34.182560 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e98eb96-4b00-4504-8647-fc6de3b8b077 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:34.183033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e98eb96-4b00-4504-8647-fc6de3b8b077 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:34.183820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e98eb96-4b00-4504-8647-fc6de3b8b077 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:34.184247 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e98eb96-4b00-4504-8647-fc6de3b8b077 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:34.352695 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6e98eb96-4b00-4504-8647-fc6de3b8b077 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:34.361321 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6e98eb96-4b00-4504-8647-fc6de3b8b077 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:34.363176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6e98eb96-4b00-4504-8647-fc6de3b8b077 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:34.364637 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6e98eb96-4b00-4504-8647-fc6de3b8b077 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1739 microversion: 2.20 time: 0.192948 Nov 02 23:12:34.365215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 463/915] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:34 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:12:34.612347 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-6ba8ede5-4f62-4496-8bd4-67a4cd51bffb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:34.613261 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-6ba8ede5-4f62-4496-8bd4-67a4cd51bffb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:34.619362 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6ba8ede5-4f62-4496-8bd4-67a4cd51bffb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:34.619810 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6ba8ede5-4f62-4496-8bd4-67a4cd51bffb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:34.620592 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6ba8ede5-4f62-4496-8bd4-67a4cd51bffb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:34.621029 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6ba8ede5-4f62-4496-8bd4-67a4cd51bffb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:34.652069 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-6ba8ede5-4f62-4496-8bd4-67a4cd51bffb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043996 Nov 02 23:12:34.652655 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 453/916] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:34 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:35.033676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ff0b066f-6ad3-4439-ad6d-ddef5433b32a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:35.034620 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ff0b066f-6ad3-4439-ad6d-ddef5433b32a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:35.041914 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff0b066f-6ad3-4439-ad6d-ddef5433b32a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:35.042617 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff0b066f-6ad3-4439-ad6d-ddef5433b32a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:35.044393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff0b066f-6ad3-4439-ad6d-ddef5433b32a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:35.044667 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff0b066f-6ad3-4439-ad6d-ddef5433b32a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:35.101138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ff0b066f-6ad3-4439-ad6d-ddef5433b32a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071278 Nov 02 23:12:35.102186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 464/917] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:35 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:35.385838 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f6a6e2f6-fc7b-4d18-98e7-238fcc33171c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:35.387058 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f6a6e2f6-fc7b-4d18-98e7-238fcc33171c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:35.396016 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f6a6e2f6-fc7b-4d18-98e7-238fcc33171c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:35.396785 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f6a6e2f6-fc7b-4d18-98e7-238fcc33171c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:35.397961 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f6a6e2f6-fc7b-4d18-98e7-238fcc33171c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:35.398549 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f6a6e2f6-fc7b-4d18-98e7-238fcc33171c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:35.664605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-384c0eec-ccd3-41af-9702-c93af66cd52f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:35.666137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-384c0eec-ccd3-41af-9702-c93af66cd52f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:35.673665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-384c0eec-ccd3-41af-9702-c93af66cd52f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:35.674357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-384c0eec-ccd3-41af-9702-c93af66cd52f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:35.675413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-384c0eec-ccd3-41af-9702-c93af66cd52f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:35.676098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-384c0eec-ccd3-41af-9702-c93af66cd52f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:35.714050 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-384c0eec-ccd3-41af-9702-c93af66cd52f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053654 Nov 02 23:12:35.714842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 465/918] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:35 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:35.760531 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-f6a6e2f6-fc7b-4d18-98e7-238fcc33171c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:35.775319 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-f6a6e2f6-fc7b-4d18-98e7-238fcc33171c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:35.778171 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-f6a6e2f6-fc7b-4d18-98e7-238fcc33171c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:35.780329 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f6a6e2f6-fc7b-4d18-98e7-238fcc33171c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1721 microversion: 2.20 time: 0.399891 Nov 02 23:12:35.781342 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 454/919] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:35 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1721 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:36.115620 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e1ce3ce1-f94d-46d4-809b-786c84b87b89 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:36.116582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e1ce3ce1-f94d-46d4-809b-786c84b87b89 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:36.123228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e1ce3ce1-f94d-46d4-809b-786c84b87b89 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:36.124215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e1ce3ce1-f94d-46d4-809b-786c84b87b89 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:36.125064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e1ce3ce1-f94d-46d4-809b-786c84b87b89 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:36.125509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e1ce3ce1-f94d-46d4-809b-786c84b87b89 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:36.158493 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e1ce3ce1-f94d-46d4-809b-786c84b87b89 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046836 Nov 02 23:12:36.159115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 466/920] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:36 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:36.726597 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-7f1a4a02-6924-4938-8914-a3a5f2432277 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:36.727631 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-7f1a4a02-6924-4938-8914-a3a5f2432277 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:36.735100 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7f1a4a02-6924-4938-8914-a3a5f2432277 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:36.735554 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7f1a4a02-6924-4938-8914-a3a5f2432277 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:36.736346 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7f1a4a02-6924-4938-8914-a3a5f2432277 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:36.736776 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-7f1a4a02-6924-4938-8914-a3a5f2432277 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:36.768337 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-7f1a4a02-6924-4938-8914-a3a5f2432277 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045722 Nov 02 23:12:36.768939 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 455/921] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:36 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:36.802053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8fd9e9a5-04fe-4fa2-be2b-b4c1e5139de1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:36.802688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8fd9e9a5-04fe-4fa2-be2b-b4c1e5139de1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:36.809558 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8fd9e9a5-04fe-4fa2-be2b-b4c1e5139de1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:36.810000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8fd9e9a5-04fe-4fa2-be2b-b4c1e5139de1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:36.810782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8fd9e9a5-04fe-4fa2-be2b-b4c1e5139de1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:36.811282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8fd9e9a5-04fe-4fa2-be2b-b4c1e5139de1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:36.958490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8fd9e9a5-04fe-4fa2-be2b-b4c1e5139de1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:36.967048 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8fd9e9a5-04fe-4fa2-be2b-b4c1e5139de1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:36.970815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8fd9e9a5-04fe-4fa2-be2b-b4c1e5139de1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:36.970815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8fd9e9a5-04fe-4fa2-be2b-b4c1e5139de1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1721 microversion: 2.20 time: 0.171798 Nov 02 23:12:36.970815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 467/922] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:36 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:12:37.172263 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-28d7f0b7-13df-4d74-95ba-a40bf642b602 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:37.173200 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-28d7f0b7-13df-4d74-95ba-a40bf642b602 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:37.179845 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-28d7f0b7-13df-4d74-95ba-a40bf642b602 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:37.180346 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-28d7f0b7-13df-4d74-95ba-a40bf642b602 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:37.181165 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-28d7f0b7-13df-4d74-95ba-a40bf642b602 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:37.181630 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-28d7f0b7-13df-4d74-95ba-a40bf642b602 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:37.216460 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-28d7f0b7-13df-4d74-95ba-a40bf642b602 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048071 Nov 02 23:12:37.217109 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 456/923] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:37 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:37.780349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d441b7aa-b052-4c0d-9496-92a5fcfa1ca0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:37.781193 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d441b7aa-b052-4c0d-9496-92a5fcfa1ca0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:37.787616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d441b7aa-b052-4c0d-9496-92a5fcfa1ca0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:37.788061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d441b7aa-b052-4c0d-9496-92a5fcfa1ca0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:37.788845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d441b7aa-b052-4c0d-9496-92a5fcfa1ca0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:37.789275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d441b7aa-b052-4c0d-9496-92a5fcfa1ca0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:37.820963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d441b7aa-b052-4c0d-9496-92a5fcfa1ca0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044956 Nov 02 23:12:37.821704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 468/924] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:37 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:37.989004 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-25eb55f2-9af5-41e3-b4de-f2e98f2aceae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:37.989624 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-25eb55f2-9af5-41e3-b4de-f2e98f2aceae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:37.996165 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-25eb55f2-9af5-41e3-b4de-f2e98f2aceae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:37.996609 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-25eb55f2-9af5-41e3-b4de-f2e98f2aceae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:37.997390 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-25eb55f2-9af5-41e3-b4de-f2e98f2aceae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:37.997820 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-25eb55f2-9af5-41e3-b4de-f2e98f2aceae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:38.160445 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-25eb55f2-9af5-41e3-b4de-f2e98f2aceae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:38.171084 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-25eb55f2-9af5-41e3-b4de-f2e98f2aceae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:38.172844 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-25eb55f2-9af5-41e3-b4de-f2e98f2aceae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:38.174566 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-25eb55f2-9af5-41e3-b4de-f2e98f2aceae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1721 microversion: 2.20 time: 0.189603 Nov 02 23:12:38.175342 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 457/925] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:37 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:12:38.229382 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5adbf77f-7ceb-4582-9ca3-f39b0c1d73f3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:38.230333 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5adbf77f-7ceb-4582-9ca3-f39b0c1d73f3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:38.237112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5adbf77f-7ceb-4582-9ca3-f39b0c1d73f3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:38.237553 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5adbf77f-7ceb-4582-9ca3-f39b0c1d73f3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:38.238331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5adbf77f-7ceb-4582-9ca3-f39b0c1d73f3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:38.238761 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5adbf77f-7ceb-4582-9ca3-f39b0c1d73f3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:38.285115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5adbf77f-7ceb-4582-9ca3-f39b0c1d73f3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059525 Nov 02 23:12:38.286182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 469/926] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:38 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:38.835779 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-dd503129-6e5c-46a3-bfe3-85331831e593 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:38.836604 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-dd503129-6e5c-46a3-bfe3-85331831e593 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:38.843269 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dd503129-6e5c-46a3-bfe3-85331831e593 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:38.843717 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dd503129-6e5c-46a3-bfe3-85331831e593 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:38.844507 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dd503129-6e5c-46a3-bfe3-85331831e593 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:38.844963 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dd503129-6e5c-46a3-bfe3-85331831e593 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:38.877408 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-dd503129-6e5c-46a3-bfe3-85331831e593 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045411 Nov 02 23:12:38.877999 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 458/927] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:38 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:39.124995 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-9b910fed-54c5-40ce-a61d-3b56d70fbf54 req-c30d01e4-d8c7-4e59-b020-0f251162019d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15750fff-dec6-4bcc-a69c-0f9576f7970e", "name": "network-vif-unplugged", "status": "completed", "tag": "1be9ce23-4225-4b98-9740-ed6ade9ebf4a"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:12:39.128082 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:12:39.128082 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:12:39.140445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-9b910fed-54c5-40ce-a61d-3b56d70fbf54 req-c30d01e4-d8c7-4e59-b020-0f251162019d service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:39.141141 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-9b910fed-54c5-40ce-a61d-3b56d70fbf54 req-c30d01e4-d8c7-4e59-b020-0f251162019d service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:39.161274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.compute.server_external_events [req-9b910fed-54c5-40ce-a61d-3b56d70fbf54 req-c30d01e4-d8c7-4e59-b020-0f251162019d service nova] Unable to find a host for instance 15750fff-dec6-4bcc-a69c-0f9576f7970e. Dropping event network-vif-unplugged {{(pid=115800) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 02 23:12:39.162911 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-9b910fed-54c5-40ce-a61d-3b56d70fbf54 req-c30d01e4-d8c7-4e59-b020-0f251162019d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.044459 Nov 02 23:12:39.163986 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 470/928] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:12:39 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 02 23:12:39.193714 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f640afad-27c7-430f-aa49-27f5b5fce45e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:39.194618 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f640afad-27c7-430f-aa49-27f5b5fce45e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:39.200740 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f640afad-27c7-430f-aa49-27f5b5fce45e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:39.201188 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f640afad-27c7-430f-aa49-27f5b5fce45e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:39.201989 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f640afad-27c7-430f-aa49-27f5b5fce45e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:39.202424 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f640afad-27c7-430f-aa49-27f5b5fce45e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:39.303354 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3dbe6780-d93e-46e0-a9df-ce2440b3e61c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:39.304414 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3dbe6780-d93e-46e0-a9df-ce2440b3e61c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:39.311529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dbe6780-d93e-46e0-a9df-ce2440b3e61c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:39.312114 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dbe6780-d93e-46e0-a9df-ce2440b3e61c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:39.313010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dbe6780-d93e-46e0-a9df-ce2440b3e61c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:39.313552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dbe6780-d93e-46e0-a9df-ce2440b3e61c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:39.350325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3dbe6780-d93e-46e0-a9df-ce2440b3e61c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053276 Nov 02 23:12:39.351229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 471/929] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:39 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:39.356050 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-f640afad-27c7-430f-aa49-27f5b5fce45e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:39.364921 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-f640afad-27c7-430f-aa49-27f5b5fce45e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:39.366549 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-f640afad-27c7-430f-aa49-27f5b5fce45e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:39.367837 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f640afad-27c7-430f-aa49-27f5b5fce45e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1664 microversion: 2.20 time: 0.177818 Nov 02 23:12:39.368566 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 459/930] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:39 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1664 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:12:39.386957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-32a28d92-6cd4-4b4f-8afe-8b1ca48d6d5b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a23a294f-90e9-4bd8-a347-0e9d124bb5a0"}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:12:39.388033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-32a28d92-6cd4-4b4f-8afe-8b1ca48d6d5b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:39.394887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-32a28d92-6cd4-4b4f-8afe-8b1ca48d6d5b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:39.395370 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-32a28d92-6cd4-4b4f-8afe-8b1ca48d6d5b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:39.396168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-32a28d92-6cd4-4b4f-8afe-8b1ca48d6d5b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:39.396602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-32a28d92-6cd4-4b4f-8afe-8b1ca48d6d5b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:39.715015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-32a28d92-6cd4-4b4f-8afe-8b1ca48d6d5b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.331720 Nov 02 23:12:39.715815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 472/931] 10.222.0.41 () {62 vars in 1363 bytes} [Tue Nov 2 23:12:39 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 188 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:12:39.836261 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-8615836c-b51a-437b-863f-a1d815c00508 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:12:39.836821 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-8615836c-b51a-437b-863f-a1d815c00508 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:39.843217 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8615836c-b51a-437b-863f-a1d815c00508 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:39.843661 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8615836c-b51a-437b-863f-a1d815c00508 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:39.844438 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8615836c-b51a-437b-863f-a1d815c00508 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:39.844861 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8615836c-b51a-437b-863f-a1d815c00508 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:39.890298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0d2d0568-230d-47c3-8520-dfdfce3e0af1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:39.891707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0d2d0568-230d-47c3-8520-dfdfce3e0af1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:39.900421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d2d0568-230d-47c3-8520-dfdfce3e0af1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:39.900949 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d2d0568-230d-47c3-8520-dfdfce3e0af1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:39.901950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d2d0568-230d-47c3-8520-dfdfce3e0af1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:39.902492 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d2d0568-230d-47c3-8520-dfdfce3e0af1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:39.947038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0d2d0568-230d-47c3-8520-dfdfce3e0af1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061227 Nov 02 23:12:39.947816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 473/932] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:39 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:40.009487 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-8615836c-b51a-437b-863f-a1d815c00508 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 202 len: 0 microversion: 2.20 time: 0.176815 Nov 02 23:12:40.010780 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 460/933] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:12:39 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 23:12:40.020764 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-784e46af-d93f-4b84-802d-41fcf3f96510 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:40.021593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-784e46af-d93f-4b84-802d-41fcf3f96510 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:40.030432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-784e46af-d93f-4b84-802d-41fcf3f96510 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:40.031068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-784e46af-d93f-4b84-802d-41fcf3f96510 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:40.032028 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-784e46af-d93f-4b84-802d-41fcf3f96510 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:40.032581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-784e46af-d93f-4b84-802d-41fcf3f96510 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:40.235465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-784e46af-d93f-4b84-802d-41fcf3f96510 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:40.246846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-784e46af-d93f-4b84-802d-41fcf3f96510 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:40.249550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-784e46af-d93f-4b84-802d-41fcf3f96510 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:40.251141 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-784e46af-d93f-4b84-802d-41fcf3f96510 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1750 microversion: 2.20 time: 0.235178 Nov 02 23:12:40.251930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 474/934] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:40 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1750 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:12:40.364992 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-8f12bbee-e29e-4042-93af-1b0905852f35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:40.367110 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-8f12bbee-e29e-4042-93af-1b0905852f35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:40.378827 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8f12bbee-e29e-4042-93af-1b0905852f35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:40.379507 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8f12bbee-e29e-4042-93af-1b0905852f35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:40.380550 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8f12bbee-e29e-4042-93af-1b0905852f35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:40.381091 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8f12bbee-e29e-4042-93af-1b0905852f35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:40.433780 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-8f12bbee-e29e-4042-93af-1b0905852f35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073663 Nov 02 23:12:40.434751 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 461/935] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:40 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:40.963665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9a5e380d-3352-4362-9961-80b38af3a926 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:40.967925 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9a5e380d-3352-4362-9961-80b38af3a926 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:40.979514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a5e380d-3352-4362-9961-80b38af3a926 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:40.980317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a5e380d-3352-4362-9961-80b38af3a926 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:40.984787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a5e380d-3352-4362-9961-80b38af3a926 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:40.985661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a5e380d-3352-4362-9961-80b38af3a926 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:41.033056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9a5e380d-3352-4362-9961-80b38af3a926 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076922 Nov 02 23:12:41.033653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 475/936] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:40 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:41.276243 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-12103c5d-59f4-4e7a-8117-ff85159b680e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:41.276981 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-12103c5d-59f4-4e7a-8117-ff85159b680e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:41.284431 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-12103c5d-59f4-4e7a-8117-ff85159b680e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:41.285031 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-12103c5d-59f4-4e7a-8117-ff85159b680e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:41.286389 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-12103c5d-59f4-4e7a-8117-ff85159b680e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:41.287001 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-12103c5d-59f4-4e7a-8117-ff85159b680e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:41.448241 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a19cfd46-49a9-46c2-9b08-d3d562687ba7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:41.449208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a19cfd46-49a9-46c2-9b08-d3d562687ba7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:41.456603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a19cfd46-49a9-46c2-9b08-d3d562687ba7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:41.457057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a19cfd46-49a9-46c2-9b08-d3d562687ba7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:41.457855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a19cfd46-49a9-46c2-9b08-d3d562687ba7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:41.458292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a19cfd46-49a9-46c2-9b08-d3d562687ba7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:41.490834 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a19cfd46-49a9-46c2-9b08-d3d562687ba7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046304 Nov 02 23:12:41.491503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 476/937] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:41 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:41.696641 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-12103c5d-59f4-4e7a-8117-ff85159b680e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:41.706471 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-12103c5d-59f4-4e7a-8117-ff85159b680e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:41.708072 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-12103c5d-59f4-4e7a-8117-ff85159b680e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:41.709288 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-12103c5d-59f4-4e7a-8117-ff85159b680e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.437387 Nov 02 23:12:41.709903 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 462/938] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:41 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:42.044887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-effef6b3-18a5-4e24-bfdd-cb56bf876789 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:42.046223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-effef6b3-18a5-4e24-bfdd-cb56bf876789 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:42.053020 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-effef6b3-18a5-4e24-bfdd-cb56bf876789 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:42.053519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-effef6b3-18a5-4e24-bfdd-cb56bf876789 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:42.054399 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-effef6b3-18a5-4e24-bfdd-cb56bf876789 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:42.054882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-effef6b3-18a5-4e24-bfdd-cb56bf876789 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:42.088298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-effef6b3-18a5-4e24-bfdd-cb56bf876789 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047375 Nov 02 23:12:42.089146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 477/939] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:42 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:42.502650 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-8636d060-d79a-4590-b685-6abb9ef3766f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:42.503703 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-8636d060-d79a-4590-b685-6abb9ef3766f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:42.510418 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8636d060-d79a-4590-b685-6abb9ef3766f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:42.510863 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8636d060-d79a-4590-b685-6abb9ef3766f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:42.511704 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8636d060-d79a-4590-b685-6abb9ef3766f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:42.512113 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-8636d060-d79a-4590-b685-6abb9ef3766f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:42.548101 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-8636d060-d79a-4590-b685-6abb9ef3766f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049485 Nov 02 23:12:42.548773 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 463/940] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:42 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:42.728031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1e2eb0ae-042a-45a2-982e-22dd6515be45 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:42.728819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1e2eb0ae-042a-45a2-982e-22dd6515be45 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:42.735913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e2eb0ae-042a-45a2-982e-22dd6515be45 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:42.736360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e2eb0ae-042a-45a2-982e-22dd6515be45 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:42.737133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e2eb0ae-042a-45a2-982e-22dd6515be45 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:42.737557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e2eb0ae-042a-45a2-982e-22dd6515be45 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:42.882507 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1e2eb0ae-042a-45a2-982e-22dd6515be45 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:42.891280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1e2eb0ae-042a-45a2-982e-22dd6515be45 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:42.892766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1e2eb0ae-042a-45a2-982e-22dd6515be45 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:42.893920 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1e2eb0ae-042a-45a2-982e-22dd6515be45 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.169642 Nov 02 23:12:42.894482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 478/941] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:42 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:43.100659 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-74762a56-b368-44c1-9489-8771456113cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:43.101575 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-74762a56-b368-44c1-9489-8771456113cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:43.107632 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-74762a56-b368-44c1-9489-8771456113cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:43.108655 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-74762a56-b368-44c1-9489-8771456113cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:43.109435 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-74762a56-b368-44c1-9489-8771456113cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:43.109871 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-74762a56-b368-44c1-9489-8771456113cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:43.140516 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-74762a56-b368-44c1-9489-8771456113cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043489 Nov 02 23:12:43.141252 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 464/942] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:43 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:43.560438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b179c260-307c-4de7-8779-fe09446a3aaa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:43.561484 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b179c260-307c-4de7-8779-fe09446a3aaa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:43.568081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b179c260-307c-4de7-8779-fe09446a3aaa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:43.568529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b179c260-307c-4de7-8779-fe09446a3aaa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:43.569335 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b179c260-307c-4de7-8779-fe09446a3aaa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:43.569772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b179c260-307c-4de7-8779-fe09446a3aaa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:43.602411 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b179c260-307c-4de7-8779-fe09446a3aaa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045918 Nov 02 23:12:43.603022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 479/943] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:43 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:43.912454 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-496e14ee-d470-4f28-8f08-61f4f7bf6320 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:43.913098 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-496e14ee-d470-4f28-8f08-61f4f7bf6320 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:43.920163 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-496e14ee-d470-4f28-8f08-61f4f7bf6320 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:43.920616 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-496e14ee-d470-4f28-8f08-61f4f7bf6320 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:43.921401 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-496e14ee-d470-4f28-8f08-61f4f7bf6320 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:43.921831 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-496e14ee-d470-4f28-8f08-61f4f7bf6320 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:44.071397 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-496e14ee-d470-4f28-8f08-61f4f7bf6320 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:44.081198 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-496e14ee-d470-4f28-8f08-61f4f7bf6320 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:44.082846 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-496e14ee-d470-4f28-8f08-61f4f7bf6320 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:44.084130 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-496e14ee-d470-4f28-8f08-61f4f7bf6320 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.175716 Nov 02 23:12:44.084725 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 465/944] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:43 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:12:44.154074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8e4583b2-92f6-4950-89ba-fea01288e27d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:44.155922 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8e4583b2-92f6-4950-89ba-fea01288e27d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:44.165974 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e4583b2-92f6-4950-89ba-fea01288e27d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:44.166425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e4583b2-92f6-4950-89ba-fea01288e27d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:44.167280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e4583b2-92f6-4950-89ba-fea01288e27d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:44.167725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e4583b2-92f6-4950-89ba-fea01288e27d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:44.202547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8e4583b2-92f6-4950-89ba-fea01288e27d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053872 Nov 02 23:12:44.203193 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 480/945] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:44 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:44.615613 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-3d7313ab-aac1-45b2-b9b5-41685400ec7a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:44.616523 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-3d7313ab-aac1-45b2-b9b5-41685400ec7a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:44.622439 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-3d7313ab-aac1-45b2-b9b5-41685400ec7a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:44.622882 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-3d7313ab-aac1-45b2-b9b5-41685400ec7a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:44.623791 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-3d7313ab-aac1-45b2-b9b5-41685400ec7a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:44.624221 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-3d7313ab-aac1-45b2-b9b5-41685400ec7a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:44.653632 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-3d7313ab-aac1-45b2-b9b5-41685400ec7a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041801 Nov 02 23:12:44.654207 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 466/946] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:44 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:45.103530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a02f8ca8-8eb3-4943-bb7b-d5915299fe76 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:45.104130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a02f8ca8-8eb3-4943-bb7b-d5915299fe76 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:45.110672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a02f8ca8-8eb3-4943-bb7b-d5915299fe76 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:45.111140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a02f8ca8-8eb3-4943-bb7b-d5915299fe76 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:45.112558 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a02f8ca8-8eb3-4943-bb7b-d5915299fe76 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:45.113175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a02f8ca8-8eb3-4943-bb7b-d5915299fe76 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:45.215924 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b63b12db-52e2-4d68-a481-35850c7f3c52 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:45.217742 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b63b12db-52e2-4d68-a481-35850c7f3c52 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:45.224696 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b63b12db-52e2-4d68-a481-35850c7f3c52 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:45.225146 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b63b12db-52e2-4d68-a481-35850c7f3c52 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:45.225946 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b63b12db-52e2-4d68-a481-35850c7f3c52 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:45.226382 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b63b12db-52e2-4d68-a481-35850c7f3c52 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:45.250653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a02f8ca8-8eb3-4943-bb7b-d5915299fe76 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:45.258480 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b63b12db-52e2-4d68-a481-35850c7f3c52 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046327 Nov 02 23:12:45.259272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a02f8ca8-8eb3-4943-bb7b-d5915299fe76 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:45.259429 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 467/947] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:45 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:45.260778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a02f8ca8-8eb3-4943-bb7b-d5915299fe76 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:45.262001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a02f8ca8-8eb3-4943-bb7b-d5915299fe76 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.162179 Nov 02 23:12:45.262557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 481/948] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:45 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:45.665587 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-64f68fca-3c04-4b2e-ac82-abf6b9c8dfda tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:45.666564 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-64f68fca-3c04-4b2e-ac82-abf6b9c8dfda tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:45.673250 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-64f68fca-3c04-4b2e-ac82-abf6b9c8dfda tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:45.673696 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-64f68fca-3c04-4b2e-ac82-abf6b9c8dfda tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:45.674476 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-64f68fca-3c04-4b2e-ac82-abf6b9c8dfda tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:45.674907 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-64f68fca-3c04-4b2e-ac82-abf6b9c8dfda tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:45.705227 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-64f68fca-3c04-4b2e-ac82-abf6b9c8dfda tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043319 Nov 02 23:12:45.705805 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 468/949] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:45 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:46.269853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2d102740-78ac-451a-8281-0e4ebd253975 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:46.270845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2d102740-78ac-451a-8281-0e4ebd253975 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:46.278824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d102740-78ac-451a-8281-0e4ebd253975 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:46.279957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d102740-78ac-451a-8281-0e4ebd253975 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:46.280929 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-56f7ccf4-afcf-4a2f-ace4-f431278cc028 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:46.281116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d102740-78ac-451a-8281-0e4ebd253975 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:46.281524 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d102740-78ac-451a-8281-0e4ebd253975 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:46.281697 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-56f7ccf4-afcf-4a2f-ace4-f431278cc028 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:46.288256 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-56f7ccf4-afcf-4a2f-ace4-f431278cc028 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:46.288709 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-56f7ccf4-afcf-4a2f-ace4-f431278cc028 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:46.289503 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-56f7ccf4-afcf-4a2f-ace4-f431278cc028 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:46.289945 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-56f7ccf4-afcf-4a2f-ace4-f431278cc028 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:46.318000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2d102740-78ac-451a-8281-0e4ebd253975 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051805 Nov 02 23:12:46.318756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 482/950] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:46 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:46.425131 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-56f7ccf4-afcf-4a2f-ace4-f431278cc028 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:46.433695 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-56f7ccf4-afcf-4a2f-ace4-f431278cc028 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:46.435247 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-56f7ccf4-afcf-4a2f-ace4-f431278cc028 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:46.436481 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-56f7ccf4-afcf-4a2f-ace4-f431278cc028 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.159753 Nov 02 23:12:46.437054 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 469/951] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:46 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:12:46.717824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-75f8bf2b-8bb9-4c8d-a314-97bcf11d2c23 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:46.718742 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-75f8bf2b-8bb9-4c8d-a314-97bcf11d2c23 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:46.724917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-75f8bf2b-8bb9-4c8d-a314-97bcf11d2c23 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:46.725369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-75f8bf2b-8bb9-4c8d-a314-97bcf11d2c23 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:46.726174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-75f8bf2b-8bb9-4c8d-a314-97bcf11d2c23 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:46.726607 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-75f8bf2b-8bb9-4c8d-a314-97bcf11d2c23 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:46.758553 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-75f8bf2b-8bb9-4c8d-a314-97bcf11d2c23 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044978 Nov 02 23:12:46.759168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 483/952] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:46 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:47.331323 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-cfb36ce0-beb2-4e29-a9e6-aa81b8c5ad79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:47.332507 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-cfb36ce0-beb2-4e29-a9e6-aa81b8c5ad79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:47.339265 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cfb36ce0-beb2-4e29-a9e6-aa81b8c5ad79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:47.339703 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cfb36ce0-beb2-4e29-a9e6-aa81b8c5ad79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:47.340487 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cfb36ce0-beb2-4e29-a9e6-aa81b8c5ad79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:47.340906 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cfb36ce0-beb2-4e29-a9e6-aa81b8c5ad79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:47.371329 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-cfb36ce0-beb2-4e29-a9e6-aa81b8c5ad79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044911 Nov 02 23:12:47.371972 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 470/953] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:47 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:47.453790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7f124b4f-78cf-4a5a-ba4d-244d8021f9e5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:47.454408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7f124b4f-78cf-4a5a-ba4d-244d8021f9e5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:47.460921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f124b4f-78cf-4a5a-ba4d-244d8021f9e5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:47.461370 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f124b4f-78cf-4a5a-ba4d-244d8021f9e5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:47.462163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f124b4f-78cf-4a5a-ba4d-244d8021f9e5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:47.462626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f124b4f-78cf-4a5a-ba4d-244d8021f9e5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:47.597755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7f124b4f-78cf-4a5a-ba4d-244d8021f9e5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:47.606347 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7f124b4f-78cf-4a5a-ba4d-244d8021f9e5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:47.607958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7f124b4f-78cf-4a5a-ba4d-244d8021f9e5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:47.609124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7f124b4f-78cf-4a5a-ba4d-244d8021f9e5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.159312 Nov 02 23:12:47.609694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 484/954] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:47 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:47.771191 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-80d71539-8aed-40be-b681-7dfd533d67f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:47.772247 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-80d71539-8aed-40be-b681-7dfd533d67f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:47.778324 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-80d71539-8aed-40be-b681-7dfd533d67f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:47.778776 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-80d71539-8aed-40be-b681-7dfd533d67f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:47.779594 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-80d71539-8aed-40be-b681-7dfd533d67f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:47.780031 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-80d71539-8aed-40be-b681-7dfd533d67f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:47.812661 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-80d71539-8aed-40be-b681-7dfd533d67f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045438 Nov 02 23:12:47.813254 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 471/955] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:47 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:48.383836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6c709d2b-6de8-4c13-8ea1-5d6696cff2f7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:48.384682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6c709d2b-6de8-4c13-8ea1-5d6696cff2f7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:48.390898 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c709d2b-6de8-4c13-8ea1-5d6696cff2f7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:48.391371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c709d2b-6de8-4c13-8ea1-5d6696cff2f7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:48.392148 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c709d2b-6de8-4c13-8ea1-5d6696cff2f7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:48.392575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c709d2b-6de8-4c13-8ea1-5d6696cff2f7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:48.425689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6c709d2b-6de8-4c13-8ea1-5d6696cff2f7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045665 Nov 02 23:12:48.426283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 485/956] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:48 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:48.627226 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-4e2ee72b-f082-4c63-b3db-8c3aab93aaa6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:48.627831 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-4e2ee72b-f082-4c63-b3db-8c3aab93aaa6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:48.634757 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4e2ee72b-f082-4c63-b3db-8c3aab93aaa6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:48.635158 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4e2ee72b-f082-4c63-b3db-8c3aab93aaa6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:48.635985 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4e2ee72b-f082-4c63-b3db-8c3aab93aaa6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:48.636402 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4e2ee72b-f082-4c63-b3db-8c3aab93aaa6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:48.798445 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-4e2ee72b-f082-4c63-b3db-8c3aab93aaa6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:48.807767 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-4e2ee72b-f082-4c63-b3db-8c3aab93aaa6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:48.809349 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-4e2ee72b-f082-4c63-b3db-8c3aab93aaa6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:48.810595 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-4e2ee72b-f082-4c63-b3db-8c3aab93aaa6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.187302 Nov 02 23:12:48.811274 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 472/957] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:48 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:48.829742 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bce617d3-91fb-4fe8-b3ed-8d829212994b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:48.831434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bce617d3-91fb-4fe8-b3ed-8d829212994b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:48.842435 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bce617d3-91fb-4fe8-b3ed-8d829212994b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:48.843233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bce617d3-91fb-4fe8-b3ed-8d829212994b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:48.844727 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bce617d3-91fb-4fe8-b3ed-8d829212994b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:48.845406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bce617d3-91fb-4fe8-b3ed-8d829212994b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:48.883528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bce617d3-91fb-4fe8-b3ed-8d829212994b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062150 Nov 02 23:12:48.884115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 486/958] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:48 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:49.438165 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d51ed62a-36db-44e6-8f68-20de155f431b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:49.439173 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d51ed62a-36db-44e6-8f68-20de155f431b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:49.445646 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d51ed62a-36db-44e6-8f68-20de155f431b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:49.446132 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d51ed62a-36db-44e6-8f68-20de155f431b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:49.446971 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d51ed62a-36db-44e6-8f68-20de155f431b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:49.447448 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d51ed62a-36db-44e6-8f68-20de155f431b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:49.479583 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d51ed62a-36db-44e6-8f68-20de155f431b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045298 Nov 02 23:12:49.480156 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 473/959] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:49 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:49.829693 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e0cdcb43-bb9c-495e-8a1b-e46e6202fa77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:49.830397 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e0cdcb43-bb9c-495e-8a1b-e46e6202fa77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:49.837016 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0cdcb43-bb9c-495e-8a1b-e46e6202fa77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:49.837469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0cdcb43-bb9c-495e-8a1b-e46e6202fa77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:49.838226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0cdcb43-bb9c-495e-8a1b-e46e6202fa77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:49.838657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0cdcb43-bb9c-495e-8a1b-e46e6202fa77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:49.896001 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-9598458c-f898-4662-91d4-87ebb6e2c864 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:49.897010 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-9598458c-f898-4662-91d4-87ebb6e2c864 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:49.905366 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9598458c-f898-4662-91d4-87ebb6e2c864 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:49.905965 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9598458c-f898-4662-91d4-87ebb6e2c864 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:49.906976 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9598458c-f898-4662-91d4-87ebb6e2c864 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:49.907731 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9598458c-f898-4662-91d4-87ebb6e2c864 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:49.945981 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-9598458c-f898-4662-91d4-87ebb6e2c864 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053576 Nov 02 23:12:49.947056 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 474/960] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:49 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:49.992617 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e0cdcb43-bb9c-495e-8a1b-e46e6202fa77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:50.008208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e0cdcb43-bb9c-495e-8a1b-e46e6202fa77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:50.011182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e0cdcb43-bb9c-495e-8a1b-e46e6202fa77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:50.013254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e0cdcb43-bb9c-495e-8a1b-e46e6202fa77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.187503 Nov 02 23:12:50.014293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 487/961] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:49 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:50.491146 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-483bdbc5-27dd-4872-a6d0-bc00693730c3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:50.492047 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-483bdbc5-27dd-4872-a6d0-bc00693730c3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:50.498668 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-483bdbc5-27dd-4872-a6d0-bc00693730c3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:50.499129 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-483bdbc5-27dd-4872-a6d0-bc00693730c3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:50.499908 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-483bdbc5-27dd-4872-a6d0-bc00693730c3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:50.500331 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-483bdbc5-27dd-4872-a6d0-bc00693730c3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:50.531530 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-483bdbc5-27dd-4872-a6d0-bc00693730c3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044088 Nov 02 23:12:50.532096 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 475/962] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:50 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:50.958578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-08200aba-8585-412e-a626-e2d93d3ececc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:50.959526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-08200aba-8585-412e-a626-e2d93d3ececc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:50.965915 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08200aba-8585-412e-a626-e2d93d3ececc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:50.966364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08200aba-8585-412e-a626-e2d93d3ececc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:50.967182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08200aba-8585-412e-a626-e2d93d3ececc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:50.967618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08200aba-8585-412e-a626-e2d93d3ececc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:50.999651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-08200aba-8585-412e-a626-e2d93d3ececc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044740 Nov 02 23:12:51.000246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 488/963] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:50 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:51.042333 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-c7ad9407-116d-42ae-b66e-d77d269e933b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:51.043110 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-c7ad9407-116d-42ae-b66e-d77d269e933b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:51.051027 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c7ad9407-116d-42ae-b66e-d77d269e933b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:51.051649 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c7ad9407-116d-42ae-b66e-d77d269e933b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:51.052513 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c7ad9407-116d-42ae-b66e-d77d269e933b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:51.052987 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c7ad9407-116d-42ae-b66e-d77d269e933b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:51.212840 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-c7ad9407-116d-42ae-b66e-d77d269e933b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:51.222645 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-c7ad9407-116d-42ae-b66e-d77d269e933b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:51.224266 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-c7ad9407-116d-42ae-b66e-d77d269e933b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:51.225440 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-c7ad9407-116d-42ae-b66e-d77d269e933b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.187054 Nov 02 23:12:51.225999 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 476/964] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:51 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:12:51.543390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e64121f6-ee1b-47ab-b58c-de6725832804 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:51.544308 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e64121f6-ee1b-47ab-b58c-de6725832804 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:51.550425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e64121f6-ee1b-47ab-b58c-de6725832804 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:51.550874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e64121f6-ee1b-47ab-b58c-de6725832804 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:51.551681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e64121f6-ee1b-47ab-b58c-de6725832804 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:51.552118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e64121f6-ee1b-47ab-b58c-de6725832804 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:51.584398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e64121f6-ee1b-47ab-b58c-de6725832804 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044709 Nov 02 23:12:51.584992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 489/965] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:51 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:52.011682 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d171d5b9-ece4-4184-9228-52079d296149 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:52.012653 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d171d5b9-ece4-4184-9228-52079d296149 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:52.019939 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d171d5b9-ece4-4184-9228-52079d296149 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:52.020501 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d171d5b9-ece4-4184-9228-52079d296149 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:52.021420 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d171d5b9-ece4-4184-9228-52079d296149 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:52.021938 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d171d5b9-ece4-4184-9228-52079d296149 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:52.056047 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d171d5b9-ece4-4184-9228-52079d296149 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048277 Nov 02 23:12:52.056890 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 477/966] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:52 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:52.243591 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b6b2ffd2-6169-4f32-9ee3-49d8e7cb62d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:52.244196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b6b2ffd2-6169-4f32-9ee3-49d8e7cb62d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:52.251360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6b2ffd2-6169-4f32-9ee3-49d8e7cb62d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:52.251804 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6b2ffd2-6169-4f32-9ee3-49d8e7cb62d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:52.252585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6b2ffd2-6169-4f32-9ee3-49d8e7cb62d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:52.253011 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6b2ffd2-6169-4f32-9ee3-49d8e7cb62d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:52.407459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b6b2ffd2-6169-4f32-9ee3-49d8e7cb62d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:52.416053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b6b2ffd2-6169-4f32-9ee3-49d8e7cb62d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:52.417555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b6b2ffd2-6169-4f32-9ee3-49d8e7cb62d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:52.418745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b6b2ffd2-6169-4f32-9ee3-49d8e7cb62d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.178851 Nov 02 23:12:52.419393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 490/967] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:52 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:52.600606 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-44e3712d-a3e6-4db8-9c84-f5170916bfcb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:52.601542 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-44e3712d-a3e6-4db8-9c84-f5170916bfcb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:52.609181 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-44e3712d-a3e6-4db8-9c84-f5170916bfcb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:52.609741 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-44e3712d-a3e6-4db8-9c84-f5170916bfcb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:52.610570 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-44e3712d-a3e6-4db8-9c84-f5170916bfcb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:52.611094 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-44e3712d-a3e6-4db8-9c84-f5170916bfcb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:52.648692 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-44e3712d-a3e6-4db8-9c84-f5170916bfcb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053003 Nov 02 23:12:52.649646 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 478/968] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:52 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:53.068223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-caa80422-6f83-4061-b82d-6dbf89bb2bd7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:53.069142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-caa80422-6f83-4061-b82d-6dbf89bb2bd7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:53.075637 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-caa80422-6f83-4061-b82d-6dbf89bb2bd7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:53.076083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-caa80422-6f83-4061-b82d-6dbf89bb2bd7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:53.076873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-caa80422-6f83-4061-b82d-6dbf89bb2bd7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:53.077302 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-caa80422-6f83-4061-b82d-6dbf89bb2bd7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:53.122003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-caa80422-6f83-4061-b82d-6dbf89bb2bd7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057168 Nov 02 23:12:53.123110 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 491/969] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:53 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:53.437198 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-db8c3877-d892-4dea-a254-9f37cdfba557 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:53.437787 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-db8c3877-d892-4dea-a254-9f37cdfba557 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:53.444132 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-db8c3877-d892-4dea-a254-9f37cdfba557 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:53.444578 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-db8c3877-d892-4dea-a254-9f37cdfba557 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:53.445355 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-db8c3877-d892-4dea-a254-9f37cdfba557 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:53.445785 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-db8c3877-d892-4dea-a254-9f37cdfba557 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:53.592949 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-db8c3877-d892-4dea-a254-9f37cdfba557 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:53.601711 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-db8c3877-d892-4dea-a254-9f37cdfba557 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:53.603241 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-db8c3877-d892-4dea-a254-9f37cdfba557 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:53.604608 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-db8c3877-d892-4dea-a254-9f37cdfba557 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.171161 Nov 02 23:12:53.605198 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 479/970] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:53 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:12:53.661727 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-286743f6-8c78-4341-b4f2-591df3a9d681 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:53.662878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-286743f6-8c78-4341-b4f2-591df3a9d681 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:53.669824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-286743f6-8c78-4341-b4f2-591df3a9d681 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:53.670842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-286743f6-8c78-4341-b4f2-591df3a9d681 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:53.671694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-286743f6-8c78-4341-b4f2-591df3a9d681 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:53.672177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-286743f6-8c78-4341-b4f2-591df3a9d681 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:53.704999 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-286743f6-8c78-4341-b4f2-591df3a9d681 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047119 Nov 02 23:12:53.705678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 492/971] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:53 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:54.136874 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f8f1f400-0e5e-47d7-97b1-d7340671b0d7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:54.138263 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f8f1f400-0e5e-47d7-97b1-d7340671b0d7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:54.145515 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f8f1f400-0e5e-47d7-97b1-d7340671b0d7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:54.145966 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f8f1f400-0e5e-47d7-97b1-d7340671b0d7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:54.146754 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f8f1f400-0e5e-47d7-97b1-d7340671b0d7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:54.147219 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f8f1f400-0e5e-47d7-97b1-d7340671b0d7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:54.178715 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f8f1f400-0e5e-47d7-97b1-d7340671b0d7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045820 Nov 02 23:12:54.179475 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 480/972] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:54 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:54.623080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-17f0846f-c769-4294-a676-3528ff07e7fa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:54.624229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-17f0846f-c769-4294-a676-3528ff07e7fa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:54.630691 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17f0846f-c769-4294-a676-3528ff07e7fa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:54.631189 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17f0846f-c769-4294-a676-3528ff07e7fa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:54.631972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17f0846f-c769-4294-a676-3528ff07e7fa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:54.632405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17f0846f-c769-4294-a676-3528ff07e7fa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:54.720778 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-de7296ba-209f-4f77-a453-228817bd3484 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:54.722401 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-de7296ba-209f-4f77-a453-228817bd3484 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:54.731809 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-de7296ba-209f-4f77-a453-228817bd3484 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:54.733114 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-de7296ba-209f-4f77-a453-228817bd3484 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:54.734473 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-de7296ba-209f-4f77-a453-228817bd3484 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:54.735263 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-de7296ba-209f-4f77-a453-228817bd3484 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:54.769061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-17f0846f-c769-4294-a676-3528ff07e7fa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:54.778671 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-17f0846f-c769-4294-a676-3528ff07e7fa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:54.780205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-17f0846f-c769-4294-a676-3528ff07e7fa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:54.781941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-17f0846f-c769-4294-a676-3528ff07e7fa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.162288 Nov 02 23:12:54.781941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 493/973] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:54 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:12:54.790226 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-de7296ba-209f-4f77-a453-228817bd3484 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076288 Nov 02 23:12:54.791283 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 481/974] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:54 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:55.192943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e86603e3-d5d1-403a-9151-ecb4400c3a87 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:55.193908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e86603e3-d5d1-403a-9151-ecb4400c3a87 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:55.200491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e86603e3-d5d1-403a-9151-ecb4400c3a87 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:55.200992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e86603e3-d5d1-403a-9151-ecb4400c3a87 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:55.201871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e86603e3-d5d1-403a-9151-ecb4400c3a87 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:55.202339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e86603e3-d5d1-403a-9151-ecb4400c3a87 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:55.240007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e86603e3-d5d1-403a-9151-ecb4400c3a87 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050921 Nov 02 23:12:55.240726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 494/975] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:55 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:55.801387 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-033b6071-7e17-4e3a-bb38-a4542491d1ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:55.802213 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-033b6071-7e17-4e3a-bb38-a4542491d1ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:55.803580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e933cf83-3792-4238-bd62-867de62b6256 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:55.804990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e933cf83-3792-4238-bd62-867de62b6256 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:55.810098 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-033b6071-7e17-4e3a-bb38-a4542491d1ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:55.811232 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-033b6071-7e17-4e3a-bb38-a4542491d1ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:55.812196 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-033b6071-7e17-4e3a-bb38-a4542491d1ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:55.812693 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-033b6071-7e17-4e3a-bb38-a4542491d1ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:55.813164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e933cf83-3792-4238-bd62-867de62b6256 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:55.813679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e933cf83-3792-4238-bd62-867de62b6256 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:55.814560 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e933cf83-3792-4238-bd62-867de62b6256 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:55.815289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e933cf83-3792-4238-bd62-867de62b6256 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:55.853557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e933cf83-3792-4238-bd62-867de62b6256 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054790 Nov 02 23:12:55.854332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 495/976] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:55 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:55.969797 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-033b6071-7e17-4e3a-bb38-a4542491d1ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:55.978485 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-033b6071-7e17-4e3a-bb38-a4542491d1ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:55.980138 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-033b6071-7e17-4e3a-bb38-a4542491d1ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:55.981375 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-033b6071-7e17-4e3a-bb38-a4542491d1ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.185040 Nov 02 23:12:55.981988 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 482/977] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:55 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:12:56.253388 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ad0f5439-5877-40e3-86fc-d3a018dd5747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:56.254392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ad0f5439-5877-40e3-86fc-d3a018dd5747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:56.261427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad0f5439-5877-40e3-86fc-d3a018dd5747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:56.261921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad0f5439-5877-40e3-86fc-d3a018dd5747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:56.262745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad0f5439-5877-40e3-86fc-d3a018dd5747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:56.263277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad0f5439-5877-40e3-86fc-d3a018dd5747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:56.295455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ad0f5439-5877-40e3-86fc-d3a018dd5747 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046127 Nov 02 23:12:56.296043 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 496/978] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:56 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:56.867836 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-6dc8ff2c-7443-443a-bdf6-c5395b1f2a1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:56.869036 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-6dc8ff2c-7443-443a-bdf6-c5395b1f2a1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:56.876269 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6dc8ff2c-7443-443a-bdf6-c5395b1f2a1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:56.876726 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6dc8ff2c-7443-443a-bdf6-c5395b1f2a1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:56.877520 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6dc8ff2c-7443-443a-bdf6-c5395b1f2a1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:56.877967 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6dc8ff2c-7443-443a-bdf6-c5395b1f2a1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:56.912483 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-6dc8ff2c-7443-443a-bdf6-c5395b1f2a1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048574 Nov 02 23:12:56.913087 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 483/979] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:56 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:57.001192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bcc491ea-3eca-40c6-81d6-155df4431498 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:57.001879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bcc491ea-3eca-40c6-81d6-155df4431498 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:57.008490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcc491ea-3eca-40c6-81d6-155df4431498 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:57.008933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcc491ea-3eca-40c6-81d6-155df4431498 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:57.009724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcc491ea-3eca-40c6-81d6-155df4431498 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:57.010167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcc491ea-3eca-40c6-81d6-155df4431498 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:57.158286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bcc491ea-3eca-40c6-81d6-155df4431498 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:57.167230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bcc491ea-3eca-40c6-81d6-155df4431498 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:57.168732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bcc491ea-3eca-40c6-81d6-155df4431498 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:57.169930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bcc491ea-3eca-40c6-81d6-155df4431498 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.172535 Nov 02 23:12:57.170667 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 497/980] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:56 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:12:57.307269 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-2cce9698-1795-4817-8705-5439db28bf1a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:57.308177 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-2cce9698-1795-4817-8705-5439db28bf1a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:57.314711 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2cce9698-1795-4817-8705-5439db28bf1a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:57.315197 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2cce9698-1795-4817-8705-5439db28bf1a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:57.315971 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2cce9698-1795-4817-8705-5439db28bf1a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:57.316401 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2cce9698-1795-4817-8705-5439db28bf1a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:57.347417 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-2cce9698-1795-4817-8705-5439db28bf1a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043960 Nov 02 23:12:57.348068 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 484/981] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:57 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:57.924367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d4bd3abd-2df0-42d6-a188-cfb3a32950f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:57.925200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d4bd3abd-2df0-42d6-a188-cfb3a32950f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:57.932176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d4bd3abd-2df0-42d6-a188-cfb3a32950f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:57.932631 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d4bd3abd-2df0-42d6-a188-cfb3a32950f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:57.933447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d4bd3abd-2df0-42d6-a188-cfb3a32950f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:57.933884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d4bd3abd-2df0-42d6-a188-cfb3a32950f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:57.966696 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d4bd3abd-2df0-42d6-a188-cfb3a32950f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046176 Nov 02 23:12:57.967924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 498/982] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:57 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:58.188826 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-6a7c919c-b438-4ac1-9b57-b537030bba0e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:58.189398 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-6a7c919c-b438-4ac1-9b57-b537030bba0e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:58.196450 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6a7c919c-b438-4ac1-9b57-b537030bba0e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:58.196950 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6a7c919c-b438-4ac1-9b57-b537030bba0e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:58.197804 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6a7c919c-b438-4ac1-9b57-b537030bba0e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:58.198289 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6a7c919c-b438-4ac1-9b57-b537030bba0e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:58.359092 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6a7c919c-b438-4ac1-9b57-b537030bba0e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:58.362209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-15cc27a3-3ec6-4495-a95c-2aa84d26695e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:58.363817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-15cc27a3-3ec6-4495-a95c-2aa84d26695e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:58.369594 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6a7c919c-b438-4ac1-9b57-b537030bba0e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:58.371100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15cc27a3-3ec6-4495-a95c-2aa84d26695e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:58.371346 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6a7c919c-b438-4ac1-9b57-b537030bba0e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:58.371786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15cc27a3-3ec6-4495-a95c-2aa84d26695e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:58.372443 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-6a7c919c-b438-4ac1-9b57-b537030bba0e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.188105 Nov 02 23:12:58.372831 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15cc27a3-3ec6-4495-a95c-2aa84d26695e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:58.373493 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 485/983] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:58 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:12:58.373689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15cc27a3-3ec6-4495-a95c-2aa84d26695e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:58.406122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-15cc27a3-3ec6-4495-a95c-2aa84d26695e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050354 Nov 02 23:12:58.406719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 499/984] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:58 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:12:58.980707 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-abc0f5b4-a6f1-486d-ab14-2b1eda1aa2b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:58.981688 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-abc0f5b4-a6f1-486d-ab14-2b1eda1aa2b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:58.988206 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-abc0f5b4-a6f1-486d-ab14-2b1eda1aa2b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:58.988657 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-abc0f5b4-a6f1-486d-ab14-2b1eda1aa2b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:58.989443 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-abc0f5b4-a6f1-486d-ab14-2b1eda1aa2b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:58.989878 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-abc0f5b4-a6f1-486d-ab14-2b1eda1aa2b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:59.022259 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-abc0f5b4-a6f1-486d-ab14-2b1eda1aa2b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045272 Nov 02 23:12:59.022851 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 486/985] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:58 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:59.390724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6d0b4096-f7a9-4c30-a7e8-0ab18f91fbf9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:59.391396 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6d0b4096-f7a9-4c30-a7e8-0ab18f91fbf9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:59.398221 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6d0b4096-f7a9-4c30-a7e8-0ab18f91fbf9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:59.398673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6d0b4096-f7a9-4c30-a7e8-0ab18f91fbf9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:59.399510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6d0b4096-f7a9-4c30-a7e8-0ab18f91fbf9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:59.399953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6d0b4096-f7a9-4c30-a7e8-0ab18f91fbf9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:59.418116 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f147ef13-650b-4ea5-9c26-40c3c8dcea6f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:12:59.419449 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f147ef13-650b-4ea5-9c26-40c3c8dcea6f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:12:59.427636 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f147ef13-650b-4ea5-9c26-40c3c8dcea6f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:59.428272 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f147ef13-650b-4ea5-9c26-40c3c8dcea6f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:59.429290 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f147ef13-650b-4ea5-9c26-40c3c8dcea6f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:12:59.429894 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f147ef13-650b-4ea5-9c26-40c3c8dcea6f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:12:59.464135 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f147ef13-650b-4ea5-9c26-40c3c8dcea6f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050041 Nov 02 23:12:59.465021 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 487/986] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:12:59 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:12:59.553982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6d0b4096-f7a9-4c30-a7e8-0ab18f91fbf9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:59.564101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6d0b4096-f7a9-4c30-a7e8-0ab18f91fbf9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:59.565724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6d0b4096-f7a9-4c30-a7e8-0ab18f91fbf9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:12:59.567178 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6d0b4096-f7a9-4c30-a7e8-0ab18f91fbf9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.180585 Nov 02 23:12:59.567817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 500/987] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:12:59 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:00.033891 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e0b8f27c-63d6-413f-a028-0907acb4df4a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:00.034808 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e0b8f27c-63d6-413f-a028-0907acb4df4a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:00.041133 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e0b8f27c-63d6-413f-a028-0907acb4df4a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:00.041580 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e0b8f27c-63d6-413f-a028-0907acb4df4a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:00.042369 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e0b8f27c-63d6-413f-a028-0907acb4df4a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:00.042804 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e0b8f27c-63d6-413f-a028-0907acb4df4a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:00.074679 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e0b8f27c-63d6-413f-a028-0907acb4df4a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044501 Nov 02 23:13:00.075302 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 488/988] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:00 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:00.478446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7cb60d31-6988-4bd1-b97b-3e5dbb28e344 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:00.479412 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7cb60d31-6988-4bd1-b97b-3e5dbb28e344 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:00.486650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7cb60d31-6988-4bd1-b97b-3e5dbb28e344 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:00.487141 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7cb60d31-6988-4bd1-b97b-3e5dbb28e344 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:00.487946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7cb60d31-6988-4bd1-b97b-3e5dbb28e344 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:00.488384 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7cb60d31-6988-4bd1-b97b-3e5dbb28e344 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:00.520473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7cb60d31-6988-4bd1-b97b-3e5dbb28e344 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045800 Nov 02 23:13:00.521075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 501/989] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:00 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:00.585588 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-37c1a6c2-355e-42f1-9059-29adc1ca4d9e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:00.586203 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-37c1a6c2-355e-42f1-9059-29adc1ca4d9e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:00.593260 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-37c1a6c2-355e-42f1-9059-29adc1ca4d9e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:00.593701 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-37c1a6c2-355e-42f1-9059-29adc1ca4d9e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:00.594479 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-37c1a6c2-355e-42f1-9059-29adc1ca4d9e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:00.594907 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-37c1a6c2-355e-42f1-9059-29adc1ca4d9e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:00.762000 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-37c1a6c2-355e-42f1-9059-29adc1ca4d9e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:00.778037 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-37c1a6c2-355e-42f1-9059-29adc1ca4d9e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:00.781170 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-37c1a6c2-355e-42f1-9059-29adc1ca4d9e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:00.783332 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-37c1a6c2-355e-42f1-9059-29adc1ca4d9e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.201165 Nov 02 23:13:00.784323 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 489/990] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:00 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:01.086139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d3e5703d-80ee-4929-b2d1-6d8188914042 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:01.087072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d3e5703d-80ee-4929-b2d1-6d8188914042 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:01.093790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3e5703d-80ee-4929-b2d1-6d8188914042 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:01.094232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3e5703d-80ee-4929-b2d1-6d8188914042 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:01.095078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3e5703d-80ee-4929-b2d1-6d8188914042 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:01.095514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3e5703d-80ee-4929-b2d1-6d8188914042 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:01.129812 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d3e5703d-80ee-4929-b2d1-6d8188914042 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047705 Nov 02 23:13:01.130689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 502/991] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:01 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:01.533588 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-22029883-359b-49fc-9f21-db7afafc2348 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:01.534457 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-22029883-359b-49fc-9f21-db7afafc2348 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:01.540792 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-22029883-359b-49fc-9f21-db7afafc2348 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:01.541252 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-22029883-359b-49fc-9f21-db7afafc2348 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:01.542059 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-22029883-359b-49fc-9f21-db7afafc2348 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:01.542502 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-22029883-359b-49fc-9f21-db7afafc2348 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:01.575237 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-22029883-359b-49fc-9f21-db7afafc2348 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046607 Nov 02 23:13:01.575836 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 490/992] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:01 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:01.805223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9e727071-3092-4f1e-812d-efb19638e7ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:01.806147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9e727071-3092-4f1e-812d-efb19638e7ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:01.813924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e727071-3092-4f1e-812d-efb19638e7ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:01.814447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e727071-3092-4f1e-812d-efb19638e7ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:01.815473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e727071-3092-4f1e-812d-efb19638e7ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:01.816169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e727071-3092-4f1e-812d-efb19638e7ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:01.964167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9e727071-3092-4f1e-812d-efb19638e7ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:01.974048 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9e727071-3092-4f1e-812d-efb19638e7ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:01.975778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9e727071-3092-4f1e-812d-efb19638e7ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:01.977008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9e727071-3092-4f1e-812d-efb19638e7ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.178178 Nov 02 23:13:01.977646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 503/993] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:01 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:02.142138 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-4b470032-1207-4f97-88cb-a2af7110900a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:02.142990 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-4b470032-1207-4f97-88cb-a2af7110900a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:02.149650 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4b470032-1207-4f97-88cb-a2af7110900a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:02.150101 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4b470032-1207-4f97-88cb-a2af7110900a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:02.150991 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4b470032-1207-4f97-88cb-a2af7110900a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:02.151431 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4b470032-1207-4f97-88cb-a2af7110900a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:02.183196 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-4b470032-1207-4f97-88cb-a2af7110900a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045343 Nov 02 23:13:02.183779 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 491/994] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:02 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:02.587134 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d983ad6e-ed40-4edb-93d0-59a237f10e5a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:02.588036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d983ad6e-ed40-4edb-93d0-59a237f10e5a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:02.594802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d983ad6e-ed40-4edb-93d0-59a237f10e5a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:02.595282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d983ad6e-ed40-4edb-93d0-59a237f10e5a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:02.596095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d983ad6e-ed40-4edb-93d0-59a237f10e5a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:02.596491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d983ad6e-ed40-4edb-93d0-59a237f10e5a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:02.627241 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d983ad6e-ed40-4edb-93d0-59a237f10e5a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043759 Nov 02 23:13:02.628042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 504/995] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:02 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:02.996679 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-4fbc079d-9279-445b-943a-be78f0061d60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:02.997281 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-4fbc079d-9279-445b-943a-be78f0061d60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:03.006811 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4fbc079d-9279-445b-943a-be78f0061d60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:03.007624 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4fbc079d-9279-445b-943a-be78f0061d60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:03.008983 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4fbc079d-9279-445b-943a-be78f0061d60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:03.009742 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4fbc079d-9279-445b-943a-be78f0061d60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:03.194600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-07b916fb-2964-48ea-941c-9c7cedf0941c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:03.195681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-07b916fb-2964-48ea-941c-9c7cedf0941c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:03.213059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-07b916fb-2964-48ea-941c-9c7cedf0941c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:03.213636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-07b916fb-2964-48ea-941c-9c7cedf0941c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:03.214956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-07b916fb-2964-48ea-941c-9c7cedf0941c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:03.215657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-07b916fb-2964-48ea-941c-9c7cedf0941c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:03.236382 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-4fbc079d-9279-445b-943a-be78f0061d60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:03.247391 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-4fbc079d-9279-445b-943a-be78f0061d60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:03.249831 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-4fbc079d-9279-445b-943a-be78f0061d60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:03.251502 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-4fbc079d-9279-445b-943a-be78f0061d60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.258586 Nov 02 23:13:03.252181 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 492/996] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:02 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:03.271042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-07b916fb-2964-48ea-941c-9c7cedf0941c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080225 Nov 02 23:13:03.272240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 505/997] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:03 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:03.640084 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-dedd74b6-d19e-4472-acaf-344133c5c5b5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:03.641010 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-dedd74b6-d19e-4472-acaf-344133c5c5b5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:03.647301 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dedd74b6-d19e-4472-acaf-344133c5c5b5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:03.647742 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dedd74b6-d19e-4472-acaf-344133c5c5b5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:03.648539 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dedd74b6-d19e-4472-acaf-344133c5c5b5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:03.648979 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dedd74b6-d19e-4472-acaf-344133c5c5b5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:03.684787 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-dedd74b6-d19e-4472-acaf-344133c5c5b5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048624 Nov 02 23:13:03.685910 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 493/998] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:03 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:04.280628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9f61cfa7-c4d8-4e4b-820a-0067f443d9c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:04.281442 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9f61cfa7-c4d8-4e4b-820a-0067f443d9c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:04.285209 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-1830a9d0-896d-4c86-9899-839b9c928b43 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:04.286107 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-1830a9d0-896d-4c86-9899-839b9c928b43 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:04.289632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f61cfa7-c4d8-4e4b-820a-0067f443d9c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:04.290280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f61cfa7-c4d8-4e4b-820a-0067f443d9c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:04.291313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f61cfa7-c4d8-4e4b-820a-0067f443d9c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:04.291841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f61cfa7-c4d8-4e4b-820a-0067f443d9c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:04.294368 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1830a9d0-896d-4c86-9899-839b9c928b43 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:04.295137 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1830a9d0-896d-4c86-9899-839b9c928b43 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:04.296248 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1830a9d0-896d-4c86-9899-839b9c928b43 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:04.296954 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-1830a9d0-896d-4c86-9899-839b9c928b43 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:04.335316 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-1830a9d0-896d-4c86-9899-839b9c928b43 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055944 Nov 02 23:13:04.336120 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 494/999] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:04 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:04.445367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9f61cfa7-c4d8-4e4b-820a-0067f443d9c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:04.455359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9f61cfa7-c4d8-4e4b-820a-0067f443d9c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:04.457014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9f61cfa7-c4d8-4e4b-820a-0067f443d9c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:04.458192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9f61cfa7-c4d8-4e4b-820a-0067f443d9c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.182615 Nov 02 23:13:04.458754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 506/1000] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:04 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:04.697285 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-fe20f7e9-3dfd-479c-bf9d-3a934bb5e322 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:04.698320 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-fe20f7e9-3dfd-479c-bf9d-3a934bb5e322 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:04.705360 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fe20f7e9-3dfd-479c-bf9d-3a934bb5e322 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:04.705847 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fe20f7e9-3dfd-479c-bf9d-3a934bb5e322 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:04.706748 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fe20f7e9-3dfd-479c-bf9d-3a934bb5e322 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:04.707308 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fe20f7e9-3dfd-479c-bf9d-3a934bb5e322 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:04.741210 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-fe20f7e9-3dfd-479c-bf9d-3a934bb5e322 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047748 Nov 02 23:13:04.741785 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 495/1001] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:04 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:05.347884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-be8ed93e-6954-4b99-922f-5429f59517dc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:05.348968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-be8ed93e-6954-4b99-922f-5429f59517dc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:05.355767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be8ed93e-6954-4b99-922f-5429f59517dc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:05.356216 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be8ed93e-6954-4b99-922f-5429f59517dc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:05.356998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be8ed93e-6954-4b99-922f-5429f59517dc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:05.357926 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be8ed93e-6954-4b99-922f-5429f59517dc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:05.388315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-be8ed93e-6954-4b99-922f-5429f59517dc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044174 Nov 02 23:13:05.388992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 507/1002] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:05 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:05.477556 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-4c89a4c8-99e2-4fbf-b032-68aa0f81c9c5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:05.478222 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-4c89a4c8-99e2-4fbf-b032-68aa0f81c9c5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:05.485735 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4c89a4c8-99e2-4fbf-b032-68aa0f81c9c5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:05.486173 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4c89a4c8-99e2-4fbf-b032-68aa0f81c9c5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:05.486970 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4c89a4c8-99e2-4fbf-b032-68aa0f81c9c5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:05.487402 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4c89a4c8-99e2-4fbf-b032-68aa0f81c9c5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:05.658820 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-4c89a4c8-99e2-4fbf-b032-68aa0f81c9c5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:05.669137 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-4c89a4c8-99e2-4fbf-b032-68aa0f81c9c5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:05.672197 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-4c89a4c8-99e2-4fbf-b032-68aa0f81c9c5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:05.674111 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-4c89a4c8-99e2-4fbf-b032-68aa0f81c9c5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.200428 Nov 02 23:13:05.675061 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 496/1003] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:05 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:05.752910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8bdb18d7-7062-4891-9487-537a627f8f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:05.753701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8bdb18d7-7062-4891-9487-537a627f8f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:05.759840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bdb18d7-7062-4891-9487-537a627f8f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:05.760329 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bdb18d7-7062-4891-9487-537a627f8f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:05.761147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bdb18d7-7062-4891-9487-537a627f8f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:05.761714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bdb18d7-7062-4891-9487-537a627f8f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:05.792104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8bdb18d7-7062-4891-9487-537a627f8f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043053 Nov 02 23:13:05.792915 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 508/1004] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:05 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:06.399695 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-2541ff01-bdcb-4dcf-b22f-3428ea9f035f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:06.400532 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-2541ff01-bdcb-4dcf-b22f-3428ea9f035f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:06.407467 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2541ff01-bdcb-4dcf-b22f-3428ea9f035f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:06.407912 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2541ff01-bdcb-4dcf-b22f-3428ea9f035f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:06.408695 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2541ff01-bdcb-4dcf-b22f-3428ea9f035f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:06.409131 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2541ff01-bdcb-4dcf-b22f-3428ea9f035f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:06.440238 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-2541ff01-bdcb-4dcf-b22f-3428ea9f035f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044376 Nov 02 23:13:06.440901 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 497/1005] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:06 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:06.705556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-827c3825-ee32-4868-bc12-07d233284f74 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:06.706277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-827c3825-ee32-4868-bc12-07d233284f74 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:06.713895 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-827c3825-ee32-4868-bc12-07d233284f74 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:06.714682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-827c3825-ee32-4868-bc12-07d233284f74 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:06.715709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-827c3825-ee32-4868-bc12-07d233284f74 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:06.716253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-827c3825-ee32-4868-bc12-07d233284f74 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:06.804622 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d4d841ac-c885-475b-aa07-4a5bf7fe6ca5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:06.805543 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d4d841ac-c885-475b-aa07-4a5bf7fe6ca5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:06.812163 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d4d841ac-c885-475b-aa07-4a5bf7fe6ca5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:06.812620 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d4d841ac-c885-475b-aa07-4a5bf7fe6ca5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:06.813522 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d4d841ac-c885-475b-aa07-4a5bf7fe6ca5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:06.813965 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d4d841ac-c885-475b-aa07-4a5bf7fe6ca5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:06.852330 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d4d841ac-c885-475b-aa07-4a5bf7fe6ca5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051475 Nov 02 23:13:06.852957 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 498/1006] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:06 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:06.912783 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-827c3825-ee32-4868-bc12-07d233284f74 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:06.922954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-827c3825-ee32-4868-bc12-07d233284f74 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:06.924465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-827c3825-ee32-4868-bc12-07d233284f74 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:06.925661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-827c3825-ee32-4868-bc12-07d233284f74 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.225306 Nov 02 23:13:06.926241 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 509/1007] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:06 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:07.452529 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-eb853aa2-a7fa-401b-bf6d-275cb8e923f9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:07.453657 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-eb853aa2-a7fa-401b-bf6d-275cb8e923f9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:07.460323 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-eb853aa2-a7fa-401b-bf6d-275cb8e923f9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:07.460771 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-eb853aa2-a7fa-401b-bf6d-275cb8e923f9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:07.461578 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-eb853aa2-a7fa-401b-bf6d-275cb8e923f9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:07.462013 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-eb853aa2-a7fa-401b-bf6d-275cb8e923f9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:07.496456 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-eb853aa2-a7fa-401b-bf6d-275cb8e923f9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047993 Nov 02 23:13:07.497056 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 499/1008] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:07 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:07.867461 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-191c4faf-bb3a-4f43-af9d-6dac8c703c26 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:07.868967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-191c4faf-bb3a-4f43-af9d-6dac8c703c26 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:07.879868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-191c4faf-bb3a-4f43-af9d-6dac8c703c26 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:07.880621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-191c4faf-bb3a-4f43-af9d-6dac8c703c26 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:07.881947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-191c4faf-bb3a-4f43-af9d-6dac8c703c26 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:07.882692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-191c4faf-bb3a-4f43-af9d-6dac8c703c26 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:07.915020 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-191c4faf-bb3a-4f43-af9d-6dac8c703c26 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054167 Nov 02 23:13:07.915601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 510/1009] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:07 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:07.944397 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-524810ad-1940-41fc-a513-a6d247c23334 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:07.944979 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-524810ad-1940-41fc-a513-a6d247c23334 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:07.951783 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-524810ad-1940-41fc-a513-a6d247c23334 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:07.952225 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-524810ad-1940-41fc-a513-a6d247c23334 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:07.953255 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-524810ad-1940-41fc-a513-a6d247c23334 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:07.953690 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-524810ad-1940-41fc-a513-a6d247c23334 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:08.103592 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-524810ad-1940-41fc-a513-a6d247c23334 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:08.116280 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-524810ad-1940-41fc-a513-a6d247c23334 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:08.119232 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-524810ad-1940-41fc-a513-a6d247c23334 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:08.121428 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-524810ad-1940-41fc-a513-a6d247c23334 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.180476 Nov 02 23:13:08.122676 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 500/1010] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:07 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:13:08.511092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3c0d9571-d201-4594-b33b-406d743943a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:08.512054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3c0d9571-d201-4594-b33b-406d743943a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:08.518457 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c0d9571-d201-4594-b33b-406d743943a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:08.518976 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c0d9571-d201-4594-b33b-406d743943a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:08.519814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c0d9571-d201-4594-b33b-406d743943a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:08.520325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c0d9571-d201-4594-b33b-406d743943a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:08.550806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3c0d9571-d201-4594-b33b-406d743943a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044038 Nov 02 23:13:08.551413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 511/1011] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:08 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:08.929335 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-0c9f1bfb-3a67-475b-b0bd-c9cbe6d2f331 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:08.930396 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-0c9f1bfb-3a67-475b-b0bd-c9cbe6d2f331 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:08.937067 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0c9f1bfb-3a67-475b-b0bd-c9cbe6d2f331 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:08.937633 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0c9f1bfb-3a67-475b-b0bd-c9cbe6d2f331 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:08.938438 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0c9f1bfb-3a67-475b-b0bd-c9cbe6d2f331 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:08.938864 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0c9f1bfb-3a67-475b-b0bd-c9cbe6d2f331 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:08.969553 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-0c9f1bfb-3a67-475b-b0bd-c9cbe6d2f331 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043894 Nov 02 23:13:08.970317 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 501/1012] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:08 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:09.146869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7bc93b9c-59b9-4557-a2f4-f163b797f75d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:09.147497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7bc93b9c-59b9-4557-a2f4-f163b797f75d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:09.153968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7bc93b9c-59b9-4557-a2f4-f163b797f75d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:09.154974 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7bc93b9c-59b9-4557-a2f4-f163b797f75d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:09.155816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7bc93b9c-59b9-4557-a2f4-f163b797f75d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:09.156245 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7bc93b9c-59b9-4557-a2f4-f163b797f75d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:09.321229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7bc93b9c-59b9-4557-a2f4-f163b797f75d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:09.330481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7bc93b9c-59b9-4557-a2f4-f163b797f75d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:09.332020 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7bc93b9c-59b9-4557-a2f4-f163b797f75d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:09.333201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7bc93b9c-59b9-4557-a2f4-f163b797f75d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.190735 Nov 02 23:13:09.333787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 512/1013] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:09 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:13:09.563039 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-9e079fdd-2943-4d80-936a-9374744d4d2d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:09.563943 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-9e079fdd-2943-4d80-936a-9374744d4d2d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:09.569953 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9e079fdd-2943-4d80-936a-9374744d4d2d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:09.570391 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9e079fdd-2943-4d80-936a-9374744d4d2d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:09.571206 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9e079fdd-2943-4d80-936a-9374744d4d2d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:09.571634 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9e079fdd-2943-4d80-936a-9374744d4d2d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:09.603714 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-9e079fdd-2943-4d80-936a-9374744d4d2d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045084 Nov 02 23:13:09.604401 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 502/1014] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:09 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:09.981752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-05e16929-b60d-4e8b-b5dd-b61c1969d8c7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:09.983577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-05e16929-b60d-4e8b-b5dd-b61c1969d8c7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:09.991419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05e16929-b60d-4e8b-b5dd-b61c1969d8c7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:09.991916 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05e16929-b60d-4e8b-b5dd-b61c1969d8c7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:09.992748 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05e16929-b60d-4e8b-b5dd-b61c1969d8c7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:09.993229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05e16929-b60d-4e8b-b5dd-b61c1969d8c7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:10.026481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-05e16929-b60d-4e8b-b5dd-b61c1969d8c7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048687 Nov 02 23:13:10.027216 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 513/1015] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:09 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:10.352518 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-49bf93ed-fd8d-4b2e-a18b-e6eaf179ef05 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:10.353146 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-49bf93ed-fd8d-4b2e-a18b-e6eaf179ef05 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:10.361090 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-49bf93ed-fd8d-4b2e-a18b-e6eaf179ef05 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:10.361718 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-49bf93ed-fd8d-4b2e-a18b-e6eaf179ef05 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:10.362584 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-49bf93ed-fd8d-4b2e-a18b-e6eaf179ef05 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:10.363112 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-49bf93ed-fd8d-4b2e-a18b-e6eaf179ef05 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:10.510195 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-49bf93ed-fd8d-4b2e-a18b-e6eaf179ef05 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:10.520002 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-49bf93ed-fd8d-4b2e-a18b-e6eaf179ef05 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:10.522348 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-49bf93ed-fd8d-4b2e-a18b-e6eaf179ef05 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:10.523574 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-49bf93ed-fd8d-4b2e-a18b-e6eaf179ef05 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.175104 Nov 02 23:13:10.524151 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 503/1016] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:10 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:10.616544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-19fb3814-6ea6-45ad-bae3-370b3a5217ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:10.617469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-19fb3814-6ea6-45ad-bae3-370b3a5217ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:10.624398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19fb3814-6ea6-45ad-bae3-370b3a5217ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:10.624842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19fb3814-6ea6-45ad-bae3-370b3a5217ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:10.625659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19fb3814-6ea6-45ad-bae3-370b3a5217ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:10.626085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19fb3814-6ea6-45ad-bae3-370b3a5217ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:10.659158 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-19fb3814-6ea6-45ad-bae3-370b3a5217ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046498 Nov 02 23:13:10.659744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 514/1017] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:10 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:11.039597 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-bc8e0f68-069c-42a3-92c5-880a4dcdb3e6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:11.040621 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-bc8e0f68-069c-42a3-92c5-880a4dcdb3e6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:11.047298 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bc8e0f68-069c-42a3-92c5-880a4dcdb3e6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:11.047795 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bc8e0f68-069c-42a3-92c5-880a4dcdb3e6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:11.048634 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bc8e0f68-069c-42a3-92c5-880a4dcdb3e6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:11.049132 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bc8e0f68-069c-42a3-92c5-880a4dcdb3e6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:11.084569 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-bc8e0f68-069c-42a3-92c5-880a4dcdb3e6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049117 Nov 02 23:13:11.085180 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 504/1018] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:11 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:11.543550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ef29ac08-4d5b-457c-91e0-69d92a2200fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:11.544147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ef29ac08-4d5b-457c-91e0-69d92a2200fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:11.550310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ef29ac08-4d5b-457c-91e0-69d92a2200fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:11.550750 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ef29ac08-4d5b-457c-91e0-69d92a2200fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:11.551569 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ef29ac08-4d5b-457c-91e0-69d92a2200fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:11.551992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ef29ac08-4d5b-457c-91e0-69d92a2200fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:11.674459 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-76abb466-bce8-43c5-992d-319ee98f209d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:11.676282 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-76abb466-bce8-43c5-992d-319ee98f209d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:11.686410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ef29ac08-4d5b-457c-91e0-69d92a2200fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:11.688069 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-76abb466-bce8-43c5-992d-319ee98f209d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:11.688866 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-76abb466-bce8-43c5-992d-319ee98f209d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:11.690232 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-76abb466-bce8-43c5-992d-319ee98f209d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:11.691047 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-76abb466-bce8-43c5-992d-319ee98f209d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:11.695951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ef29ac08-4d5b-457c-91e0-69d92a2200fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:11.697450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ef29ac08-4d5b-457c-91e0-69d92a2200fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:11.698618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ef29ac08-4d5b-457c-91e0-69d92a2200fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.158824 Nov 02 23:13:11.699264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 515/1019] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:11 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:13:11.745913 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-76abb466-bce8-43c5-992d-319ee98f209d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078371 Nov 02 23:13:11.746998 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 505/1020] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:11 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:12.096252 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-315ab370-e824-4243-866d-2a7a07bd48af tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:12.097164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-315ab370-e824-4243-866d-2a7a07bd48af tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:12.103323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-315ab370-e824-4243-866d-2a7a07bd48af tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:12.103771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-315ab370-e824-4243-866d-2a7a07bd48af tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:12.104554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-315ab370-e824-4243-866d-2a7a07bd48af tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:12.104983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-315ab370-e824-4243-866d-2a7a07bd48af tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:12.136711 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-315ab370-e824-4243-866d-2a7a07bd48af tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044174 Nov 02 23:13:12.137309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 516/1021] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:12 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:12.718007 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-6eb5bb1c-daac-448f-9c0a-9f7ec644918e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:12.718778 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-6eb5bb1c-daac-448f-9c0a-9f7ec644918e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:12.725993 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6eb5bb1c-daac-448f-9c0a-9f7ec644918e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:12.726494 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6eb5bb1c-daac-448f-9c0a-9f7ec644918e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:12.727413 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6eb5bb1c-daac-448f-9c0a-9f7ec644918e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:12.727938 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6eb5bb1c-daac-448f-9c0a-9f7ec644918e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:12.759059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bf2c9610-7447-4f2d-a0f0-0d111e39c5b8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:12.760084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bf2c9610-7447-4f2d-a0f0-0d111e39c5b8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:12.767843 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf2c9610-7447-4f2d-a0f0-0d111e39c5b8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:12.768401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf2c9610-7447-4f2d-a0f0-0d111e39c5b8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:12.769430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf2c9610-7447-4f2d-a0f0-0d111e39c5b8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:12.769928 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf2c9610-7447-4f2d-a0f0-0d111e39c5b8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:12.808690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bf2c9610-7447-4f2d-a0f0-0d111e39c5b8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053235 Nov 02 23:13:12.809730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 517/1022] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:12 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:12.884666 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6eb5bb1c-daac-448f-9c0a-9f7ec644918e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:12.894197 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6eb5bb1c-daac-448f-9c0a-9f7ec644918e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:12.895708 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-6eb5bb1c-daac-448f-9c0a-9f7ec644918e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:12.896878 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-6eb5bb1c-daac-448f-9c0a-9f7ec644918e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.182903 Nov 02 23:13:12.897441 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 506/1023] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:12 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:13.149408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-29ca208f-4a1c-47c7-a687-d777e381f67d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:13.150235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-29ca208f-4a1c-47c7-a687-d777e381f67d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:13.156981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-29ca208f-4a1c-47c7-a687-d777e381f67d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:13.157426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-29ca208f-4a1c-47c7-a687-d777e381f67d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:13.158215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-29ca208f-4a1c-47c7-a687-d777e381f67d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:13.158646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-29ca208f-4a1c-47c7-a687-d777e381f67d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:13.192837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-29ca208f-4a1c-47c7-a687-d777e381f67d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047161 Nov 02 23:13:13.193545 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 518/1024] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:13 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:13.823080 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-958543cf-ca89-443d-b182-faf0c8ae2e14 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:13.824090 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-958543cf-ca89-443d-b182-faf0c8ae2e14 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:13.832358 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-958543cf-ca89-443d-b182-faf0c8ae2e14 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:13.832894 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-958543cf-ca89-443d-b182-faf0c8ae2e14 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:13.833835 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-958543cf-ca89-443d-b182-faf0c8ae2e14 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:13.834381 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-958543cf-ca89-443d-b182-faf0c8ae2e14 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:13.867399 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-958543cf-ca89-443d-b182-faf0c8ae2e14 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048253 Nov 02 23:13:13.867978 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 507/1025] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:13 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:13.925764 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-01aefc1e-9c31-4cb5-99fc-1c7a6c0bf873 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:13.926514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-01aefc1e-9c31-4cb5-99fc-1c7a6c0bf873 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:13.932788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-01aefc1e-9c31-4cb5-99fc-1c7a6c0bf873 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:13.933289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-01aefc1e-9c31-4cb5-99fc-1c7a6c0bf873 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:13.934104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-01aefc1e-9c31-4cb5-99fc-1c7a6c0bf873 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:13.934574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-01aefc1e-9c31-4cb5-99fc-1c7a6c0bf873 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:14.084126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-01aefc1e-9c31-4cb5-99fc-1c7a6c0bf873 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:14.094145 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-01aefc1e-9c31-4cb5-99fc-1c7a6c0bf873 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:14.095781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-01aefc1e-9c31-4cb5-99fc-1c7a6c0bf873 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:14.097032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-01aefc1e-9c31-4cb5-99fc-1c7a6c0bf873 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.175078 Nov 02 23:13:14.097592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 519/1026] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:13 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:13:14.204817 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-177b3c9b-2d8f-4582-895a-9d0c8d721576 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:14.205795 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-177b3c9b-2d8f-4582-895a-9d0c8d721576 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:14.212262 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-177b3c9b-2d8f-4582-895a-9d0c8d721576 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:14.212715 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-177b3c9b-2d8f-4582-895a-9d0c8d721576 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:14.213509 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-177b3c9b-2d8f-4582-895a-9d0c8d721576 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:14.213973 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-177b3c9b-2d8f-4582-895a-9d0c8d721576 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:14.249157 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-177b3c9b-2d8f-4582-895a-9d0c8d721576 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048352 Nov 02 23:13:14.249764 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 508/1027] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:14 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:14.879138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-67ea4d3a-d3c0-4df8-849c-90671053c369 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:14.880136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-67ea4d3a-d3c0-4df8-849c-90671053c369 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:14.886653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67ea4d3a-d3c0-4df8-849c-90671053c369 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:14.887161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67ea4d3a-d3c0-4df8-849c-90671053c369 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:14.887960 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67ea4d3a-d3c0-4df8-849c-90671053c369 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:14.889072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67ea4d3a-d3c0-4df8-849c-90671053c369 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:14.921865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-67ea4d3a-d3c0-4df8-849c-90671053c369 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047214 Nov 02 23:13:14.922453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 520/1028] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:14 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:15.123883 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a5c5048b-d2bc-4ee9-a774-6164e92d4108 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:15.124783 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a5c5048b-d2bc-4ee9-a774-6164e92d4108 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:15.131429 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a5c5048b-d2bc-4ee9-a774-6164e92d4108 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:15.131872 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a5c5048b-d2bc-4ee9-a774-6164e92d4108 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:15.132639 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a5c5048b-d2bc-4ee9-a774-6164e92d4108 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:15.133060 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a5c5048b-d2bc-4ee9-a774-6164e92d4108 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:15.264915 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1fc02521-20fc-413e-a43e-3725f58ba494 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:15.266577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1fc02521-20fc-413e-a43e-3725f58ba494 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:15.277847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fc02521-20fc-413e-a43e-3725f58ba494 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:15.278649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fc02521-20fc-413e-a43e-3725f58ba494 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:15.280272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fc02521-20fc-413e-a43e-3725f58ba494 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:15.281040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fc02521-20fc-413e-a43e-3725f58ba494 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:15.313038 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-a5c5048b-d2bc-4ee9-a774-6164e92d4108 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:15.322676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1fc02521-20fc-413e-a43e-3725f58ba494 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064799 Nov 02 23:13:15.323654 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 521/1029] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:15 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:15.326697 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-a5c5048b-d2bc-4ee9-a774-6164e92d4108 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:15.329711 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-a5c5048b-d2bc-4ee9-a774-6164e92d4108 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:15.330991 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a5c5048b-d2bc-4ee9-a774-6164e92d4108 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.211003 Nov 02 23:13:15.331631 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 509/1030] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:15 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:13:15.934602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c1f64b24-03e2-409f-bbf4-041c30d96bf1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:15.935525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c1f64b24-03e2-409f-bbf4-041c30d96bf1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:15.941940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c1f64b24-03e2-409f-bbf4-041c30d96bf1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:15.942379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c1f64b24-03e2-409f-bbf4-041c30d96bf1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:15.943362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c1f64b24-03e2-409f-bbf4-041c30d96bf1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:15.943793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c1f64b24-03e2-409f-bbf4-041c30d96bf1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:15.976152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c1f64b24-03e2-409f-bbf4-041c30d96bf1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045816 Nov 02 23:13:15.976732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 522/1031] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:15 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:16.337337 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-0817a946-1c32-41a4-93ef-0de5fd48ed48 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:16.338242 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-0817a946-1c32-41a4-93ef-0de5fd48ed48 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:16.344852 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0817a946-1c32-41a4-93ef-0de5fd48ed48 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:16.345305 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0817a946-1c32-41a4-93ef-0de5fd48ed48 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:16.346085 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0817a946-1c32-41a4-93ef-0de5fd48ed48 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:16.346511 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0817a946-1c32-41a4-93ef-0de5fd48ed48 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:16.350494 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-335902fa-ded6-4511-bc1e-f2152df1a799 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:16.352332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-335902fa-ded6-4511-bc1e-f2152df1a799 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:16.363863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-335902fa-ded6-4511-bc1e-f2152df1a799 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:16.364667 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-335902fa-ded6-4511-bc1e-f2152df1a799 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:16.366092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-335902fa-ded6-4511-bc1e-f2152df1a799 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:16.366895 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-335902fa-ded6-4511-bc1e-f2152df1a799 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:16.377970 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-0817a946-1c32-41a4-93ef-0de5fd48ed48 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044398 Nov 02 23:13:16.378554 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 510/1032] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:16 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:16.549105 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-335902fa-ded6-4511-bc1e-f2152df1a799 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:16.563850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-335902fa-ded6-4511-bc1e-f2152df1a799 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:16.567055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-335902fa-ded6-4511-bc1e-f2152df1a799 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:16.569207 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-335902fa-ded6-4511-bc1e-f2152df1a799 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.222558 Nov 02 23:13:16.570149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 523/1033] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:16 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:13:16.987440 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b2505613-7832-4917-954e-925d22bcc2c2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:16.988375 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b2505613-7832-4917-954e-925d22bcc2c2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:16.995195 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b2505613-7832-4917-954e-925d22bcc2c2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:16.995803 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b2505613-7832-4917-954e-925d22bcc2c2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:16.996656 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b2505613-7832-4917-954e-925d22bcc2c2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:16.997199 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b2505613-7832-4917-954e-925d22bcc2c2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:17.030876 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b2505613-7832-4917-954e-925d22bcc2c2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047238 Nov 02 23:13:17.031601 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 511/1034] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:16 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:17.390608 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-69800822-b17c-4254-91f2-034d85a862b8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:17.391661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-69800822-b17c-4254-91f2-034d85a862b8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:17.398326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-69800822-b17c-4254-91f2-034d85a862b8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:17.398765 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-69800822-b17c-4254-91f2-034d85a862b8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:17.399576 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-69800822-b17c-4254-91f2-034d85a862b8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:17.400000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-69800822-b17c-4254-91f2-034d85a862b8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:17.432161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-69800822-b17c-4254-91f2-034d85a862b8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045735 Nov 02 23:13:17.432829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 524/1035] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:17 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:17.592082 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-2704166f-fff9-48e3-b65e-ef780bb85608 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:17.592661 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-2704166f-fff9-48e3-b65e-ef780bb85608 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:17.599031 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2704166f-fff9-48e3-b65e-ef780bb85608 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:17.599478 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2704166f-fff9-48e3-b65e-ef780bb85608 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:17.600250 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2704166f-fff9-48e3-b65e-ef780bb85608 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:17.600684 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2704166f-fff9-48e3-b65e-ef780bb85608 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:17.745107 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-2704166f-fff9-48e3-b65e-ef780bb85608 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:17.754405 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-2704166f-fff9-48e3-b65e-ef780bb85608 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:17.756065 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-2704166f-fff9-48e3-b65e-ef780bb85608 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:17.757299 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-2704166f-fff9-48e3-b65e-ef780bb85608 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.169096 Nov 02 23:13:17.757934 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 512/1036] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:17 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:13:18.043256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-316b518b-9898-4c89-9e87-903d819ec95c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:18.045005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-316b518b-9898-4c89-9e87-903d819ec95c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:18.054433 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-316b518b-9898-4c89-9e87-903d819ec95c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:18.054887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-316b518b-9898-4c89-9e87-903d819ec95c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:18.055736 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-316b518b-9898-4c89-9e87-903d819ec95c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:18.056183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-316b518b-9898-4c89-9e87-903d819ec95c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:18.089875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-316b518b-9898-4c89-9e87-903d819ec95c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050618 Nov 02 23:13:18.090465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 525/1037] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:18 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:18.443690 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-cc697c8a-069f-410c-8953-fdde8f17bf4e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:18.444657 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-cc697c8a-069f-410c-8953-fdde8f17bf4e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:18.451325 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cc697c8a-069f-410c-8953-fdde8f17bf4e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:18.451895 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cc697c8a-069f-410c-8953-fdde8f17bf4e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:18.452772 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cc697c8a-069f-410c-8953-fdde8f17bf4e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:18.453761 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-cc697c8a-069f-410c-8953-fdde8f17bf4e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:18.483487 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-cc697c8a-069f-410c-8953-fdde8f17bf4e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043556 Nov 02 23:13:18.484069 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 513/1038] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:18 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:18.776672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d213a9b3-1653-4a5e-9e97-4395b5b9edc2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:18.777458 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d213a9b3-1653-4a5e-9e97-4395b5b9edc2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:18.785025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d213a9b3-1653-4a5e-9e97-4395b5b9edc2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:18.785520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d213a9b3-1653-4a5e-9e97-4395b5b9edc2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:18.786359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d213a9b3-1653-4a5e-9e97-4395b5b9edc2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:18.786841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d213a9b3-1653-4a5e-9e97-4395b5b9edc2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:18.923433 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d213a9b3-1653-4a5e-9e97-4395b5b9edc2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:18.932861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d213a9b3-1653-4a5e-9e97-4395b5b9edc2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:18.934337 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d213a9b3-1653-4a5e-9e97-4395b5b9edc2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:18.935592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d213a9b3-1653-4a5e-9e97-4395b5b9edc2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.162838 Nov 02 23:13:18.936161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 526/1039] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:18 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:13:19.104037 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-568283ba-5c13-499a-a0b0-4053a0b770e4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:19.105028 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-568283ba-5c13-499a-a0b0-4053a0b770e4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:19.112310 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-568283ba-5c13-499a-a0b0-4053a0b770e4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:19.112769 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-568283ba-5c13-499a-a0b0-4053a0b770e4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:19.113694 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-568283ba-5c13-499a-a0b0-4053a0b770e4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:19.114146 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-568283ba-5c13-499a-a0b0-4053a0b770e4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:19.151276 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-568283ba-5c13-499a-a0b0-4053a0b770e4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051158 Nov 02 23:13:19.151909 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 514/1040] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:19 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:19.495807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1bae7746-3682-4e3e-a57b-51b239803c8b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:19.496750 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1bae7746-3682-4e3e-a57b-51b239803c8b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:19.503249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1bae7746-3682-4e3e-a57b-51b239803c8b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:19.503688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1bae7746-3682-4e3e-a57b-51b239803c8b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:19.504470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1bae7746-3682-4e3e-a57b-51b239803c8b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:19.504910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1bae7746-3682-4e3e-a57b-51b239803c8b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:19.538770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1bae7746-3682-4e3e-a57b-51b239803c8b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046921 Nov 02 23:13:19.539398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 527/1041] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:19 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:19.954407 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-c72e9be0-a106-4435-8cb3-1edfaa07c9e9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:19.955103 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-c72e9be0-a106-4435-8cb3-1edfaa07c9e9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:19.961165 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c72e9be0-a106-4435-8cb3-1edfaa07c9e9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:19.961648 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c72e9be0-a106-4435-8cb3-1edfaa07c9e9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:19.962465 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c72e9be0-a106-4435-8cb3-1edfaa07c9e9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:19.962950 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c72e9be0-a106-4435-8cb3-1edfaa07c9e9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:20.098342 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-c72e9be0-a106-4435-8cb3-1edfaa07c9e9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:20.108239 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-c72e9be0-a106-4435-8cb3-1edfaa07c9e9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:20.109809 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-c72e9be0-a106-4435-8cb3-1edfaa07c9e9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:20.111088 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-c72e9be0-a106-4435-8cb3-1edfaa07c9e9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.161232 Nov 02 23:13:20.112011 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 515/1042] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:19 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:20.163186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-946495dd-3acc-4104-9bea-fc314b5397bc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:20.164096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-946495dd-3acc-4104-9bea-fc314b5397bc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:20.170944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-946495dd-3acc-4104-9bea-fc314b5397bc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:20.171399 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-946495dd-3acc-4104-9bea-fc314b5397bc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:20.172174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-946495dd-3acc-4104-9bea-fc314b5397bc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:20.172608 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-946495dd-3acc-4104-9bea-fc314b5397bc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:20.203517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-946495dd-3acc-4104-9bea-fc314b5397bc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043847 Nov 02 23:13:20.204272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 528/1043] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:20 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:20.552619 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-dbf1a7c6-0f4f-42ba-acf8-d67661974159 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:20.553648 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-dbf1a7c6-0f4f-42ba-acf8-d67661974159 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:20.560481 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dbf1a7c6-0f4f-42ba-acf8-d67661974159 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:20.560915 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dbf1a7c6-0f4f-42ba-acf8-d67661974159 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:20.561690 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dbf1a7c6-0f4f-42ba-acf8-d67661974159 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:20.562116 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-dbf1a7c6-0f4f-42ba-acf8-d67661974159 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:20.596912 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-dbf1a7c6-0f4f-42ba-acf8-d67661974159 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048118 Nov 02 23:13:20.597488 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 516/1044] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:20 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:21.130655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-337d7006-d9de-4dcd-8116-641c94df8c94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:21.131826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-337d7006-d9de-4dcd-8116-641c94df8c94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:21.137875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-337d7006-d9de-4dcd-8116-641c94df8c94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:21.138850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-337d7006-d9de-4dcd-8116-641c94df8c94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:21.139660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-337d7006-d9de-4dcd-8116-641c94df8c94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:21.140096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-337d7006-d9de-4dcd-8116-641c94df8c94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:21.217621 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-69b93f53-3aa9-4308-a085-80554ac87674 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:21.219017 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-69b93f53-3aa9-4308-a085-80554ac87674 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:21.227005 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-69b93f53-3aa9-4308-a085-80554ac87674 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:21.227895 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-69b93f53-3aa9-4308-a085-80554ac87674 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:21.228885 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-69b93f53-3aa9-4308-a085-80554ac87674 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:21.229443 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-69b93f53-3aa9-4308-a085-80554ac87674 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:21.263369 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-69b93f53-3aa9-4308-a085-80554ac87674 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051162 Nov 02 23:13:21.264238 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 517/1045] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:21 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:21.292872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-337d7006-d9de-4dcd-8116-641c94df8c94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:21.302244 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-337d7006-d9de-4dcd-8116-641c94df8c94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:21.303767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-337d7006-d9de-4dcd-8116-641c94df8c94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:21.304947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-337d7006-d9de-4dcd-8116-641c94df8c94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.178322 Nov 02 23:13:21.305702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 529/1046] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:21 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:21.609762 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f118a9bb-6fe0-476a-bfc0-e14d65455dad tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:21.610878 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f118a9bb-6fe0-476a-bfc0-e14d65455dad tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:21.617745 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f118a9bb-6fe0-476a-bfc0-e14d65455dad tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:21.618356 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f118a9bb-6fe0-476a-bfc0-e14d65455dad tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:21.619237 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f118a9bb-6fe0-476a-bfc0-e14d65455dad tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:21.619713 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f118a9bb-6fe0-476a-bfc0-e14d65455dad tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:21.652091 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f118a9bb-6fe0-476a-bfc0-e14d65455dad tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047120 Nov 02 23:13:21.652677 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 518/1047] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:21 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:22.275306 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cc6ed9a5-cd52-493e-9b86-8ab47a0f31d6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:22.276234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cc6ed9a5-cd52-493e-9b86-8ab47a0f31d6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:22.283463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc6ed9a5-cd52-493e-9b86-8ab47a0f31d6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:22.283905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc6ed9a5-cd52-493e-9b86-8ab47a0f31d6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:22.284698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc6ed9a5-cd52-493e-9b86-8ab47a0f31d6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:22.285127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc6ed9a5-cd52-493e-9b86-8ab47a0f31d6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:22.316884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cc6ed9a5-cd52-493e-9b86-8ab47a0f31d6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045326 Nov 02 23:13:22.317804 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 530/1048] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:22 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:22.324307 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-85ce501c-7bf7-4b7f-93e9-a1037d912448 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:22.324931 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-85ce501c-7bf7-4b7f-93e9-a1037d912448 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:22.331262 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-85ce501c-7bf7-4b7f-93e9-a1037d912448 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:22.331705 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-85ce501c-7bf7-4b7f-93e9-a1037d912448 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:22.332479 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-85ce501c-7bf7-4b7f-93e9-a1037d912448 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:22.332905 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-85ce501c-7bf7-4b7f-93e9-a1037d912448 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:22.470094 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-85ce501c-7bf7-4b7f-93e9-a1037d912448 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:22.478610 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-85ce501c-7bf7-4b7f-93e9-a1037d912448 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:22.480125 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-85ce501c-7bf7-4b7f-93e9-a1037d912448 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:22.481289 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-85ce501c-7bf7-4b7f-93e9-a1037d912448 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.160824 Nov 02 23:13:22.481868 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 519/1049] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:22 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:13:22.665586 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d7f19ef3-d01e-4b07-ab7f-094b48477ac5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:22.666483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d7f19ef3-d01e-4b07-ab7f-094b48477ac5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:22.673108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d7f19ef3-d01e-4b07-ab7f-094b48477ac5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:22.673546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d7f19ef3-d01e-4b07-ab7f-094b48477ac5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:22.674309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d7f19ef3-d01e-4b07-ab7f-094b48477ac5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:22.674730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d7f19ef3-d01e-4b07-ab7f-094b48477ac5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:22.715006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d7f19ef3-d01e-4b07-ab7f-094b48477ac5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052685 Nov 02 23:13:22.716795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 531/1050] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:22 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:23.331707 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-fbd8bcf4-5e3a-4aae-8996-4b269c820726 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:23.332631 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-fbd8bcf4-5e3a-4aae-8996-4b269c820726 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:23.342900 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fbd8bcf4-5e3a-4aae-8996-4b269c820726 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:23.343738 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fbd8bcf4-5e3a-4aae-8996-4b269c820726 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:23.345170 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fbd8bcf4-5e3a-4aae-8996-4b269c820726 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:23.345948 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fbd8bcf4-5e3a-4aae-8996-4b269c820726 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:23.405079 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-fbd8bcf4-5e3a-4aae-8996-4b269c820726 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077269 Nov 02 23:13:23.406163 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 520/1051] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:23 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:23.500728 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-88ccb3ab-916b-42e5-b0ed-7793bb758859 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:23.501296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-88ccb3ab-916b-42e5-b0ed-7793bb758859 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:23.507895 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88ccb3ab-916b-42e5-b0ed-7793bb758859 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:23.508341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88ccb3ab-916b-42e5-b0ed-7793bb758859 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:23.509122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88ccb3ab-916b-42e5-b0ed-7793bb758859 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:23.509554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88ccb3ab-916b-42e5-b0ed-7793bb758859 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:23.646286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-88ccb3ab-916b-42e5-b0ed-7793bb758859 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:23.655796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-88ccb3ab-916b-42e5-b0ed-7793bb758859 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:23.657277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-88ccb3ab-916b-42e5-b0ed-7793bb758859 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:23.658443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-88ccb3ab-916b-42e5-b0ed-7793bb758859 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.162073 Nov 02 23:13:23.659220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 532/1052] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:23 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:23.730293 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a6ff0d96-fb03-45ba-8bb7-fc7edd18a57b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:23.731715 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a6ff0d96-fb03-45ba-8bb7-fc7edd18a57b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:23.739239 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a6ff0d96-fb03-45ba-8bb7-fc7edd18a57b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:23.739738 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a6ff0d96-fb03-45ba-8bb7-fc7edd18a57b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:23.741055 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a6ff0d96-fb03-45ba-8bb7-fc7edd18a57b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:23.741553 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a6ff0d96-fb03-45ba-8bb7-fc7edd18a57b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:23.773745 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a6ff0d96-fb03-45ba-8bb7-fc7edd18a57b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048689 Nov 02 23:13:23.774302 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 521/1053] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:23 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:24.420954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c8569e57-dca3-448d-ada7-61621941fc60 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:24.422064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c8569e57-dca3-448d-ada7-61621941fc60 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:24.428462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8569e57-dca3-448d-ada7-61621941fc60 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:24.428912 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8569e57-dca3-448d-ada7-61621941fc60 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:24.429709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8569e57-dca3-448d-ada7-61621941fc60 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:24.430138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8569e57-dca3-448d-ada7-61621941fc60 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:24.464437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c8569e57-dca3-448d-ada7-61621941fc60 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048535 Nov 02 23:13:24.465025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 533/1054] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:24 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:24.687488 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-fca58370-1d72-496c-96dc-175a657ba2c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:24.688456 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-fca58370-1d72-496c-96dc-175a657ba2c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:24.697847 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fca58370-1d72-496c-96dc-175a657ba2c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:24.698607 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fca58370-1d72-496c-96dc-175a657ba2c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:24.699532 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fca58370-1d72-496c-96dc-175a657ba2c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:24.700251 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fca58370-1d72-496c-96dc-175a657ba2c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:24.787112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bc22445e-60d1-4b67-8c94-37fe44313d16 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:24.788437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bc22445e-60d1-4b67-8c94-37fe44313d16 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:24.796062 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc22445e-60d1-4b67-8c94-37fe44313d16 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:24.796768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc22445e-60d1-4b67-8c94-37fe44313d16 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:24.797714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc22445e-60d1-4b67-8c94-37fe44313d16 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:24.798310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc22445e-60d1-4b67-8c94-37fe44313d16 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:24.846614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bc22445e-60d1-4b67-8c94-37fe44313d16 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063289 Nov 02 23:13:24.847907 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 534/1055] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:24 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:24.884877 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-fca58370-1d72-496c-96dc-175a657ba2c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:24.894009 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-fca58370-1d72-496c-96dc-175a657ba2c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:24.895533 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-fca58370-1d72-496c-96dc-175a657ba2c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:24.896695 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-fca58370-1d72-496c-96dc-175a657ba2c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.213868 Nov 02 23:13:24.897257 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 522/1056] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:24 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:13:25.476732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0f84d9b7-1bb1-4f66-90e3-404cdce4b6a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:25.477747 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0f84d9b7-1bb1-4f66-90e3-404cdce4b6a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:25.483901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0f84d9b7-1bb1-4f66-90e3-404cdce4b6a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:25.484344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0f84d9b7-1bb1-4f66-90e3-404cdce4b6a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:25.485106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0f84d9b7-1bb1-4f66-90e3-404cdce4b6a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:25.485533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0f84d9b7-1bb1-4f66-90e3-404cdce4b6a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:25.515170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0f84d9b7-1bb1-4f66-90e3-404cdce4b6a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042091 Nov 02 23:13:25.515743 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 535/1057] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:25 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:25.859352 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e5a8f580-8538-453b-bdd5-1382529a5150 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:25.860384 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e5a8f580-8538-453b-bdd5-1382529a5150 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:25.866902 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e5a8f580-8538-453b-bdd5-1382529a5150 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:25.867448 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e5a8f580-8538-453b-bdd5-1382529a5150 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:25.868259 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e5a8f580-8538-453b-bdd5-1382529a5150 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:25.868778 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e5a8f580-8538-453b-bdd5-1382529a5150 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:25.901102 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e5a8f580-8538-453b-bdd5-1382529a5150 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045755 Nov 02 23:13:25.901697 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 523/1058] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:25 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:25.915479 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c8977a7d-6d9b-44bc-8ac1-b6d929aec587 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:25.916133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c8977a7d-6d9b-44bc-8ac1-b6d929aec587 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:25.922392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8977a7d-6d9b-44bc-8ac1-b6d929aec587 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:25.922831 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8977a7d-6d9b-44bc-8ac1-b6d929aec587 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:25.923635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8977a7d-6d9b-44bc-8ac1-b6d929aec587 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:25.924060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8977a7d-6d9b-44bc-8ac1-b6d929aec587 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:26.062567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c8977a7d-6d9b-44bc-8ac1-b6d929aec587 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:26.071234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c8977a7d-6d9b-44bc-8ac1-b6d929aec587 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:26.072705 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c8977a7d-6d9b-44bc-8ac1-b6d929aec587 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:26.073850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c8977a7d-6d9b-44bc-8ac1-b6d929aec587 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.162082 Nov 02 23:13:26.074415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 536/1059] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:25 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:13:26.528862 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-abce087a-0a7e-47b8-8fd3-0b011d38df08 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:26.529824 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-abce087a-0a7e-47b8-8fd3-0b011d38df08 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:26.535930 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-abce087a-0a7e-47b8-8fd3-0b011d38df08 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:26.536495 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-abce087a-0a7e-47b8-8fd3-0b011d38df08 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:26.537311 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-abce087a-0a7e-47b8-8fd3-0b011d38df08 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:26.538062 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-abce087a-0a7e-47b8-8fd3-0b011d38df08 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:26.568908 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-abce087a-0a7e-47b8-8fd3-0b011d38df08 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043820 Nov 02 23:13:26.569649 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 524/1060] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:26 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:26.913173 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ded5046a-79b8-4873-9b45-753cf3224287 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:26.914151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ded5046a-79b8-4873-9b45-753cf3224287 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:26.921554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ded5046a-79b8-4873-9b45-753cf3224287 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:26.922245 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ded5046a-79b8-4873-9b45-753cf3224287 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:26.922884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ded5046a-79b8-4873-9b45-753cf3224287 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:26.923466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ded5046a-79b8-4873-9b45-753cf3224287 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:26.957864 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ded5046a-79b8-4873-9b45-753cf3224287 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048727 Nov 02 23:13:26.958529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 537/1061] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:26 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:27.093084 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-38c386d3-2374-4ef9-9d96-30949300db24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:27.093660 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-38c386d3-2374-4ef9-9d96-30949300db24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:27.100683 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-38c386d3-2374-4ef9-9d96-30949300db24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:27.101136 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-38c386d3-2374-4ef9-9d96-30949300db24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:27.101930 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-38c386d3-2374-4ef9-9d96-30949300db24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:27.102377 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-38c386d3-2374-4ef9-9d96-30949300db24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:27.271169 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-38c386d3-2374-4ef9-9d96-30949300db24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:27.281903 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-38c386d3-2374-4ef9-9d96-30949300db24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:27.283669 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-38c386d3-2374-4ef9-9d96-30949300db24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:27.284990 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-38c386d3-2374-4ef9-9d96-30949300db24 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.196514 Nov 02 23:13:27.285604 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 525/1062] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:27 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:13:27.581940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-16381408-0393-44d3-89e9-f35df4162a0c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:27.582838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-16381408-0393-44d3-89e9-f35df4162a0c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:27.588850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-16381408-0393-44d3-89e9-f35df4162a0c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:27.589290 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-16381408-0393-44d3-89e9-f35df4162a0c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:27.590052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-16381408-0393-44d3-89e9-f35df4162a0c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:27.590476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-16381408-0393-44d3-89e9-f35df4162a0c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:27.621773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-16381408-0393-44d3-89e9-f35df4162a0c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043787 Nov 02 23:13:27.623131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 538/1063] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:27 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:27.970210 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-fd59400f-8dfd-4461-b406-b8de86be18f6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:27.971230 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-fd59400f-8dfd-4461-b406-b8de86be18f6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:27.978045 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fd59400f-8dfd-4461-b406-b8de86be18f6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:27.978531 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fd59400f-8dfd-4461-b406-b8de86be18f6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:27.979404 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fd59400f-8dfd-4461-b406-b8de86be18f6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:27.979944 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fd59400f-8dfd-4461-b406-b8de86be18f6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:28.010413 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-fd59400f-8dfd-4461-b406-b8de86be18f6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044464 Nov 02 23:13:28.011088 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 526/1064] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:27 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:28.304436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dcdf941e-507d-4585-808e-8da866f582e9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:28.305127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dcdf941e-507d-4585-808e-8da866f582e9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:28.312416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dcdf941e-507d-4585-808e-8da866f582e9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:28.312934 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dcdf941e-507d-4585-808e-8da866f582e9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:28.313763 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dcdf941e-507d-4585-808e-8da866f582e9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:28.314238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dcdf941e-507d-4585-808e-8da866f582e9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:28.461013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dcdf941e-507d-4585-808e-8da866f582e9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:28.469844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dcdf941e-507d-4585-808e-8da866f582e9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:28.471496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dcdf941e-507d-4585-808e-8da866f582e9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:28.472796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dcdf941e-507d-4585-808e-8da866f582e9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.172208 Nov 02 23:13:28.473412 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 539/1065] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:28 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:13:28.633826 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e4bfb729-6262-48cf-bf7f-582d09c36bc6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:28.634842 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e4bfb729-6262-48cf-bf7f-582d09c36bc6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:28.641820 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e4bfb729-6262-48cf-bf7f-582d09c36bc6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:28.642324 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e4bfb729-6262-48cf-bf7f-582d09c36bc6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:28.643255 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e4bfb729-6262-48cf-bf7f-582d09c36bc6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:28.643730 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e4bfb729-6262-48cf-bf7f-582d09c36bc6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:28.674587 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e4bfb729-6262-48cf-bf7f-582d09c36bc6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044474 Nov 02 23:13:28.675221 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 527/1066] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:28 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:29.026665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-49da8da1-1c0f-45da-b582-a85c937d2808 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:29.028818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-49da8da1-1c0f-45da-b582-a85c937d2808 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:29.039030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-49da8da1-1c0f-45da-b582-a85c937d2808 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:29.039824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-49da8da1-1c0f-45da-b582-a85c937d2808 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:29.041226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-49da8da1-1c0f-45da-b582-a85c937d2808 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:29.042017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-49da8da1-1c0f-45da-b582-a85c937d2808 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:29.101144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-49da8da1-1c0f-45da-b582-a85c937d2808 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081105 Nov 02 23:13:29.102196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 540/1067] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:29 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:29.491869 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-84e8f921-871c-4233-9c68-6f23a52ac4df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:29.492478 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-84e8f921-871c-4233-9c68-6f23a52ac4df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:29.499112 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-84e8f921-871c-4233-9c68-6f23a52ac4df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:29.499558 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-84e8f921-871c-4233-9c68-6f23a52ac4df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:29.500341 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-84e8f921-871c-4233-9c68-6f23a52ac4df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:29.500767 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-84e8f921-871c-4233-9c68-6f23a52ac4df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:29.647336 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-84e8f921-871c-4233-9c68-6f23a52ac4df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:29.658067 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-84e8f921-871c-4233-9c68-6f23a52ac4df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:29.659658 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-84e8f921-871c-4233-9c68-6f23a52ac4df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:29.660884 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-84e8f921-871c-4233-9c68-6f23a52ac4df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.172879 Nov 02 23:13:29.661464 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 528/1068] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:29 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:29.686577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1000bc24-4a88-40f1-9975-2425689749c9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:29.687896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1000bc24-4a88-40f1-9975-2425689749c9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:29.694775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1000bc24-4a88-40f1-9975-2425689749c9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:29.695272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1000bc24-4a88-40f1-9975-2425689749c9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:29.696097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1000bc24-4a88-40f1-9975-2425689749c9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:29.696536 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1000bc24-4a88-40f1-9975-2425689749c9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:29.730107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1000bc24-4a88-40f1-9975-2425689749c9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047538 Nov 02 23:13:29.730811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 541/1069] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:29 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:30.116680 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ed8f6543-0382-4128-b643-751c5a40c33c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:30.117633 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ed8f6543-0382-4128-b643-751c5a40c33c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:30.126577 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ed8f6543-0382-4128-b643-751c5a40c33c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:30.127424 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ed8f6543-0382-4128-b643-751c5a40c33c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:30.128721 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ed8f6543-0382-4128-b643-751c5a40c33c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:30.129467 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ed8f6543-0382-4128-b643-751c5a40c33c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:30.164506 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ed8f6543-0382-4128-b643-751c5a40c33c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051558 Nov 02 23:13:30.165110 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 529/1070] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:30 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:30.679905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6cc9b889-c948-4ad3-8966-1a2a4f5f61ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:30.680503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6cc9b889-c948-4ad3-8966-1a2a4f5f61ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:30.686509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6cc9b889-c948-4ad3-8966-1a2a4f5f61ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:30.686992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6cc9b889-c948-4ad3-8966-1a2a4f5f61ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:30.687768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6cc9b889-c948-4ad3-8966-1a2a4f5f61ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:30.688197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6cc9b889-c948-4ad3-8966-1a2a4f5f61ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:30.742719 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-80caa838-f71a-4820-9d66-8598587ee741 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:30.743684 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-80caa838-f71a-4820-9d66-8598587ee741 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:30.750597 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-80caa838-f71a-4820-9d66-8598587ee741 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:30.751077 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-80caa838-f71a-4820-9d66-8598587ee741 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:30.751876 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-80caa838-f71a-4820-9d66-8598587ee741 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:30.752308 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-80caa838-f71a-4820-9d66-8598587ee741 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:30.783425 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-80caa838-f71a-4820-9d66-8598587ee741 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044421 Nov 02 23:13:30.784015 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 530/1071] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:30 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:30.826900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6cc9b889-c948-4ad3-8966-1a2a4f5f61ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:30.835715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6cc9b889-c948-4ad3-8966-1a2a4f5f61ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:30.837256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6cc9b889-c948-4ad3-8966-1a2a4f5f61ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:30.838456 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6cc9b889-c948-4ad3-8966-1a2a4f5f61ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.162385 Nov 02 23:13:30.838972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 542/1072] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:30 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:31.176620 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d99d3556-3dfc-41f2-88b6-290f353dcb4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:31.177491 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d99d3556-3dfc-41f2-88b6-290f353dcb4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:31.183527 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d99d3556-3dfc-41f2-88b6-290f353dcb4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:31.183966 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d99d3556-3dfc-41f2-88b6-290f353dcb4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:31.184728 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d99d3556-3dfc-41f2-88b6-290f353dcb4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:31.185156 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d99d3556-3dfc-41f2-88b6-290f353dcb4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:31.214687 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d99d3556-3dfc-41f2-88b6-290f353dcb4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041925 Nov 02 23:13:31.215292 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 531/1073] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:31 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:31.795056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8c4ea5dc-2254-4395-9e11-a85347aed16c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:31.795990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8c4ea5dc-2254-4395-9e11-a85347aed16c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:31.802655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c4ea5dc-2254-4395-9e11-a85347aed16c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:31.803137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c4ea5dc-2254-4395-9e11-a85347aed16c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:31.803935 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c4ea5dc-2254-4395-9e11-a85347aed16c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:31.804375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c4ea5dc-2254-4395-9e11-a85347aed16c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:31.838109 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8c4ea5dc-2254-4395-9e11-a85347aed16c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046809 Nov 02 23:13:31.838711 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 543/1074] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:31 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:31.857604 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-b33a4b10-44cc-449c-8a39-bc8ae403a924 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:31.858266 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-b33a4b10-44cc-449c-8a39-bc8ae403a924 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:31.865274 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b33a4b10-44cc-449c-8a39-bc8ae403a924 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:31.865863 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b33a4b10-44cc-449c-8a39-bc8ae403a924 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:31.866784 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b33a4b10-44cc-449c-8a39-bc8ae403a924 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:31.867360 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-b33a4b10-44cc-449c-8a39-bc8ae403a924 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:32.008172 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-b33a4b10-44cc-449c-8a39-bc8ae403a924 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:32.024056 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-b33a4b10-44cc-449c-8a39-bc8ae403a924 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:32.027031 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-b33a4b10-44cc-449c-8a39-bc8ae403a924 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:32.029220 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-b33a4b10-44cc-449c-8a39-bc8ae403a924 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.175308 Nov 02 23:13:32.030250 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 532/1075] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:31 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:32.226049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2759ccb6-4ebc-49eb-b842-8daf04110062 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:32.227061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2759ccb6-4ebc-49eb-b842-8daf04110062 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:32.234224 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2759ccb6-4ebc-49eb-b842-8daf04110062 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:32.234674 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2759ccb6-4ebc-49eb-b842-8daf04110062 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:32.235516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2759ccb6-4ebc-49eb-b842-8daf04110062 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:32.235950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2759ccb6-4ebc-49eb-b842-8daf04110062 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:32.270076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2759ccb6-4ebc-49eb-b842-8daf04110062 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047893 Nov 02 23:13:32.270677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 544/1076] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:32 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:32.849705 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ac15ee47-d479-43fb-8cbe-1d2b4d21511b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:32.850620 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ac15ee47-d479-43fb-8cbe-1d2b4d21511b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:32.857107 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ac15ee47-d479-43fb-8cbe-1d2b4d21511b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:32.857558 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ac15ee47-d479-43fb-8cbe-1d2b4d21511b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:32.858337 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ac15ee47-d479-43fb-8cbe-1d2b4d21511b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:32.858870 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ac15ee47-d479-43fb-8cbe-1d2b4d21511b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:32.889220 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ac15ee47-d479-43fb-8cbe-1d2b4d21511b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043202 Nov 02 23:13:32.889792 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 533/1077] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:32 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:33.056836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1ac0ee93-54fc-48a0-b08f-8683458b2f54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:33.057440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1ac0ee93-54fc-48a0-b08f-8683458b2f54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:33.064605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ac0ee93-54fc-48a0-b08f-8683458b2f54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:33.065051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ac0ee93-54fc-48a0-b08f-8683458b2f54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:33.065832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ac0ee93-54fc-48a0-b08f-8683458b2f54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:33.066265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ac0ee93-54fc-48a0-b08f-8683458b2f54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:33.208660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1ac0ee93-54fc-48a0-b08f-8683458b2f54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:33.217835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1ac0ee93-54fc-48a0-b08f-8683458b2f54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:33.219330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1ac0ee93-54fc-48a0-b08f-8683458b2f54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:33.220484 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1ac0ee93-54fc-48a0-b08f-8683458b2f54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.167392 Nov 02 23:13:33.221086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 545/1078] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:33 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:33.282413 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-32305341-6b03-4a5c-8af6-8139604faf59 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:33.283343 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-32305341-6b03-4a5c-8af6-8139604faf59 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:33.289212 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-32305341-6b03-4a5c-8af6-8139604faf59 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:33.289648 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-32305341-6b03-4a5c-8af6-8139604faf59 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:33.290408 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-32305341-6b03-4a5c-8af6-8139604faf59 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:33.290835 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-32305341-6b03-4a5c-8af6-8139604faf59 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:33.320212 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-32305341-6b03-4a5c-8af6-8139604faf59 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042348 Nov 02 23:13:33.320786 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 534/1079] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:33 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:33.901470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-23eb3927-078b-4a2d-acb3-e39e0d5d6eb2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:33.902577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-23eb3927-078b-4a2d-acb3-e39e0d5d6eb2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:33.911826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-23eb3927-078b-4a2d-acb3-e39e0d5d6eb2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:33.912260 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-23eb3927-078b-4a2d-acb3-e39e0d5d6eb2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:33.913046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-23eb3927-078b-4a2d-acb3-e39e0d5d6eb2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:33.913478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-23eb3927-078b-4a2d-acb3-e39e0d5d6eb2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:33.943052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-23eb3927-078b-4a2d-acb3-e39e0d5d6eb2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045936 Nov 02 23:13:33.943620 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 546/1080] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:33 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:34.239877 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a32fd44e-73df-4deb-b864-2bca957d5e11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:34.240494 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a32fd44e-73df-4deb-b864-2bca957d5e11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:34.247755 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a32fd44e-73df-4deb-b864-2bca957d5e11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:34.248427 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a32fd44e-73df-4deb-b864-2bca957d5e11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:34.249322 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a32fd44e-73df-4deb-b864-2bca957d5e11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:34.249845 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a32fd44e-73df-4deb-b864-2bca957d5e11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:34.333016 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3907ed55-3a11-4fe0-bb0d-ced2cd369b4b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:34.333972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3907ed55-3a11-4fe0-bb0d-ced2cd369b4b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:34.340904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3907ed55-3a11-4fe0-bb0d-ced2cd369b4b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:34.341356 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3907ed55-3a11-4fe0-bb0d-ced2cd369b4b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:34.342154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3907ed55-3a11-4fe0-bb0d-ced2cd369b4b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:34.343020 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3907ed55-3a11-4fe0-bb0d-ced2cd369b4b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:34.379325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3907ed55-3a11-4fe0-bb0d-ced2cd369b4b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050469 Nov 02 23:13:34.379934 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 547/1081] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:34 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:34.402473 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-a32fd44e-73df-4deb-b864-2bca957d5e11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:34.411424 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-a32fd44e-73df-4deb-b864-2bca957d5e11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:34.412927 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-a32fd44e-73df-4deb-b864-2bca957d5e11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:34.414135 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a32fd44e-73df-4deb-b864-2bca957d5e11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.177912 Nov 02 23:13:34.414711 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 535/1082] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:34 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:34.955160 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d97345ca-50c6-44ef-8022-af8d8ded0ad6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:34.956022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d97345ca-50c6-44ef-8022-af8d8ded0ad6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:34.962335 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d97345ca-50c6-44ef-8022-af8d8ded0ad6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:34.962776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d97345ca-50c6-44ef-8022-af8d8ded0ad6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:34.963603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d97345ca-50c6-44ef-8022-af8d8ded0ad6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:34.964032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d97345ca-50c6-44ef-8022-af8d8ded0ad6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:34.994079 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d97345ca-50c6-44ef-8022-af8d8ded0ad6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043893 Nov 02 23:13:34.994656 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 548/1083] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:34 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:35.391465 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a96e3695-8ca8-4408-a0f3-334aa9246eda tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:35.392390 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a96e3695-8ca8-4408-a0f3-334aa9246eda tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:35.401122 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a96e3695-8ca8-4408-a0f3-334aa9246eda tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:35.401566 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a96e3695-8ca8-4408-a0f3-334aa9246eda tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:35.402369 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a96e3695-8ca8-4408-a0f3-334aa9246eda tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:35.402808 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a96e3695-8ca8-4408-a0f3-334aa9246eda tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:35.433512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dd3f938e-7a34-46bd-b92e-395838039728 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:35.434341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dd3f938e-7a34-46bd-b92e-395838039728 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:35.435919 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a96e3695-8ca8-4408-a0f3-334aa9246eda tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048331 Nov 02 23:13:35.436696 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 536/1084] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:35 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:35.442299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd3f938e-7a34-46bd-b92e-395838039728 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:35.442749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd3f938e-7a34-46bd-b92e-395838039728 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:35.443579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd3f938e-7a34-46bd-b92e-395838039728 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:35.444020 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd3f938e-7a34-46bd-b92e-395838039728 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:35.584588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dd3f938e-7a34-46bd-b92e-395838039728 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:35.593989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dd3f938e-7a34-46bd-b92e-395838039728 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:35.595544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dd3f938e-7a34-46bd-b92e-395838039728 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:35.596714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dd3f938e-7a34-46bd-b92e-395838039728 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.167434 Nov 02 23:13:35.597275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 549/1085] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:35 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:13:36.005717 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-6888ba21-c949-4124-a530-171e8c12d27d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:36.006632 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-6888ba21-c949-4124-a530-171e8c12d27d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:36.013197 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6888ba21-c949-4124-a530-171e8c12d27d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:36.013648 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6888ba21-c949-4124-a530-171e8c12d27d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:36.014455 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6888ba21-c949-4124-a530-171e8c12d27d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:36.014891 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-6888ba21-c949-4124-a530-171e8c12d27d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:36.052243 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-6888ba21-c949-4124-a530-171e8c12d27d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050272 Nov 02 23:13:36.052839 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 537/1086] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:36 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:36.447997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7dff9432-5776-4de5-b24b-d71b7ff30737 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:36.448963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7dff9432-5776-4de5-b24b-d71b7ff30737 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:36.456104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7dff9432-5776-4de5-b24b-d71b7ff30737 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:36.456557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7dff9432-5776-4de5-b24b-d71b7ff30737 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:36.457357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7dff9432-5776-4de5-b24b-d71b7ff30737 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:36.457816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7dff9432-5776-4de5-b24b-d71b7ff30737 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:36.489521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7dff9432-5776-4de5-b24b-d71b7ff30737 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045449 Nov 02 23:13:36.490097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 550/1087] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:36 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:36.618826 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-09780956-53b1-4af4-b4a4-6687e334f34a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:36.619961 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-09780956-53b1-4af4-b4a4-6687e334f34a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:36.630642 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-09780956-53b1-4af4-b4a4-6687e334f34a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:36.631448 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-09780956-53b1-4af4-b4a4-6687e334f34a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:36.632810 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-09780956-53b1-4af4-b4a4-6687e334f34a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:36.633585 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-09780956-53b1-4af4-b4a4-6687e334f34a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:36.799294 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-09780956-53b1-4af4-b4a4-6687e334f34a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:36.808119 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-09780956-53b1-4af4-b4a4-6687e334f34a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:36.809596 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-09780956-53b1-4af4-b4a4-6687e334f34a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:36.810780 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-09780956-53b1-4af4-b4a4-6687e334f34a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.199253 Nov 02 23:13:36.811379 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 538/1088] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:36 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:37.063397 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f96c9e55-c063-4b59-9c6c-5869355796df tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:37.064311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f96c9e55-c063-4b59-9c6c-5869355796df tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:37.070287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f96c9e55-c063-4b59-9c6c-5869355796df tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:37.070738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f96c9e55-c063-4b59-9c6c-5869355796df tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:37.071551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f96c9e55-c063-4b59-9c6c-5869355796df tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:37.071990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f96c9e55-c063-4b59-9c6c-5869355796df tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:37.101358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f96c9e55-c063-4b59-9c6c-5869355796df tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041783 Nov 02 23:13:37.101938 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 551/1089] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:37 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:37.500642 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-c285dcf9-01eb-4bfc-aacd-6dfe15180f78 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:37.501561 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-c285dcf9-01eb-4bfc-aacd-6dfe15180f78 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:37.507717 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c285dcf9-01eb-4bfc-aacd-6dfe15180f78 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:37.508160 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c285dcf9-01eb-4bfc-aacd-6dfe15180f78 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:37.508939 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c285dcf9-01eb-4bfc-aacd-6dfe15180f78 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:37.509371 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c285dcf9-01eb-4bfc-aacd-6dfe15180f78 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:37.539136 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-c285dcf9-01eb-4bfc-aacd-6dfe15180f78 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042256 Nov 02 23:13:37.539695 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 539/1090] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:37 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:37.831530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b0931e95-c67b-49ec-8e24-f627f5ee3132 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:37.832376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b0931e95-c67b-49ec-8e24-f627f5ee3132 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:37.839226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b0931e95-c67b-49ec-8e24-f627f5ee3132 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:37.839677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b0931e95-c67b-49ec-8e24-f627f5ee3132 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:37.840455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b0931e95-c67b-49ec-8e24-f627f5ee3132 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:37.840883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b0931e95-c67b-49ec-8e24-f627f5ee3132 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:37.972751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b0931e95-c67b-49ec-8e24-f627f5ee3132 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:37.981490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b0931e95-c67b-49ec-8e24-f627f5ee3132 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:37.982994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b0931e95-c67b-49ec-8e24-f627f5ee3132 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:37.984151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b0931e95-c67b-49ec-8e24-f627f5ee3132 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.157710 Nov 02 23:13:37.984713 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 552/1091] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:37 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:38.112857 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f268fb35-880a-47a9-b3e1-655183cfd3f4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:38.113783 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f268fb35-880a-47a9-b3e1-655183cfd3f4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:38.120612 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f268fb35-880a-47a9-b3e1-655183cfd3f4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:38.121055 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f268fb35-880a-47a9-b3e1-655183cfd3f4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:38.121847 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f268fb35-880a-47a9-b3e1-655183cfd3f4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:38.122847 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f268fb35-880a-47a9-b3e1-655183cfd3f4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:38.155547 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f268fb35-880a-47a9-b3e1-655183cfd3f4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046436 Nov 02 23:13:38.156144 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 540/1092] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:38 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:38.550203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8d3c6ad6-70ba-45e9-b9bf-1e01f14ed047 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:38.551121 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8d3c6ad6-70ba-45e9-b9bf-1e01f14ed047 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:38.557010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d3c6ad6-70ba-45e9-b9bf-1e01f14ed047 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:38.557455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d3c6ad6-70ba-45e9-b9bf-1e01f14ed047 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:38.558223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d3c6ad6-70ba-45e9-b9bf-1e01f14ed047 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:38.558661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d3c6ad6-70ba-45e9-b9bf-1e01f14ed047 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:38.589048 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8d3c6ad6-70ba-45e9-b9bf-1e01f14ed047 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042550 Nov 02 23:13:38.589619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 553/1093] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:38 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:39.001447 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e32ae5f1-076e-4cb3-b328-6ce9c4756698 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:39.002070 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e32ae5f1-076e-4cb3-b328-6ce9c4756698 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:39.007913 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e32ae5f1-076e-4cb3-b328-6ce9c4756698 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:39.008354 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e32ae5f1-076e-4cb3-b328-6ce9c4756698 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:39.009113 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e32ae5f1-076e-4cb3-b328-6ce9c4756698 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:39.009535 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e32ae5f1-076e-4cb3-b328-6ce9c4756698 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:39.141730 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e32ae5f1-076e-4cb3-b328-6ce9c4756698 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:39.149985 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e32ae5f1-076e-4cb3-b328-6ce9c4756698 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:39.151476 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e32ae5f1-076e-4cb3-b328-6ce9c4756698 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:39.152607 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e32ae5f1-076e-4cb3-b328-6ce9c4756698 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.154929 Nov 02 23:13:39.153753 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 541/1094] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:38 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:39.166860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-395c3fc5-b8c8-4515-9cb7-a082e4115127 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:39.167787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-395c3fc5-b8c8-4515-9cb7-a082e4115127 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:39.174167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-395c3fc5-b8c8-4515-9cb7-a082e4115127 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:39.174614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-395c3fc5-b8c8-4515-9cb7-a082e4115127 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:39.175429 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-395c3fc5-b8c8-4515-9cb7-a082e4115127 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:39.175865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-395c3fc5-b8c8-4515-9cb7-a082e4115127 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:39.205603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-395c3fc5-b8c8-4515-9cb7-a082e4115127 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042400 Nov 02 23:13:39.206177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 554/1095] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:39 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:39.600635 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a357fa49-ced1-4bfc-b79b-4f6b33a89c01 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:39.601578 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a357fa49-ced1-4bfc-b79b-4f6b33a89c01 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:39.608070 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a357fa49-ced1-4bfc-b79b-4f6b33a89c01 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:39.608511 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a357fa49-ced1-4bfc-b79b-4f6b33a89c01 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:39.609283 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a357fa49-ced1-4bfc-b79b-4f6b33a89c01 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:39.609720 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a357fa49-ced1-4bfc-b79b-4f6b33a89c01 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:39.639375 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a357fa49-ced1-4bfc-b79b-4f6b33a89c01 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042412 Nov 02 23:13:39.639945 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 542/1096] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:39 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:40.171786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-829002c4-1f27-4285-a71f-ba10555349dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:40.172331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-829002c4-1f27-4285-a71f-ba10555349dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:40.178623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-829002c4-1f27-4285-a71f-ba10555349dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:40.179115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-829002c4-1f27-4285-a71f-ba10555349dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:40.179894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-829002c4-1f27-4285-a71f-ba10555349dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:40.180332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-829002c4-1f27-4285-a71f-ba10555349dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:40.217150 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-c0d88b08-cb7f-4cac-9d93-f45cfd179187 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:40.218092 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-c0d88b08-cb7f-4cac-9d93-f45cfd179187 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:40.224748 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c0d88b08-cb7f-4cac-9d93-f45cfd179187 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:40.225173 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c0d88b08-cb7f-4cac-9d93-f45cfd179187 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:40.225964 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c0d88b08-cb7f-4cac-9d93-f45cfd179187 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:40.226395 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c0d88b08-cb7f-4cac-9d93-f45cfd179187 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:40.261573 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-c0d88b08-cb7f-4cac-9d93-f45cfd179187 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048239 Nov 02 23:13:40.262164 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 543/1097] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:40 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:40.317664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-829002c4-1f27-4285-a71f-ba10555349dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:40.326605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-829002c4-1f27-4285-a71f-ba10555349dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:40.328387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-829002c4-1f27-4285-a71f-ba10555349dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:40.329544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-829002c4-1f27-4285-a71f-ba10555349dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.161730 Nov 02 23:13:40.330116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 555/1098] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:40 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:40.651209 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-c42cac43-df22-43bf-a1ef-53c22a3ea0cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:40.652158 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-c42cac43-df22-43bf-a1ef-53c22a3ea0cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:40.658133 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c42cac43-df22-43bf-a1ef-53c22a3ea0cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:40.658607 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c42cac43-df22-43bf-a1ef-53c22a3ea0cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:40.659415 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c42cac43-df22-43bf-a1ef-53c22a3ea0cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:40.659855 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c42cac43-df22-43bf-a1ef-53c22a3ea0cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:40.690197 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-c42cac43-df22-43bf-a1ef-53c22a3ea0cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042806 Nov 02 23:13:40.690775 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 544/1099] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:40 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:41.273602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9378f14f-df76-4426-87cb-87eb7ff1415e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:41.274544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9378f14f-df76-4426-87cb-87eb7ff1415e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:41.282899 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9378f14f-df76-4426-87cb-87eb7ff1415e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:41.282899 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9378f14f-df76-4426-87cb-87eb7ff1415e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:41.283329 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9378f14f-df76-4426-87cb-87eb7ff1415e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:41.283713 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9378f14f-df76-4426-87cb-87eb7ff1415e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:41.319167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9378f14f-df76-4426-87cb-87eb7ff1415e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049273 Nov 02 23:13:41.319739 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 556/1100] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:41 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:41.347697 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-9a77c038-89ac-489e-8460-3951496f24ad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:41.348297 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-9a77c038-89ac-489e-8460-3951496f24ad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:41.354651 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9a77c038-89ac-489e-8460-3951496f24ad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:41.355134 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9a77c038-89ac-489e-8460-3951496f24ad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:41.355907 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9a77c038-89ac-489e-8460-3951496f24ad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:41.356338 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9a77c038-89ac-489e-8460-3951496f24ad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:41.491138 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-9a77c038-89ac-489e-8460-3951496f24ad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:41.500096 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-9a77c038-89ac-489e-8460-3951496f24ad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:41.501580 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-9a77c038-89ac-489e-8460-3951496f24ad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:41.502741 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-9a77c038-89ac-489e-8460-3951496f24ad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.158754 Nov 02 23:13:41.503322 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 545/1101] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:41 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:41.702239 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1cf6cc95-539c-4d64-86c6-cf1d6e609d85 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:41.703470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1cf6cc95-539c-4d64-86c6-cf1d6e609d85 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:41.709482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1cf6cc95-539c-4d64-86c6-cf1d6e609d85 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:41.709927 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1cf6cc95-539c-4d64-86c6-cf1d6e609d85 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:41.710719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1cf6cc95-539c-4d64-86c6-cf1d6e609d85 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:41.711171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1cf6cc95-539c-4d64-86c6-cf1d6e609d85 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:41.741825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1cf6cc95-539c-4d64-86c6-cf1d6e609d85 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043777 Nov 02 23:13:41.742328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 557/1102] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:41 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:42.330461 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-f69fd28f-07f4-4724-998a-c1aafb84fc82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:42.331385 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-f69fd28f-07f4-4724-998a-c1aafb84fc82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:42.337310 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f69fd28f-07f4-4724-998a-c1aafb84fc82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:42.337753 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f69fd28f-07f4-4724-998a-c1aafb84fc82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:42.338515 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f69fd28f-07f4-4724-998a-c1aafb84fc82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:42.338951 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-f69fd28f-07f4-4724-998a-c1aafb84fc82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:42.368274 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-f69fd28f-07f4-4724-998a-c1aafb84fc82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041740 Nov 02 23:13:42.368967 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 546/1103] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:42 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:42.521587 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9105780f-66d5-4303-93b5-3f187846018b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:42.522210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9105780f-66d5-4303-93b5-3f187846018b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:42.529110 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9105780f-66d5-4303-93b5-3f187846018b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:42.529546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9105780f-66d5-4303-93b5-3f187846018b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:42.530317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9105780f-66d5-4303-93b5-3f187846018b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:42.530740 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9105780f-66d5-4303-93b5-3f187846018b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:42.673682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9105780f-66d5-4303-93b5-3f187846018b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:42.681878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9105780f-66d5-4303-93b5-3f187846018b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:42.683363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9105780f-66d5-4303-93b5-3f187846018b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:42.684531 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9105780f-66d5-4303-93b5-3f187846018b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.166706 Nov 02 23:13:42.685085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 558/1104] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:42 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:42.752806 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ae0fc677-046c-40be-89b2-60a3fb67c5ba tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:42.753703 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ae0fc677-046c-40be-89b2-60a3fb67c5ba tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:42.759580 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ae0fc677-046c-40be-89b2-60a3fb67c5ba tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:42.760023 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ae0fc677-046c-40be-89b2-60a3fb67c5ba tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:42.760780 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ae0fc677-046c-40be-89b2-60a3fb67c5ba tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:42.761205 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ae0fc677-046c-40be-89b2-60a3fb67c5ba tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:42.790182 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ae0fc677-046c-40be-89b2-60a3fb67c5ba tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041058 Nov 02 23:13:42.790651 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 547/1105] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:42 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:43.379933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-799792de-6840-4531-b8c9-dc5b54b6d593 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:43.380824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-799792de-6840-4531-b8c9-dc5b54b6d593 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:43.386738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-799792de-6840-4531-b8c9-dc5b54b6d593 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:43.387236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-799792de-6840-4531-b8c9-dc5b54b6d593 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:43.388055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-799792de-6840-4531-b8c9-dc5b54b6d593 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:43.388485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-799792de-6840-4531-b8c9-dc5b54b6d593 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:43.417227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-799792de-6840-4531-b8c9-dc5b54b6d593 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041037 Nov 02 23:13:43.417787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 559/1106] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:43 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:43.701114 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-fb453bc8-1545-43cf-b6e6-092e070362f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:43.701711 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-fb453bc8-1545-43cf-b6e6-092e070362f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:43.708465 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fb453bc8-1545-43cf-b6e6-092e070362f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:43.708904 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fb453bc8-1545-43cf-b6e6-092e070362f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:43.709667 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fb453bc8-1545-43cf-b6e6-092e070362f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:43.710094 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fb453bc8-1545-43cf-b6e6-092e070362f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:43.801280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-55cc62bf-07f6-4508-b5f5-00708ef8351d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:43.802207 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-55cc62bf-07f6-4508-b5f5-00708ef8351d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:43.808332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55cc62bf-07f6-4508-b5f5-00708ef8351d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:43.808774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55cc62bf-07f6-4508-b5f5-00708ef8351d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:43.810051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55cc62bf-07f6-4508-b5f5-00708ef8351d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:43.810477 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55cc62bf-07f6-4508-b5f5-00708ef8351d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:43.839854 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-fb453bc8-1545-43cf-b6e6-092e070362f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:43.840065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-55cc62bf-07f6-4508-b5f5-00708ef8351d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042260 Nov 02 23:13:43.840468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 560/1107] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:43 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:43.848008 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-fb453bc8-1545-43cf-b6e6-092e070362f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:43.849529 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-fb453bc8-1545-43cf-b6e6-092e070362f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:43.850705 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-fb453bc8-1545-43cf-b6e6-092e070362f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.153177 Nov 02 23:13:43.851293 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 548/1108] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:43 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:44.429350 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5efec7eb-af2a-4347-a7f6-724e7078737d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:44.430252 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5efec7eb-af2a-4347-a7f6-724e7078737d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:44.436064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5efec7eb-af2a-4347-a7f6-724e7078737d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:44.436508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5efec7eb-af2a-4347-a7f6-724e7078737d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:44.437265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5efec7eb-af2a-4347-a7f6-724e7078737d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:44.437694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5efec7eb-af2a-4347-a7f6-724e7078737d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:44.466640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5efec7eb-af2a-4347-a7f6-724e7078737d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041075 Nov 02 23:13:44.467228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 561/1109] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:44 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:44.850644 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-ae51a497-6673-44da-bd16-3cf4c082f97e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:44.851583 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-ae51a497-6673-44da-bd16-3cf4c082f97e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:44.858519 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ae51a497-6673-44da-bd16-3cf4c082f97e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:44.858980 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ae51a497-6673-44da-bd16-3cf4c082f97e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:44.859748 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ae51a497-6673-44da-bd16-3cf4c082f97e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:44.860173 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-ae51a497-6673-44da-bd16-3cf4c082f97e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:44.868389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-07db11a5-6d64-4a08-a6e5-8fc2ac70f4c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:44.868980 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-07db11a5-6d64-4a08-a6e5-8fc2ac70f4c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:44.875256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-07db11a5-6d64-4a08-a6e5-8fc2ac70f4c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:44.875695 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-07db11a5-6d64-4a08-a6e5-8fc2ac70f4c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:44.876468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-07db11a5-6d64-4a08-a6e5-8fc2ac70f4c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:44.876892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-07db11a5-6d64-4a08-a6e5-8fc2ac70f4c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:44.890554 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-ae51a497-6673-44da-bd16-3cf4c082f97e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043592 Nov 02 23:13:44.891177 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 549/1110] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:44 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:45.016529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-07db11a5-6d64-4a08-a6e5-8fc2ac70f4c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:45.025192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-07db11a5-6d64-4a08-a6e5-8fc2ac70f4c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:45.026677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-07db11a5-6d64-4a08-a6e5-8fc2ac70f4c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:45.027998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-07db11a5-6d64-4a08-a6e5-8fc2ac70f4c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.163217 Nov 02 23:13:45.029194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 562/1111] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:44 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:13:45.477975 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-55eec4c7-72c2-4db0-b2b1-1d6aa5c5ee33 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:45.478892 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-55eec4c7-72c2-4db0-b2b1-1d6aa5c5ee33 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:45.484735 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-55eec4c7-72c2-4db0-b2b1-1d6aa5c5ee33 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:45.485171 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-55eec4c7-72c2-4db0-b2b1-1d6aa5c5ee33 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:45.485921 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-55eec4c7-72c2-4db0-b2b1-1d6aa5c5ee33 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:45.486342 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-55eec4c7-72c2-4db0-b2b1-1d6aa5c5ee33 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:45.514941 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-55eec4c7-72c2-4db0-b2b1-1d6aa5c5ee33 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040690 Nov 02 23:13:45.515501 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 550/1112] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:45 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:45.901618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c974bf26-2685-4045-9a46-50819adb9352 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:45.902515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c974bf26-2685-4045-9a46-50819adb9352 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:45.908976 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c974bf26-2685-4045-9a46-50819adb9352 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:45.909424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c974bf26-2685-4045-9a46-50819adb9352 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:45.910199 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c974bf26-2685-4045-9a46-50819adb9352 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:45.910626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c974bf26-2685-4045-9a46-50819adb9352 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:45.939993 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c974bf26-2685-4045-9a46-50819adb9352 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042097 Nov 02 23:13:45.940555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 563/1113] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:45 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:46.047501 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-82eda814-873e-4bdb-9d53-806afe094d66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:46.048151 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-82eda814-873e-4bdb-9d53-806afe094d66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:46.054377 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-82eda814-873e-4bdb-9d53-806afe094d66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:46.054820 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-82eda814-873e-4bdb-9d53-806afe094d66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:46.055623 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-82eda814-873e-4bdb-9d53-806afe094d66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:46.056054 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-82eda814-873e-4bdb-9d53-806afe094d66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:46.190287 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-82eda814-873e-4bdb-9d53-806afe094d66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:46.198348 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-82eda814-873e-4bdb-9d53-806afe094d66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:46.199895 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-82eda814-873e-4bdb-9d53-806afe094d66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:46.201041 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-82eda814-873e-4bdb-9d53-806afe094d66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.157895 Nov 02 23:13:46.201596 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 551/1114] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:46 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:46.525554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9b04f6b7-7928-44f5-b41b-4aa0f589e68a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:46.526453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9b04f6b7-7928-44f5-b41b-4aa0f589e68a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:46.532908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9b04f6b7-7928-44f5-b41b-4aa0f589e68a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:46.533348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9b04f6b7-7928-44f5-b41b-4aa0f589e68a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:46.534099 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9b04f6b7-7928-44f5-b41b-4aa0f589e68a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:46.534524 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9b04f6b7-7928-44f5-b41b-4aa0f589e68a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:46.562267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9b04f6b7-7928-44f5-b41b-4aa0f589e68a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040385 Nov 02 23:13:46.562856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 564/1115] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:46 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:46.951506 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-2f1141f0-3fff-4ab7-b9e6-e6d0ff6faf2b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:46.952416 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-2f1141f0-3fff-4ab7-b9e6-e6d0ff6faf2b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:46.958574 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2f1141f0-3fff-4ab7-b9e6-e6d0ff6faf2b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:46.959045 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2f1141f0-3fff-4ab7-b9e6-e6d0ff6faf2b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:46.959815 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2f1141f0-3fff-4ab7-b9e6-e6d0ff6faf2b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:46.960242 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2f1141f0-3fff-4ab7-b9e6-e6d0ff6faf2b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:46.990567 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-2f1141f0-3fff-4ab7-b9e6-e6d0ff6faf2b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042839 Nov 02 23:13:46.991158 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 552/1116] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:46 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:47.219887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-208f8f17-5c0e-4c15-91e9-2f9cc5d6b0fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:47.220486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-208f8f17-5c0e-4c15-91e9-2f9cc5d6b0fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:47.226702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-208f8f17-5c0e-4c15-91e9-2f9cc5d6b0fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:47.227184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-208f8f17-5c0e-4c15-91e9-2f9cc5d6b0fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:47.227966 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-208f8f17-5c0e-4c15-91e9-2f9cc5d6b0fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:47.228396 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-208f8f17-5c0e-4c15-91e9-2f9cc5d6b0fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:47.357186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-208f8f17-5c0e-4c15-91e9-2f9cc5d6b0fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:47.365566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-208f8f17-5c0e-4c15-91e9-2f9cc5d6b0fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:47.367380 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-208f8f17-5c0e-4c15-91e9-2f9cc5d6b0fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:47.368701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-208f8f17-5c0e-4c15-91e9-2f9cc5d6b0fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.153136 Nov 02 23:13:47.369320 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 565/1117] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:47 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:47.573655 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-84d1c78b-1f36-40e8-8b1b-13021ee47b37 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:47.574579 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-84d1c78b-1f36-40e8-8b1b-13021ee47b37 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:47.581515 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-84d1c78b-1f36-40e8-8b1b-13021ee47b37 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:47.581955 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-84d1c78b-1f36-40e8-8b1b-13021ee47b37 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:47.582728 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-84d1c78b-1f36-40e8-8b1b-13021ee47b37 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:47.583192 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-84d1c78b-1f36-40e8-8b1b-13021ee47b37 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:47.613187 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-84d1c78b-1f36-40e8-8b1b-13021ee47b37 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043154 Nov 02 23:13:47.613669 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 553/1118] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:47 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:48.002026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-80ef0fe6-1ec9-4a5d-af43-4a5f83364110 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:48.002951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-80ef0fe6-1ec9-4a5d-af43-4a5f83364110 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:48.008760 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-80ef0fe6-1ec9-4a5d-af43-4a5f83364110 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:48.009207 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-80ef0fe6-1ec9-4a5d-af43-4a5f83364110 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:48.009967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-80ef0fe6-1ec9-4a5d-af43-4a5f83364110 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:48.010396 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-80ef0fe6-1ec9-4a5d-af43-4a5f83364110 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:48.039186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-80ef0fe6-1ec9-4a5d-af43-4a5f83364110 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040957 Nov 02 23:13:48.039735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 566/1119] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:47 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:48.386797 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-e291ae34-b2f9-4a95-a220-42c5f63c10f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:48.387420 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-e291ae34-b2f9-4a95-a220-42c5f63c10f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:48.393241 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e291ae34-b2f9-4a95-a220-42c5f63c10f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:48.393682 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e291ae34-b2f9-4a95-a220-42c5f63c10f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:48.394439 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e291ae34-b2f9-4a95-a220-42c5f63c10f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:48.394857 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-e291ae34-b2f9-4a95-a220-42c5f63c10f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:48.521867 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e291ae34-b2f9-4a95-a220-42c5f63c10f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:48.530478 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e291ae34-b2f9-4a95-a220-42c5f63c10f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:48.532009 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-e291ae34-b2f9-4a95-a220-42c5f63c10f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:48.533155 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-e291ae34-b2f9-4a95-a220-42c5f63c10f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.150122 Nov 02 23:13:48.533706 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 554/1120] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:48 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:48.624418 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c2504744-477d-470e-8b36-4cb691bfbc03 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:48.625316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c2504744-477d-470e-8b36-4cb691bfbc03 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:48.631518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2504744-477d-470e-8b36-4cb691bfbc03 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:48.631994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2504744-477d-470e-8b36-4cb691bfbc03 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:48.632742 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2504744-477d-470e-8b36-4cb691bfbc03 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:48.633165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2504744-477d-470e-8b36-4cb691bfbc03 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:48.662615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c2504744-477d-470e-8b36-4cb691bfbc03 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041863 Nov 02 23:13:48.663120 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 567/1121] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:48 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:49.050223 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d93d05d0-1500-4f2e-85ce-8aae2bae26c0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:49.051149 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d93d05d0-1500-4f2e-85ce-8aae2bae26c0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:49.057329 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d93d05d0-1500-4f2e-85ce-8aae2bae26c0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:49.057772 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d93d05d0-1500-4f2e-85ce-8aae2bae26c0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:49.058529 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d93d05d0-1500-4f2e-85ce-8aae2bae26c0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:49.059550 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d93d05d0-1500-4f2e-85ce-8aae2bae26c0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:49.088530 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d93d05d0-1500-4f2e-85ce-8aae2bae26c0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041939 Nov 02 23:13:49.089085 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 555/1122] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:49 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:49.551084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d91fae71-0643-471d-9eb2-c5b1a181a698 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:49.551687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d91fae71-0643-471d-9eb2-c5b1a181a698 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:49.557726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d91fae71-0643-471d-9eb2-c5b1a181a698 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:49.558167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d91fae71-0643-471d-9eb2-c5b1a181a698 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:49.558989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d91fae71-0643-471d-9eb2-c5b1a181a698 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:49.560057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d91fae71-0643-471d-9eb2-c5b1a181a698 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:49.675061 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-25e71169-b21e-4e73-871d-ce1a8c1ecffa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:49.676075 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-25e71169-b21e-4e73-871d-ce1a8c1ecffa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:49.681998 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-25e71169-b21e-4e73-871d-ce1a8c1ecffa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:49.682445 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-25e71169-b21e-4e73-871d-ce1a8c1ecffa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:49.683246 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-25e71169-b21e-4e73-871d-ce1a8c1ecffa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:49.683680 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-25e71169-b21e-4e73-871d-ce1a8c1ecffa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:49.691961 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d91fae71-0643-471d-9eb2-c5b1a181a698 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:49.700634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d91fae71-0643-471d-9eb2-c5b1a181a698 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:49.702156 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d91fae71-0643-471d-9eb2-c5b1a181a698 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:49.703586 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d91fae71-0643-471d-9eb2-c5b1a181a698 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.156283 Nov 02 23:13:49.704150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 568/1123] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:49 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:13:49.713920 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-25e71169-b21e-4e73-871d-ce1a8c1ecffa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042658 Nov 02 23:13:49.714475 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 556/1124] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:49 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:50.100083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-96907f07-aa19-4a91-a4e6-1aeceb1c65f7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:50.100992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-96907f07-aa19-4a91-a4e6-1aeceb1c65f7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:50.107841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-96907f07-aa19-4a91-a4e6-1aeceb1c65f7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:50.108227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-96907f07-aa19-4a91-a4e6-1aeceb1c65f7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:50.109007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-96907f07-aa19-4a91-a4e6-1aeceb1c65f7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:50.109724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-96907f07-aa19-4a91-a4e6-1aeceb1c65f7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:50.139593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-96907f07-aa19-4a91-a4e6-1aeceb1c65f7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043229 Nov 02 23:13:50.140137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 569/1125] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:50 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:50.721622 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-44ad4049-b19d-449a-a7b3-fb884e1b5315 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:50.722222 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-44ad4049-b19d-449a-a7b3-fb884e1b5315 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:50.725232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5d160187-c956-4860-8c0b-dbd96800e48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:50.726184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5d160187-c956-4860-8c0b-dbd96800e48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:50.728744 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-44ad4049-b19d-449a-a7b3-fb884e1b5315 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:50.729193 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-44ad4049-b19d-449a-a7b3-fb884e1b5315 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:50.729967 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-44ad4049-b19d-449a-a7b3-fb884e1b5315 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:50.730422 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-44ad4049-b19d-449a-a7b3-fb884e1b5315 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:50.732724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d160187-c956-4860-8c0b-dbd96800e48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:50.733164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d160187-c956-4860-8c0b-dbd96800e48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:50.734094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d160187-c956-4860-8c0b-dbd96800e48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:50.734527 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d160187-c956-4860-8c0b-dbd96800e48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:50.764840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5d160187-c956-4860-8c0b-dbd96800e48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043231 Nov 02 23:13:50.765603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 570/1126] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:50 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:50.864877 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-44ad4049-b19d-449a-a7b3-fb884e1b5315 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:50.873531 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-44ad4049-b19d-449a-a7b3-fb884e1b5315 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:50.875037 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-44ad4049-b19d-449a-a7b3-fb884e1b5315 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:50.876173 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-44ad4049-b19d-449a-a7b3-fb884e1b5315 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.158399 Nov 02 23:13:50.876765 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 557/1127] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:50 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:51.151287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fc5a71cb-f293-4744-9918-1465c6257ab4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:51.152098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fc5a71cb-f293-4744-9918-1465c6257ab4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:51.158203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc5a71cb-f293-4744-9918-1465c6257ab4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:51.158687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc5a71cb-f293-4744-9918-1465c6257ab4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:51.159722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc5a71cb-f293-4744-9918-1465c6257ab4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:51.160151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc5a71cb-f293-4744-9918-1465c6257ab4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:51.189163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fc5a71cb-f293-4744-9918-1465c6257ab4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041766 Nov 02 23:13:51.189707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 571/1128] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:51 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:51.776407 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a007ab01-7bae-4d1e-8c37-0f3cd1375999 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:51.777336 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a007ab01-7bae-4d1e-8c37-0f3cd1375999 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:51.786679 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a007ab01-7bae-4d1e-8c37-0f3cd1375999 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:51.787149 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a007ab01-7bae-4d1e-8c37-0f3cd1375999 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:51.787909 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a007ab01-7bae-4d1e-8c37-0f3cd1375999 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:51.788333 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a007ab01-7bae-4d1e-8c37-0f3cd1375999 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:51.816982 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a007ab01-7bae-4d1e-8c37-0f3cd1375999 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044314 Nov 02 23:13:51.817527 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 558/1129] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:51 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:51.894018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-db57c585-45dc-4a9b-aff5-87fd1ccd3997 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:51.894643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-db57c585-45dc-4a9b-aff5-87fd1ccd3997 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:51.900828 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db57c585-45dc-4a9b-aff5-87fd1ccd3997 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:51.901267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db57c585-45dc-4a9b-aff5-87fd1ccd3997 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:51.902020 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db57c585-45dc-4a9b-aff5-87fd1ccd3997 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:51.902442 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db57c585-45dc-4a9b-aff5-87fd1ccd3997 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:52.035335 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-db57c585-45dc-4a9b-aff5-87fd1ccd3997 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:52.044138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-db57c585-45dc-4a9b-aff5-87fd1ccd3997 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:52.045634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-db57c585-45dc-4a9b-aff5-87fd1ccd3997 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:52.046800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-db57c585-45dc-4a9b-aff5-87fd1ccd3997 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.156442 Nov 02 23:13:52.047549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 572/1130] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:51 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:52.200549 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-bfef97fe-2cea-4584-9e1c-f910207cfdeb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:52.201476 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-bfef97fe-2cea-4584-9e1c-f910207cfdeb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:52.207797 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bfef97fe-2cea-4584-9e1c-f910207cfdeb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:52.208179 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bfef97fe-2cea-4584-9e1c-f910207cfdeb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:52.208953 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bfef97fe-2cea-4584-9e1c-f910207cfdeb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:52.209619 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-bfef97fe-2cea-4584-9e1c-f910207cfdeb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:52.239381 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-bfef97fe-2cea-4584-9e1c-f910207cfdeb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042592 Nov 02 23:13:52.239945 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 559/1131] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:52 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:52.829135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1bac71fe-1d51-449b-bbad-d503b6b94f6c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:52.830091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1bac71fe-1d51-449b-bbad-d503b6b94f6c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:52.836786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1bac71fe-1d51-449b-bbad-d503b6b94f6c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:52.837236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1bac71fe-1d51-449b-bbad-d503b6b94f6c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:52.838004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1bac71fe-1d51-449b-bbad-d503b6b94f6c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:52.838440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1bac71fe-1d51-449b-bbad-d503b6b94f6c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:52.866200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1bac71fe-1d51-449b-bbad-d503b6b94f6c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041584 Nov 02 23:13:52.866688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 573/1132] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:52 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:53.064594 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-067e6a7d-01ae-4424-b757-b369756a91d0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:53.065194 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-067e6a7d-01ae-4424-b757-b369756a91d0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:53.070978 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-067e6a7d-01ae-4424-b757-b369756a91d0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:53.071424 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-067e6a7d-01ae-4424-b757-b369756a91d0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:53.072195 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-067e6a7d-01ae-4424-b757-b369756a91d0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:53.072626 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-067e6a7d-01ae-4424-b757-b369756a91d0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:53.209565 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-067e6a7d-01ae-4424-b757-b369756a91d0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:53.218839 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-067e6a7d-01ae-4424-b757-b369756a91d0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:53.220428 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-067e6a7d-01ae-4424-b757-b369756a91d0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:53.221574 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-067e6a7d-01ae-4424-b757-b369756a91d0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.160785 Nov 02 23:13:53.222138 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 560/1133] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:53 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:53.251111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-060bf5bb-de68-43d0-a52e-f9ae7da0562c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:53.252023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-060bf5bb-de68-43d0-a52e-f9ae7da0562c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:53.258185 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-060bf5bb-de68-43d0-a52e-f9ae7da0562c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:53.258629 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-060bf5bb-de68-43d0-a52e-f9ae7da0562c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:53.259436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-060bf5bb-de68-43d0-a52e-f9ae7da0562c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:53.259875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-060bf5bb-de68-43d0-a52e-f9ae7da0562c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:53.288883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-060bf5bb-de68-43d0-a52e-f9ae7da0562c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041643 Nov 02 23:13:53.289439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 574/1134] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:53 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:53.877656 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-4dafd9ff-83e8-4dc0-b668-b2963c110855 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:53.878600 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-4dafd9ff-83e8-4dc0-b668-b2963c110855 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:53.884554 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4dafd9ff-83e8-4dc0-b668-b2963c110855 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:53.884999 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4dafd9ff-83e8-4dc0-b668-b2963c110855 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:53.885762 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4dafd9ff-83e8-4dc0-b668-b2963c110855 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:53.886250 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-4dafd9ff-83e8-4dc0-b668-b2963c110855 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:53.916660 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-4dafd9ff-83e8-4dc0-b668-b2963c110855 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042715 Nov 02 23:13:53.917231 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 561/1135] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:53 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:54.239407 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-52115d95-00f8-465c-b190-71b78243f0b4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:54.240003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-52115d95-00f8-465c-b190-71b78243f0b4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:54.245847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52115d95-00f8-465c-b190-71b78243f0b4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:54.246289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52115d95-00f8-465c-b190-71b78243f0b4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:54.247184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52115d95-00f8-465c-b190-71b78243f0b4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:54.247616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52115d95-00f8-465c-b190-71b78243f0b4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:54.300546 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-23160d78-5046-4a67-b9a9-851a0302857d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:54.301447 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-23160d78-5046-4a67-b9a9-851a0302857d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:54.307936 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-23160d78-5046-4a67-b9a9-851a0302857d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:54.308383 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-23160d78-5046-4a67-b9a9-851a0302857d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:54.309201 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-23160d78-5046-4a67-b9a9-851a0302857d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:54.309630 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-23160d78-5046-4a67-b9a9-851a0302857d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:54.338838 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-23160d78-5046-4a67-b9a9-851a0302857d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041971 Nov 02 23:13:54.339446 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 562/1136] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:54 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:13:54.376531 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-52115d95-00f8-465c-b190-71b78243f0b4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:54.384744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-52115d95-00f8-465c-b190-71b78243f0b4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:54.386211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-52115d95-00f8-465c-b190-71b78243f0b4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:54.387433 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-52115d95-00f8-465c-b190-71b78243f0b4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.151662 Nov 02 23:13:54.388012 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 575/1137] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:54 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:54.928222 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-2580cab3-1406-4805-833e-03b464749c86 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:54.929157 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-2580cab3-1406-4805-833e-03b464749c86 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:54.936117 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2580cab3-1406-4805-833e-03b464749c86 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:54.936568 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2580cab3-1406-4805-833e-03b464749c86 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:54.937358 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2580cab3-1406-4805-833e-03b464749c86 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:54.937790 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2580cab3-1406-4805-833e-03b464749c86 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:54.969593 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-2580cab3-1406-4805-833e-03b464749c86 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045177 Nov 02 23:13:54.970170 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 563/1138] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:54 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:55.350820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0d122f17-e33c-42b3-96bd-14de483c285c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:55.351750 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0d122f17-e33c-42b3-96bd-14de483c285c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:55.358514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d122f17-e33c-42b3-96bd-14de483c285c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:55.358932 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d122f17-e33c-42b3-96bd-14de483c285c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:55.359702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d122f17-e33c-42b3-96bd-14de483c285c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:55.360132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d122f17-e33c-42b3-96bd-14de483c285c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:55.388095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0d122f17-e33c-42b3-96bd-14de483c285c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041026 Nov 02 23:13:55.388674 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 576/1139] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:55 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:55.405806 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-9ec3281c-5eda-47e0-a274-9063bf895e8a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:55.406409 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-9ec3281c-5eda-47e0-a274-9063bf895e8a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:55.412614 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9ec3281c-5eda-47e0-a274-9063bf895e8a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:55.413057 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9ec3281c-5eda-47e0-a274-9063bf895e8a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:55.413825 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9ec3281c-5eda-47e0-a274-9063bf895e8a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:55.414250 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-9ec3281c-5eda-47e0-a274-9063bf895e8a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:55.552936 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-9ec3281c-5eda-47e0-a274-9063bf895e8a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:55.562123 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-9ec3281c-5eda-47e0-a274-9063bf895e8a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:55.563681 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-9ec3281c-5eda-47e0-a274-9063bf895e8a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:55.564859 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-9ec3281c-5eda-47e0-a274-9063bf895e8a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.163353 Nov 02 23:13:55.565415 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 564/1140] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:55 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:55.981118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5b4fea6e-65f0-4a8d-b288-5b034b64f11f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:55.982039 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5b4fea6e-65f0-4a8d-b288-5b034b64f11f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:55.988262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b4fea6e-65f0-4a8d-b288-5b034b64f11f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:55.988704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b4fea6e-65f0-4a8d-b288-5b034b64f11f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:55.989481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b4fea6e-65f0-4a8d-b288-5b034b64f11f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:55.989906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b4fea6e-65f0-4a8d-b288-5b034b64f11f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:56.019368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5b4fea6e-65f0-4a8d-b288-5b034b64f11f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042027 Nov 02 23:13:56.019916 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 577/1141] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:55 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:56.399522 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-86779049-a551-47dd-b9ba-c0c8487dd470 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:56.400441 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-86779049-a551-47dd-b9ba-c0c8487dd470 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:56.406859 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-86779049-a551-47dd-b9ba-c0c8487dd470 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:56.407485 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-86779049-a551-47dd-b9ba-c0c8487dd470 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:56.408059 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-86779049-a551-47dd-b9ba-c0c8487dd470 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:56.408484 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-86779049-a551-47dd-b9ba-c0c8487dd470 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:56.437320 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-86779049-a551-47dd-b9ba-c0c8487dd470 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041471 Nov 02 23:13:56.437883 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 565/1142] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:56 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:56.583469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0aea8e3d-68b8-425b-bd57-f777eca6f0ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:56.584122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0aea8e3d-68b8-425b-bd57-f777eca6f0ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:56.590376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0aea8e3d-68b8-425b-bd57-f777eca6f0ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:56.590820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0aea8e3d-68b8-425b-bd57-f777eca6f0ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:56.591612 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0aea8e3d-68b8-425b-bd57-f777eca6f0ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:56.592040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0aea8e3d-68b8-425b-bd57-f777eca6f0ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:56.698955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:13:56.699400 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:13:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e (ip 10.222.0.41) !!! Nov 02 23:13:56.723176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0aea8e3d-68b8-425b-bd57-f777eca6f0ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:56.731668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0aea8e3d-68b8-425b-bd57-f777eca6f0ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:56.733159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0aea8e3d-68b8-425b-bd57-f777eca6f0ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:56.734310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0aea8e3d-68b8-425b-bd57-f777eca6f0ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.154583 Nov 02 23:13:56.734869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 578/1143] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:56 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:57.030937 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-75c638e7-6367-42d5-b4ec-a66ffaf94508 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:57.031862 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-75c638e7-6367-42d5-b4ec-a66ffaf94508 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:57.037683 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-75c638e7-6367-42d5-b4ec-a66ffaf94508 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:57.038125 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-75c638e7-6367-42d5-b4ec-a66ffaf94508 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:57.038891 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-75c638e7-6367-42d5-b4ec-a66ffaf94508 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:57.039353 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-75c638e7-6367-42d5-b4ec-a66ffaf94508 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:57.069065 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-75c638e7-6367-42d5-b4ec-a66ffaf94508 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042066 Nov 02 23:13:57.069646 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 566/1144] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:57 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:57.448708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3bca7ee8-dcb9-4442-82b4-f486c4b7d3e3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:57.449648 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3bca7ee8-dcb9-4442-82b4-f486c4b7d3e3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:57.457345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3bca7ee8-dcb9-4442-82b4-f486c4b7d3e3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:57.458311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3bca7ee8-dcb9-4442-82b4-f486c4b7d3e3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:57.459127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3bca7ee8-dcb9-4442-82b4-f486c4b7d3e3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:57.459562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3bca7ee8-dcb9-4442-82b4-f486c4b7d3e3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:57.496851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3bca7ee8-dcb9-4442-82b4-f486c4b7d3e3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051803 Nov 02 23:13:57.497408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 579/1145] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:57 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:57.579970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:13:57.580137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:13:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 23:13:57.752758 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-5e550ed4-bd50-4ff8-88b4-634e99ee9fd9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:57.753361 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-5e550ed4-bd50-4ff8-88b4-634e99ee9fd9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:57.760105 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5e550ed4-bd50-4ff8-88b4-634e99ee9fd9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:57.760555 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5e550ed4-bd50-4ff8-88b4-634e99ee9fd9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:57.761327 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5e550ed4-bd50-4ff8-88b4-634e99ee9fd9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:57.761760 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-5e550ed4-bd50-4ff8-88b4-634e99ee9fd9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:57.889388 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-5e550ed4-bd50-4ff8-88b4-634e99ee9fd9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:57.897604 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-5e550ed4-bd50-4ff8-88b4-634e99ee9fd9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:57.899105 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-5e550ed4-bd50-4ff8-88b4-634e99ee9fd9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:57.900244 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-5e550ed4-bd50-4ff8-88b4-634e99ee9fd9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.151333 Nov 02 23:13:57.900799 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 567/1146] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:57 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:58.081406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2332e986-8ab9-48a0-bfbc-3fd04cff7893 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:58.082231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2332e986-8ab9-48a0-bfbc-3fd04cff7893 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:58.088470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2332e986-8ab9-48a0-bfbc-3fd04cff7893 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:58.088917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2332e986-8ab9-48a0-bfbc-3fd04cff7893 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:58.089680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2332e986-8ab9-48a0-bfbc-3fd04cff7893 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:58.090111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2332e986-8ab9-48a0-bfbc-3fd04cff7893 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:58.126013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2332e986-8ab9-48a0-bfbc-3fd04cff7893 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048676 Nov 02 23:13:58.126585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 580/1147] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:58 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:58.508383 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-858194b5-db1b-447e-83dd-88d671ce4d93 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:58.509329 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-858194b5-db1b-447e-83dd-88d671ce4d93 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:58.515279 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-858194b5-db1b-447e-83dd-88d671ce4d93 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:58.515728 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-858194b5-db1b-447e-83dd-88d671ce4d93 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:58.516502 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-858194b5-db1b-447e-83dd-88d671ce4d93 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:58.516924 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-858194b5-db1b-447e-83dd-88d671ce4d93 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:58.545404 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-858194b5-db1b-447e-83dd-88d671ce4d93 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040733 Nov 02 23:13:58.545964 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 568/1148] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:58 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:58.919659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d21c2946-4a95-4192-9828-97f5a283de26 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:58.920164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d21c2946-4a95-4192-9828-97f5a283de26 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:58.925880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d21c2946-4a95-4192-9828-97f5a283de26 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:58.926319 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d21c2946-4a95-4192-9828-97f5a283de26 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:58.927108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d21c2946-4a95-4192-9828-97f5a283de26 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:58.927537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d21c2946-4a95-4192-9828-97f5a283de26 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:59.054185 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d21c2946-4a95-4192-9828-97f5a283de26 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:59.062512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d21c2946-4a95-4192-9828-97f5a283de26 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:59.064032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d21c2946-4a95-4192-9828-97f5a283de26 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:13:59.065213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d21c2946-4a95-4192-9828-97f5a283de26 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.150126 Nov 02 23:13:59.065768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 581/1149] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:13:58 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:13:59.137964 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-2cc40783-bc34-4a2e-a88c-dd7f37cc7369 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:59.138862 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-2cc40783-bc34-4a2e-a88c-dd7f37cc7369 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:59.145156 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2cc40783-bc34-4a2e-a88c-dd7f37cc7369 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:59.145599 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2cc40783-bc34-4a2e-a88c-dd7f37cc7369 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:59.146366 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2cc40783-bc34-4a2e-a88c-dd7f37cc7369 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:59.146794 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-2cc40783-bc34-4a2e-a88c-dd7f37cc7369 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:59.176163 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-2cc40783-bc34-4a2e-a88c-dd7f37cc7369 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042419 Nov 02 23:13:59.176653 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 569/1150] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:59 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:13:59.556846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6db7228b-543c-42d9-80f3-43c3df73fe4d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:13:59.557747 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6db7228b-543c-42d9-80f3-43c3df73fe4d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:13:59.564500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6db7228b-543c-42d9-80f3-43c3df73fe4d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:59.564940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6db7228b-543c-42d9-80f3-43c3df73fe4d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:59.565708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6db7228b-543c-42d9-80f3-43c3df73fe4d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:13:59.566133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6db7228b-543c-42d9-80f3-43c3df73fe4d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:13:59.597548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6db7228b-543c-42d9-80f3-43c3df73fe4d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044437 Nov 02 23:13:59.598130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 582/1151] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:13:59 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:00.083489 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-28272fa6-944b-4411-aee3-520c8c09c69d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:00.084096 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-28272fa6-944b-4411-aee3-520c8c09c69d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:00.089956 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-28272fa6-944b-4411-aee3-520c8c09c69d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:00.090396 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-28272fa6-944b-4411-aee3-520c8c09c69d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:00.091191 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-28272fa6-944b-4411-aee3-520c8c09c69d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:00.091626 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-28272fa6-944b-4411-aee3-520c8c09c69d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:00.225924 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-28272fa6-944b-4411-aee3-520c8c09c69d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:00.234802 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-28272fa6-944b-4411-aee3-520c8c09c69d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:00.236313 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-28272fa6-944b-4411-aee3-520c8c09c69d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:00.237467 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-28272fa6-944b-4411-aee3-520c8c09c69d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.157644 Nov 02 23:14:00.238024 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 570/1152] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:00 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:14:00.286043 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3cd47a6f-2b9b-4007-b77a-51769d8b67c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:00.286972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3cd47a6f-2b9b-4007-b77a-51769d8b67c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:00.292771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3cd47a6f-2b9b-4007-b77a-51769d8b67c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:00.293895 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3cd47a6f-2b9b-4007-b77a-51769d8b67c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:00.294665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3cd47a6f-2b9b-4007-b77a-51769d8b67c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:00.295152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3cd47a6f-2b9b-4007-b77a-51769d8b67c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:00.322692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3cd47a6f-2b9b-4007-b77a-51769d8b67c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139128 Nov 02 23:14:00.323274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 583/1153] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:00 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:14:00.609499 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-d32ad22f-7b3c-46eb-bcb6-ad5dd5ab6cce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:00.610405 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-d32ad22f-7b3c-46eb-bcb6-ad5dd5ab6cce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:00.616324 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d32ad22f-7b3c-46eb-bcb6-ad5dd5ab6cce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:00.616763 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d32ad22f-7b3c-46eb-bcb6-ad5dd5ab6cce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:00.617527 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d32ad22f-7b3c-46eb-bcb6-ad5dd5ab6cce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:00.617996 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-d32ad22f-7b3c-46eb-bcb6-ad5dd5ab6cce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:00.646547 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-d32ad22f-7b3c-46eb-bcb6-ad5dd5ab6cce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041503 Nov 02 23:14:00.647137 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 571/1154] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:00 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:01.255495 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-420b4824-86ad-4fc0-b789-59e0fd8be750 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:01.256077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-420b4824-86ad-4fc0-b789-59e0fd8be750 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:01.262784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-420b4824-86ad-4fc0-b789-59e0fd8be750 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:01.263257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-420b4824-86ad-4fc0-b789-59e0fd8be750 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:01.264037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-420b4824-86ad-4fc0-b789-59e0fd8be750 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:01.264467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-420b4824-86ad-4fc0-b789-59e0fd8be750 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:01.333823 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-c7b90af6-1fb6-49a9-ac74-321f67395f10 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:01.335028 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-c7b90af6-1fb6-49a9-ac74-321f67395f10 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:01.341316 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c7b90af6-1fb6-49a9-ac74-321f67395f10 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:01.342013 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c7b90af6-1fb6-49a9-ac74-321f67395f10 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:01.342791 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c7b90af6-1fb6-49a9-ac74-321f67395f10 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:01.343251 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-c7b90af6-1fb6-49a9-ac74-321f67395f10 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:01.373844 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-c7b90af6-1fb6-49a9-ac74-321f67395f10 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043727 Nov 02 23:14:01.374420 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 572/1155] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:01 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:14:01.396596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-420b4824-86ad-4fc0-b789-59e0fd8be750 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:01.404672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-420b4824-86ad-4fc0-b789-59e0fd8be750 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:01.406138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-420b4824-86ad-4fc0-b789-59e0fd8be750 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:01.407291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-420b4824-86ad-4fc0-b789-59e0fd8be750 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.155659 Nov 02 23:14:01.407843 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 584/1156] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:01 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:14:01.657753 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-fd840a63-4e89-421c-9da7-97cd4c4953ef tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:01.658583 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-fd840a63-4e89-421c-9da7-97cd4c4953ef tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:01.664415 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fd840a63-4e89-421c-9da7-97cd4c4953ef tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:01.664860 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fd840a63-4e89-421c-9da7-97cd4c4953ef tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:01.665627 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fd840a63-4e89-421c-9da7-97cd4c4953ef tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:01.666052 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-fd840a63-4e89-421c-9da7-97cd4c4953ef tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:01.696400 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-fd840a63-4e89-421c-9da7-97cd4c4953ef tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042446 Nov 02 23:14:01.696958 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 573/1157] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:01 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:14:02.385469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3e01f864-0b23-4275-ab57-17efe8cd0c79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:02.386390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3e01f864-0b23-4275-ab57-17efe8cd0c79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:02.393483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e01f864-0b23-4275-ab57-17efe8cd0c79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:02.393929 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e01f864-0b23-4275-ab57-17efe8cd0c79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:02.394715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e01f864-0b23-4275-ab57-17efe8cd0c79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:02.395181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e01f864-0b23-4275-ab57-17efe8cd0c79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:02.425019 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-a0ee80dd-298b-4493-9fc3-bdf33d4966aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:02.425618 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-a0ee80dd-298b-4493-9fc3-bdf33d4966aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:02.427653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3e01f864-0b23-4275-ab57-17efe8cd0c79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045951 Nov 02 23:14:02.428228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 585/1158] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:02 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:14:02.432011 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a0ee80dd-298b-4493-9fc3-bdf33d4966aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:02.432448 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a0ee80dd-298b-4493-9fc3-bdf33d4966aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:02.433206 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a0ee80dd-298b-4493-9fc3-bdf33d4966aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:02.433627 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-a0ee80dd-298b-4493-9fc3-bdf33d4966aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:02.571859 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-a0ee80dd-298b-4493-9fc3-bdf33d4966aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:02.580256 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-a0ee80dd-298b-4493-9fc3-bdf33d4966aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:02.581738 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.policy [None req-a0ee80dd-298b-4493-9fc3-bdf33d4966aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115799) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:02.582890 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-a0ee80dd-298b-4493-9fc3-bdf33d4966aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.161531 Nov 02 23:14:02.585197 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 574/1159] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:02 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:02.708124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2657ccf7-2793-4292-9a3f-4e451be37e15 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:02.709015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2657ccf7-2793-4292-9a3f-4e451be37e15 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:02.714719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2657ccf7-2793-4292-9a3f-4e451be37e15 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:02.715707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2657ccf7-2793-4292-9a3f-4e451be37e15 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:02.716538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2657ccf7-2793-4292-9a3f-4e451be37e15 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:02.716969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2657ccf7-2793-4292-9a3f-4e451be37e15 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:02.745494 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2657ccf7-2793-4292-9a3f-4e451be37e15 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040985 Nov 02 23:14:02.745958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 586/1160] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:02 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:03.439626 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-0b5580dd-d7a4-4af5-9733-bacc5a29d855 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:03.440574 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-0b5580dd-d7a4-4af5-9733-bacc5a29d855 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:03.447502 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0b5580dd-d7a4-4af5-9733-bacc5a29d855 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:03.447954 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0b5580dd-d7a4-4af5-9733-bacc5a29d855 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:03.448729 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0b5580dd-d7a4-4af5-9733-bacc5a29d855 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:03.449157 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-0b5580dd-d7a4-4af5-9733-bacc5a29d855 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:03.479049 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: INFO nova.api.openstack.requestlog [None req-0b5580dd-d7a4-4af5-9733-bacc5a29d855 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043104 Nov 02 23:14:03.479847 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: [pid: 115799|app: 0|req: 575/1161] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:03 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:03.600745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7a8b5cab-3bda-41db-852e-9f9038acc75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:03.601351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7a8b5cab-3bda-41db-852e-9f9038acc75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:03.608096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7a8b5cab-3bda-41db-852e-9f9038acc75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:03.608543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7a8b5cab-3bda-41db-852e-9f9038acc75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:03.609313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7a8b5cab-3bda-41db-852e-9f9038acc75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:03.609749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7a8b5cab-3bda-41db-852e-9f9038acc75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:03.735958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7a8b5cab-3bda-41db-852e-9f9038acc75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:03.744359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7a8b5cab-3bda-41db-852e-9f9038acc75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:03.745855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7a8b5cab-3bda-41db-852e-9f9038acc75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:03.747653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7a8b5cab-3bda-41db-852e-9f9038acc75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.150564 Nov 02 23:14:03.748211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 587/1162] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:03 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:14:03.756776 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.api.openstack.wsgi [None req-976fbb57-0ad0-4787-9c60-8254137f08c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:03.757822 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG nova.compute.api [None req-976fbb57-0ad0-4787-9c60-8254137f08c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115799) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:03.763678 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-976fbb57-0ad0-4787-9c60-8254137f08c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:03.764123 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-976fbb57-0ad0-4787-9c60-8254137f08c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:03.764896 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: DEBUG oslo_concurrency.lockutils [None req-976fbb57-0ad0-4787-9c60-8254137f08c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:03.773298 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: Traceback (most recent call last): Nov 02 23:14:03.773444 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 02 23:14:03.773444 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: timer() Nov 02 23:14:03.773444 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 02 23:14:03.773444 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: cb(*args, **kw) Nov 02 23:14:03.773444 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 152, in _do_acquire Nov 02 23:14:03.773444 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: waiter.switch() Nov 02 23:14:03.773444 dv-cinder-815848-3-iscsi devstack@n-api.service[115799]: greenlet.error: cannot switch to a different thread Nov 02 23:14:04.489793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-828182da-6853-46c4-901e-127d7deb024e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:04.490695 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-828182da-6853-46c4-901e-127d7deb024e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:04.496532 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-828182da-6853-46c4-901e-127d7deb024e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:04.496973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-828182da-6853-46c4-901e-127d7deb024e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:04.497749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-828182da-6853-46c4-901e-127d7deb024e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:04.498174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-828182da-6853-46c4-901e-127d7deb024e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:04.529274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-828182da-6853-46c4-901e-127d7deb024e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043149 Nov 02 23:14:04.529842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 588/1163] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:04 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:14:04.766211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f54336ad-8d96-423f-8f23-279373c0d629 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:04.766868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f54336ad-8d96-423f-8f23-279373c0d629 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:04.773387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f54336ad-8d96-423f-8f23-279373c0d629 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:04.773832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f54336ad-8d96-423f-8f23-279373c0d629 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:04.774615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f54336ad-8d96-423f-8f23-279373c0d629 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:04.775114 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f54336ad-8d96-423f-8f23-279373c0d629 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:04.913730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f54336ad-8d96-423f-8f23-279373c0d629 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:04.922001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f54336ad-8d96-423f-8f23-279373c0d629 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:04.923526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f54336ad-8d96-423f-8f23-279373c0d629 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:04.924699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f54336ad-8d96-423f-8f23-279373c0d629 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.162924 Nov 02 23:14:04.925257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 589/1164] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:04 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:05.540891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fcaf11ca-5dea-4c46-9868-08fc58dd97ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:05.541797 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fcaf11ca-5dea-4c46-9868-08fc58dd97ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:05.548408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fcaf11ca-5dea-4c46-9868-08fc58dd97ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:05.548855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fcaf11ca-5dea-4c46-9868-08fc58dd97ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:05.549612 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fcaf11ca-5dea-4c46-9868-08fc58dd97ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:05.550038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fcaf11ca-5dea-4c46-9868-08fc58dd97ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:05.578254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fcaf11ca-5dea-4c46-9868-08fc58dd97ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041105 Nov 02 23:14:05.578803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 590/1165] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:05 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:14:05.942994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9bf15f79-a0e5-4258-8a44-bc4398eb4635 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:05.943612 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9bf15f79-a0e5-4258-8a44-bc4398eb4635 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:05.950394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9bf15f79-a0e5-4258-8a44-bc4398eb4635 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:05.950841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9bf15f79-a0e5-4258-8a44-bc4398eb4635 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:05.951652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9bf15f79-a0e5-4258-8a44-bc4398eb4635 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:05.952081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9bf15f79-a0e5-4258-8a44-bc4398eb4635 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:06.079927 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9bf15f79-a0e5-4258-8a44-bc4398eb4635 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:06.088105 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9bf15f79-a0e5-4258-8a44-bc4398eb4635 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:06.089594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9bf15f79-a0e5-4258-8a44-bc4398eb4635 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:06.091378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9bf15f79-a0e5-4258-8a44-bc4398eb4635 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.152069 Nov 02 23:14:06.091944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 591/1166] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:05 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:06.589988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-59b79b50-f3d7-425a-856d-1e746603a318 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:06.591110 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-59b79b50-f3d7-425a-856d-1e746603a318 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:06.597000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59b79b50-f3d7-425a-856d-1e746603a318 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:06.597539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59b79b50-f3d7-425a-856d-1e746603a318 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:06.598316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59b79b50-f3d7-425a-856d-1e746603a318 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:06.598751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59b79b50-f3d7-425a-856d-1e746603a318 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:06.628007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-59b79b50-f3d7-425a-856d-1e746603a318 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041973 Nov 02 23:14:06.628572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 592/1167] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:06 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:14:07.109218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-343e52bc-8d63-491b-8324-a3c7e4fac8ff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:07.109936 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-343e52bc-8d63-491b-8324-a3c7e4fac8ff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:07.116129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-343e52bc-8d63-491b-8324-a3c7e4fac8ff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:07.116573 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-343e52bc-8d63-491b-8324-a3c7e4fac8ff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:07.117344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-343e52bc-8d63-491b-8324-a3c7e4fac8ff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:07.117777 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-343e52bc-8d63-491b-8324-a3c7e4fac8ff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:07.262835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-343e52bc-8d63-491b-8324-a3c7e4fac8ff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:07.271650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-343e52bc-8d63-491b-8324-a3c7e4fac8ff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:07.273184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-343e52bc-8d63-491b-8324-a3c7e4fac8ff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:07.274389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-343e52bc-8d63-491b-8324-a3c7e4fac8ff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.169506 Nov 02 23:14:07.274977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 593/1168] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:07 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:07.640014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8b70e4e5-b75c-4de0-99d5-f9d57337bc97 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:07.640916 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8b70e4e5-b75c-4de0-99d5-f9d57337bc97 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:07.646682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8b70e4e5-b75c-4de0-99d5-f9d57337bc97 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:07.647156 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8b70e4e5-b75c-4de0-99d5-f9d57337bc97 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:07.647942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8b70e4e5-b75c-4de0-99d5-f9d57337bc97 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:07.648393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8b70e4e5-b75c-4de0-99d5-f9d57337bc97 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:07.677713 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8b70e4e5-b75c-4de0-99d5-f9d57337bc97 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042063 Nov 02 23:14:07.678252 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 594/1169] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:07 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:14:08.293672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8b89dd26-f84e-49dc-bdcb-fdf2f91cbc59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:08.294302 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8b89dd26-f84e-49dc-bdcb-fdf2f91cbc59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:08.300662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8b89dd26-f84e-49dc-bdcb-fdf2f91cbc59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:08.301112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8b89dd26-f84e-49dc-bdcb-fdf2f91cbc59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:08.301900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8b89dd26-f84e-49dc-bdcb-fdf2f91cbc59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:08.302339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8b89dd26-f84e-49dc-bdcb-fdf2f91cbc59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:08.435369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8b89dd26-f84e-49dc-bdcb-fdf2f91cbc59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:08.443428 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8b89dd26-f84e-49dc-bdcb-fdf2f91cbc59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:08.444928 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8b89dd26-f84e-49dc-bdcb-fdf2f91cbc59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:08.446071 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8b89dd26-f84e-49dc-bdcb-fdf2f91cbc59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.156711 Nov 02 23:14:08.446628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 595/1170] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:08 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:08.688544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e19d1022-4641-4f09-a7e4-f39ed8b9f0aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:08.689456 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e19d1022-4641-4f09-a7e4-f39ed8b9f0aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:08.695292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e19d1022-4641-4f09-a7e4-f39ed8b9f0aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:08.695769 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e19d1022-4641-4f09-a7e4-f39ed8b9f0aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:08.696537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e19d1022-4641-4f09-a7e4-f39ed8b9f0aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:08.696967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e19d1022-4641-4f09-a7e4-f39ed8b9f0aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:08.726658 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e19d1022-4641-4f09-a7e4-f39ed8b9f0aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041844 Nov 02 23:14:08.727246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 596/1171] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:08 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:14:09.464282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-253c722c-8617-4514-a40c-fc65e563294f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:09.465392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-253c722c-8617-4514-a40c-fc65e563294f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:09.471466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-253c722c-8617-4514-a40c-fc65e563294f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:09.471906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-253c722c-8617-4514-a40c-fc65e563294f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:09.472666 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-253c722c-8617-4514-a40c-fc65e563294f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:09.473089 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-253c722c-8617-4514-a40c-fc65e563294f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:09.601293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-253c722c-8617-4514-a40c-fc65e563294f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:09.610514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-253c722c-8617-4514-a40c-fc65e563294f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:09.612006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-253c722c-8617-4514-a40c-fc65e563294f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:09.613176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-253c722c-8617-4514-a40c-fc65e563294f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.152685 Nov 02 23:14:09.613729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 597/1172] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:09 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:09.738095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-85d29604-6911-4da7-8182-c373876130b7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:09.739033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-85d29604-6911-4da7-8182-c373876130b7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:09.745275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85d29604-6911-4da7-8182-c373876130b7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:09.745712 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85d29604-6911-4da7-8182-c373876130b7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:09.746493 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85d29604-6911-4da7-8182-c373876130b7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:09.746934 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85d29604-6911-4da7-8182-c373876130b7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:09.778158 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-85d29604-6911-4da7-8182-c373876130b7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043201 Nov 02 23:14:09.778746 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 598/1173] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:09 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:14:10.630986 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b5368709-2ae3-4e72-a9a8-900c90bd559e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:10.631599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b5368709-2ae3-4e72-a9a8-900c90bd559e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:10.637837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5368709-2ae3-4e72-a9a8-900c90bd559e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:10.638286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5368709-2ae3-4e72-a9a8-900c90bd559e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:10.639084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5368709-2ae3-4e72-a9a8-900c90bd559e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:10.639520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5368709-2ae3-4e72-a9a8-900c90bd559e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:10.770269 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b5368709-2ae3-4e72-a9a8-900c90bd559e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:10.778810 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b5368709-2ae3-4e72-a9a8-900c90bd559e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:10.780303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b5368709-2ae3-4e72-a9a8-900c90bd559e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:10.781424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b5368709-2ae3-4e72-a9a8-900c90bd559e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.154196 Nov 02 23:14:10.782033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 599/1174] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:10 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:10.789227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2e09c325-2398-48c9-82f2-1cd23695a1cd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:10.790150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2e09c325-2398-48c9-82f2-1cd23695a1cd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:10.796442 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2e09c325-2398-48c9-82f2-1cd23695a1cd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:10.796905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2e09c325-2398-48c9-82f2-1cd23695a1cd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:10.797673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2e09c325-2398-48c9-82f2-1cd23695a1cd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:10.798105 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2e09c325-2398-48c9-82f2-1cd23695a1cd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:10.826526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2e09c325-2398-48c9-82f2-1cd23695a1cd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040853 Nov 02 23:14:10.827169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 600/1175] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:10 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:14:11.800194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a3f827c3-296d-4b04-a1e2-40536b39ec65 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:11.800878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a3f827c3-296d-4b04-a1e2-40536b39ec65 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:11.807638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3f827c3-296d-4b04-a1e2-40536b39ec65 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:11.808143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3f827c3-296d-4b04-a1e2-40536b39ec65 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:11.808997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3f827c3-296d-4b04-a1e2-40536b39ec65 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:11.809462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3f827c3-296d-4b04-a1e2-40536b39ec65 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:11.941032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a3f827c3-296d-4b04-a1e2-40536b39ec65 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:11.949923 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a3f827c3-296d-4b04-a1e2-40536b39ec65 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:11.951446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a3f827c3-296d-4b04-a1e2-40536b39ec65 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:11.953004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a3f827c3-296d-4b04-a1e2-40536b39ec65 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.156362 Nov 02 23:14:11.953552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 601/1176] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:11 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:11.958163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-53a73ec1-8d41-41ca-8244-e6315fbb2588 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:11.959101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-53a73ec1-8d41-41ca-8244-e6315fbb2588 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:11.965556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53a73ec1-8d41-41ca-8244-e6315fbb2588 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:11.966002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53a73ec1-8d41-41ca-8244-e6315fbb2588 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:11.966777 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53a73ec1-8d41-41ca-8244-e6315fbb2588 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:11.967236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53a73ec1-8d41-41ca-8244-e6315fbb2588 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:11.996886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-53a73ec1-8d41-41ca-8244-e6315fbb2588 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042240 Nov 02 23:14:11.997478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 602/1177] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:11 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:12.971251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-612f0f4f-0467-45e5-844d-a0a47e8c740a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:12.971896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-612f0f4f-0467-45e5-844d-a0a47e8c740a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:12.978058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-612f0f4f-0467-45e5-844d-a0a47e8c740a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:12.978506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-612f0f4f-0467-45e5-844d-a0a47e8c740a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:12.979303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-612f0f4f-0467-45e5-844d-a0a47e8c740a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:12.979735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-612f0f4f-0467-45e5-844d-a0a47e8c740a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:13.107257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-612f0f4f-0467-45e5-844d-a0a47e8c740a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:13.115437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-612f0f4f-0467-45e5-844d-a0a47e8c740a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:13.116921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-612f0f4f-0467-45e5-844d-a0a47e8c740a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:13.118068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-612f0f4f-0467-45e5-844d-a0a47e8c740a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.150592 Nov 02 23:14:13.118618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 603/1178] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:12 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:13.124228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b5a50632-248f-4392-ae26-d4f64450e13e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:13.125159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b5a50632-248f-4392-ae26-d4f64450e13e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:13.130878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5a50632-248f-4392-ae26-d4f64450e13e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:13.131345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5a50632-248f-4392-ae26-d4f64450e13e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:13.132109 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5a50632-248f-4392-ae26-d4f64450e13e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:13.132531 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5a50632-248f-4392-ae26-d4f64450e13e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:13.162372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b5a50632-248f-4392-ae26-d4f64450e13e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042698 Nov 02 23:14:13.162943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 604/1179] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:13 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:14.137323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5ce9f640-c475-48ae-95d9-f0043d56b0f8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:14.137960 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5ce9f640-c475-48ae-95d9-f0043d56b0f8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:14.144221 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ce9f640-c475-48ae-95d9-f0043d56b0f8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:14.144658 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ce9f640-c475-48ae-95d9-f0043d56b0f8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:14.145406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ce9f640-c475-48ae-95d9-f0043d56b0f8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:14.145829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ce9f640-c475-48ae-95d9-f0043d56b0f8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:14.279931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5ce9f640-c475-48ae-95d9-f0043d56b0f8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:14.288267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5ce9f640-c475-48ae-95d9-f0043d56b0f8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:14.289776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5ce9f640-c475-48ae-95d9-f0043d56b0f8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:14.290982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5ce9f640-c475-48ae-95d9-f0043d56b0f8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.157836 Nov 02 23:14:14.291541 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 605/1180] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:14 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:14.295993 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6c84f75e-cf79-40c0-8623-e6cd71300a99 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:14.296891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6c84f75e-cf79-40c0-8623-e6cd71300a99 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:14.302551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c84f75e-cf79-40c0-8623-e6cd71300a99 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:14.303021 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c84f75e-cf79-40c0-8623-e6cd71300a99 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:14.303786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c84f75e-cf79-40c0-8623-e6cd71300a99 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:14.304211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c84f75e-cf79-40c0-8623-e6cd71300a99 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:14.332889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6c84f75e-cf79-40c0-8623-e6cd71300a99 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040250 Nov 02 23:14:14.333440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 606/1181] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:14 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:15.310323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-56239444-0195-4d2a-81ff-0561623eb76d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:15.311013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-56239444-0195-4d2a-81ff-0561623eb76d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:15.317334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56239444-0195-4d2a-81ff-0561623eb76d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:15.317782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56239444-0195-4d2a-81ff-0561623eb76d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:15.318546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56239444-0195-4d2a-81ff-0561623eb76d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:15.318993 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56239444-0195-4d2a-81ff-0561623eb76d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:15.446861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-56239444-0195-4d2a-81ff-0561623eb76d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:15.456224 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-56239444-0195-4d2a-81ff-0561623eb76d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:15.457719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-56239444-0195-4d2a-81ff-0561623eb76d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:15.458871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-56239444-0195-4d2a-81ff-0561623eb76d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.152855 Nov 02 23:14:15.459513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 607/1182] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:15 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:15.463803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3addb83e-64e9-47c1-8d42-7463c92dc163 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:15.464714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3addb83e-64e9-47c1-8d42-7463c92dc163 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:15.470429 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3addb83e-64e9-47c1-8d42-7463c92dc163 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:15.470873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3addb83e-64e9-47c1-8d42-7463c92dc163 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:15.471668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3addb83e-64e9-47c1-8d42-7463c92dc163 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:15.472099 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3addb83e-64e9-47c1-8d42-7463c92dc163 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:15.500709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3addb83e-64e9-47c1-8d42-7463c92dc163 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040235 Nov 02 23:14:15.501267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 608/1183] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:15 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:16.476101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-22ec5312-a356-4de7-8bde-c5784b2184a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:16.476781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-22ec5312-a356-4de7-8bde-c5784b2184a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:16.482902 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22ec5312-a356-4de7-8bde-c5784b2184a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:16.483374 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22ec5312-a356-4de7-8bde-c5784b2184a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:16.484133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22ec5312-a356-4de7-8bde-c5784b2184a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:16.484558 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22ec5312-a356-4de7-8bde-c5784b2184a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:16.614310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-22ec5312-a356-4de7-8bde-c5784b2184a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:16.622427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-22ec5312-a356-4de7-8bde-c5784b2184a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:16.623882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-22ec5312-a356-4de7-8bde-c5784b2184a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:16.625022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-22ec5312-a356-4de7-8bde-c5784b2184a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.152599 Nov 02 23:14:16.625575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 609/1184] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:16 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:16.629826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7268c98f-103c-4162-a02b-0052e1ab1f13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:16.630707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7268c98f-103c-4162-a02b-0052e1ab1f13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:16.636169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7268c98f-103c-4162-a02b-0052e1ab1f13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:16.637127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7268c98f-103c-4162-a02b-0052e1ab1f13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:16.637913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7268c98f-103c-4162-a02b-0052e1ab1f13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:16.638344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7268c98f-103c-4162-a02b-0052e1ab1f13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:16.666311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7268c98f-103c-4162-a02b-0052e1ab1f13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039729 Nov 02 23:14:16.666870 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 610/1185] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:16 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:17.643361 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5ab9407e-9c21-4283-b509-2278af08b75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:17.644004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5ab9407e-9c21-4283-b509-2278af08b75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:17.650065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ab9407e-9c21-4283-b509-2278af08b75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:17.650546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ab9407e-9c21-4283-b509-2278af08b75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:17.651355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ab9407e-9c21-4283-b509-2278af08b75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:17.651791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ab9407e-9c21-4283-b509-2278af08b75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:17.778163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5ab9407e-9c21-4283-b509-2278af08b75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:17.786281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5ab9407e-9c21-4283-b509-2278af08b75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:17.787798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5ab9407e-9c21-4283-b509-2278af08b75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:17.788928 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5ab9407e-9c21-4283-b509-2278af08b75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.149312 Nov 02 23:14:17.789475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 611/1186] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:17 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:17.794009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f8385b82-8920-4705-bc37-7b45b4c14b06 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:17.794899 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f8385b82-8920-4705-bc37-7b45b4c14b06 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:17.800588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8385b82-8920-4705-bc37-7b45b4c14b06 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:17.801061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8385b82-8920-4705-bc37-7b45b4c14b06 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:17.801819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8385b82-8920-4705-bc37-7b45b4c14b06 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:17.802242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8385b82-8920-4705-bc37-7b45b4c14b06 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:17.832447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f8385b82-8920-4705-bc37-7b45b4c14b06 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041805 Nov 02 23:14:17.833005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 612/1187] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:17 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:18.806941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5d43efd7-045b-45ea-bb14-b0a455685ccd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:18.807611 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5d43efd7-045b-45ea-bb14-b0a455685ccd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:18.813797 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d43efd7-045b-45ea-bb14-b0a455685ccd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:18.814242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d43efd7-045b-45ea-bb14-b0a455685ccd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:18.815041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d43efd7-045b-45ea-bb14-b0a455685ccd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:18.815476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d43efd7-045b-45ea-bb14-b0a455685ccd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:18.945776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5d43efd7-045b-45ea-bb14-b0a455685ccd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:18.954697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5d43efd7-045b-45ea-bb14-b0a455685ccd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:18.956223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5d43efd7-045b-45ea-bb14-b0a455685ccd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:18.957360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5d43efd7-045b-45ea-bb14-b0a455685ccd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.154223 Nov 02 23:14:18.957918 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 613/1188] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:18 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:18.962181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-10ee7587-87bc-4774-8aac-2212ae485e2d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:18.963118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-10ee7587-87bc-4774-8aac-2212ae485e2d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:18.969697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10ee7587-87bc-4774-8aac-2212ae485e2d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:18.970149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10ee7587-87bc-4774-8aac-2212ae485e2d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:18.970950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10ee7587-87bc-4774-8aac-2212ae485e2d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:18.971402 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10ee7587-87bc-4774-8aac-2212ae485e2d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:19.000009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-10ee7587-87bc-4774-8aac-2212ae485e2d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041088 Nov 02 23:14:19.000569 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 614/1189] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:18 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:19.975904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aad348c2-3af7-4680-b017-c9ce3cde5959 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:19.976507 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aad348c2-3af7-4680-b017-c9ce3cde5959 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:19.982756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aad348c2-3af7-4680-b017-c9ce3cde5959 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:19.983234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aad348c2-3af7-4680-b017-c9ce3cde5959 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:19.983996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aad348c2-3af7-4680-b017-c9ce3cde5959 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:19.984428 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aad348c2-3af7-4680-b017-c9ce3cde5959 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:20.110121 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aad348c2-3af7-4680-b017-c9ce3cde5959 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:20.119138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aad348c2-3af7-4680-b017-c9ce3cde5959 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:20.120630 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aad348c2-3af7-4680-b017-c9ce3cde5959 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:20.122444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aad348c2-3af7-4680-b017-c9ce3cde5959 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.150174 Nov 02 23:14:20.123027 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 615/1190] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:19 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:20.127328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4663db44-8449-485c-b512-3e5a8059b521 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:20.128220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4663db44-8449-485c-b512-3e5a8059b521 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:20.133897 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4663db44-8449-485c-b512-3e5a8059b521 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:20.134343 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4663db44-8449-485c-b512-3e5a8059b521 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:20.135159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4663db44-8449-485c-b512-3e5a8059b521 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:20.135594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4663db44-8449-485c-b512-3e5a8059b521 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:20.163209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4663db44-8449-485c-b512-3e5a8059b521 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039056 Nov 02 23:14:20.163764 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 616/1191] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:20 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:21.140137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6bda6987-05cc-4357-a0fd-492ffa5d2a0c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:21.140754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6bda6987-05cc-4357-a0fd-492ffa5d2a0c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:21.146892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6bda6987-05cc-4357-a0fd-492ffa5d2a0c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:21.147369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6bda6987-05cc-4357-a0fd-492ffa5d2a0c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:21.148123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6bda6987-05cc-4357-a0fd-492ffa5d2a0c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:21.148547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6bda6987-05cc-4357-a0fd-492ffa5d2a0c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:21.277597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6bda6987-05cc-4357-a0fd-492ffa5d2a0c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:21.285673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6bda6987-05cc-4357-a0fd-492ffa5d2a0c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:21.287192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6bda6987-05cc-4357-a0fd-492ffa5d2a0c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:21.288335 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6bda6987-05cc-4357-a0fd-492ffa5d2a0c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.152447 Nov 02 23:14:21.288886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 617/1192] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:21 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:21.293166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5bcec619-3d55-45a8-895a-6e0b815e9c8f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:21.294064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5bcec619-3d55-45a8-895a-6e0b815e9c8f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:21.299693 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5bcec619-3d55-45a8-895a-6e0b815e9c8f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:21.300136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5bcec619-3d55-45a8-895a-6e0b815e9c8f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:21.300909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5bcec619-3d55-45a8-895a-6e0b815e9c8f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:21.301334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5bcec619-3d55-45a8-895a-6e0b815e9c8f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:21.334870 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5bcec619-3d55-45a8-895a-6e0b815e9c8f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044847 Nov 02 23:14:21.335590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 618/1193] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:21 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:22.305968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-10394084-0a3a-47b4-b9a9-7b4e900378bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:22.306639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-10394084-0a3a-47b4-b9a9-7b4e900378bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:22.313339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10394084-0a3a-47b4-b9a9-7b4e900378bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:22.313783 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10394084-0a3a-47b4-b9a9-7b4e900378bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:22.314542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10394084-0a3a-47b4-b9a9-7b4e900378bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:22.315025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10394084-0a3a-47b4-b9a9-7b4e900378bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:22.449616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-10394084-0a3a-47b4-b9a9-7b4e900378bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:22.457954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-10394084-0a3a-47b4-b9a9-7b4e900378bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:22.459511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-10394084-0a3a-47b4-b9a9-7b4e900378bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:22.460586 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-10394084-0a3a-47b4-b9a9-7b4e900378bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.158293 Nov 02 23:14:22.461142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 619/1194] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:22 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:22.465512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b3456363-2d9f-460b-bb50-163459c1f0de tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:22.466399 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b3456363-2d9f-460b-bb50-163459c1f0de tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:22.471914 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3456363-2d9f-460b-bb50-163459c1f0de tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:22.472347 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3456363-2d9f-460b-bb50-163459c1f0de tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:22.473098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3456363-2d9f-460b-bb50-163459c1f0de tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:22.473554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3456363-2d9f-460b-bb50-163459c1f0de tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:22.502877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b3456363-2d9f-460b-bb50-163459c1f0de tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040756 Nov 02 23:14:22.503442 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 620/1195] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:22 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:23.477989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4cf72e52-9717-46de-bfab-e9c03e9cf2a1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:23.478594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4cf72e52-9717-46de-bfab-e9c03e9cf2a1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:23.485391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4cf72e52-9717-46de-bfab-e9c03e9cf2a1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:23.485831 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4cf72e52-9717-46de-bfab-e9c03e9cf2a1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:23.486595 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4cf72e52-9717-46de-bfab-e9c03e9cf2a1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:23.487056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4cf72e52-9717-46de-bfab-e9c03e9cf2a1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:23.769904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4cf72e52-9717-46de-bfab-e9c03e9cf2a1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:23.778589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4cf72e52-9717-46de-bfab-e9c03e9cf2a1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:23.780199 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4cf72e52-9717-46de-bfab-e9c03e9cf2a1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:23.781347 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4cf72e52-9717-46de-bfab-e9c03e9cf2a1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.307083 Nov 02 23:14:23.781914 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 621/1196] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:23 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:23.786353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9e55ed36-073a-4c01-b625-0484f672b778 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:23.787283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9e55ed36-073a-4c01-b625-0484f672b778 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:23.793478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e55ed36-073a-4c01-b625-0484f672b778 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:23.793925 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e55ed36-073a-4c01-b625-0484f672b778 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:23.794697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e55ed36-073a-4c01-b625-0484f672b778 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:23.795154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e55ed36-073a-4c01-b625-0484f672b778 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:23.824760 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9e55ed36-073a-4c01-b625-0484f672b778 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041263 Nov 02 23:14:23.825324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 622/1197] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:23 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:24.799483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-41dddef2-b80e-48bd-829c-7661250f5077 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:24.800149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-41dddef2-b80e-48bd-829c-7661250f5077 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:24.806293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-41dddef2-b80e-48bd-829c-7661250f5077 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:24.806729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-41dddef2-b80e-48bd-829c-7661250f5077 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:24.807522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-41dddef2-b80e-48bd-829c-7661250f5077 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:24.807943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-41dddef2-b80e-48bd-829c-7661250f5077 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:24.946733 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-41dddef2-b80e-48bd-829c-7661250f5077 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:24.955519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-41dddef2-b80e-48bd-829c-7661250f5077 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:24.956988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-41dddef2-b80e-48bd-829c-7661250f5077 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:24.958126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-41dddef2-b80e-48bd-829c-7661250f5077 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.162387 Nov 02 23:14:24.958675 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 623/1198] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:24 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:24.963035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1a0f65fe-e0a0-4042-a4be-18a2c0634844 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:24.963930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1a0f65fe-e0a0-4042-a4be-18a2c0634844 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:24.970217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a0f65fe-e0a0-4042-a4be-18a2c0634844 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:24.970659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a0f65fe-e0a0-4042-a4be-18a2c0634844 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:24.971469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a0f65fe-e0a0-4042-a4be-18a2c0634844 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:24.971903 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a0f65fe-e0a0-4042-a4be-18a2c0634844 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:25.000896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1a0f65fe-e0a0-4042-a4be-18a2c0634844 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041084 Nov 02 23:14:25.001364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 624/1199] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:24 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:25.977570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1a14b303-daad-418b-83a8-1c327fe3bd93 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:25.978226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1a14b303-daad-418b-83a8-1c327fe3bd93 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:25.985203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a14b303-daad-418b-83a8-1c327fe3bd93 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:25.985647 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a14b303-daad-418b-83a8-1c327fe3bd93 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:25.986417 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a14b303-daad-418b-83a8-1c327fe3bd93 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:25.986841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a14b303-daad-418b-83a8-1c327fe3bd93 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:26.115951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1a14b303-daad-418b-83a8-1c327fe3bd93 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:26.124289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1a14b303-daad-418b-83a8-1c327fe3bd93 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:26.125828 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1a14b303-daad-418b-83a8-1c327fe3bd93 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:26.126983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1a14b303-daad-418b-83a8-1c327fe3bd93 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.153093 Nov 02 23:14:26.127521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 625/1200] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:25 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:14:26.131836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c29a4b5a-58d0-4f8a-9e6f-64a9e2ef2621 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:26.132716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c29a4b5a-58d0-4f8a-9e6f-64a9e2ef2621 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:26.139033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c29a4b5a-58d0-4f8a-9e6f-64a9e2ef2621 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:26.139475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c29a4b5a-58d0-4f8a-9e6f-64a9e2ef2621 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:26.140234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c29a4b5a-58d0-4f8a-9e6f-64a9e2ef2621 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:26.140659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c29a4b5a-58d0-4f8a-9e6f-64a9e2ef2621 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:26.169690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c29a4b5a-58d0-4f8a-9e6f-64a9e2ef2621 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041107 Nov 02 23:14:26.170253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 626/1201] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:26 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:27.145548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ee176d41-f4ee-4742-b2dc-9daa1e205821 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:27.146180 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ee176d41-f4ee-4742-b2dc-9daa1e205821 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:27.153117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ee176d41-f4ee-4742-b2dc-9daa1e205821 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:27.153563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ee176d41-f4ee-4742-b2dc-9daa1e205821 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:27.154346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ee176d41-f4ee-4742-b2dc-9daa1e205821 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:27.154771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ee176d41-f4ee-4742-b2dc-9daa1e205821 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:27.285434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ee176d41-f4ee-4742-b2dc-9daa1e205821 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:27.294008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ee176d41-f4ee-4742-b2dc-9daa1e205821 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:27.295525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ee176d41-f4ee-4742-b2dc-9daa1e205821 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:27.296682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ee176d41-f4ee-4742-b2dc-9daa1e205821 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.155023 Nov 02 23:14:27.297242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 627/1202] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:27 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:27.301552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b936c3b1-4b89-448c-af48-0e273cc21285 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:27.302446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b936c3b1-4b89-448c-af48-0e273cc21285 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:27.308730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b936c3b1-4b89-448c-af48-0e273cc21285 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:27.309213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b936c3b1-4b89-448c-af48-0e273cc21285 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:27.309969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b936c3b1-4b89-448c-af48-0e273cc21285 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:27.310400 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b936c3b1-4b89-448c-af48-0e273cc21285 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:27.340179 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b936c3b1-4b89-448c-af48-0e273cc21285 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041396 Nov 02 23:14:27.340730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 628/1203] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:27 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:28.315251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cb0d7ed9-3452-490d-bb53-19903eb48ebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:28.315921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cb0d7ed9-3452-490d-bb53-19903eb48ebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:28.322351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cb0d7ed9-3452-490d-bb53-19903eb48ebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:28.322816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cb0d7ed9-3452-490d-bb53-19903eb48ebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:28.323635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cb0d7ed9-3452-490d-bb53-19903eb48ebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:28.324735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cb0d7ed9-3452-490d-bb53-19903eb48ebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:28.498522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cb0d7ed9-3452-490d-bb53-19903eb48ebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:28.508168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cb0d7ed9-3452-490d-bb53-19903eb48ebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:28.509639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cb0d7ed9-3452-490d-bb53-19903eb48ebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:28.511292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cb0d7ed9-3452-490d-bb53-19903eb48ebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.199672 Nov 02 23:14:28.512079 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 629/1204] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:28 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:28.517409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0cacf66c-034c-4ed8-9d70-e64cb6cf8a29 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:28.518468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0cacf66c-034c-4ed8-9d70-e64cb6cf8a29 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:28.525524 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0cacf66c-034c-4ed8-9d70-e64cb6cf8a29 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:28.526109 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0cacf66c-034c-4ed8-9d70-e64cb6cf8a29 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:28.527051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0cacf66c-034c-4ed8-9d70-e64cb6cf8a29 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:28.527531 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0cacf66c-034c-4ed8-9d70-e64cb6cf8a29 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:28.564076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0cacf66c-034c-4ed8-9d70-e64cb6cf8a29 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050875 Nov 02 23:14:28.564667 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 630/1205] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:28 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:29.532123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8011a7e5-a2c5-4e07-bf8b-c0898164f54e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:29.532841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8011a7e5-a2c5-4e07-bf8b-c0898164f54e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:29.539840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8011a7e5-a2c5-4e07-bf8b-c0898164f54e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:29.540284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8011a7e5-a2c5-4e07-bf8b-c0898164f54e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:29.541081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8011a7e5-a2c5-4e07-bf8b-c0898164f54e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:29.541497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8011a7e5-a2c5-4e07-bf8b-c0898164f54e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:29.686602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8011a7e5-a2c5-4e07-bf8b-c0898164f54e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:29.695954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8011a7e5-a2c5-4e07-bf8b-c0898164f54e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:29.697551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8011a7e5-a2c5-4e07-bf8b-c0898164f54e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:29.699359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8011a7e5-a2c5-4e07-bf8b-c0898164f54e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.171044 Nov 02 23:14:29.706175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 631/1206] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:29 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:29.711338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-87d81448-e069-46de-a219-5fd61014b8ec tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:29.712264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-87d81448-e069-46de-a219-5fd61014b8ec tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:29.718204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87d81448-e069-46de-a219-5fd61014b8ec tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:29.718647 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87d81448-e069-46de-a219-5fd61014b8ec tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:29.719459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87d81448-e069-46de-a219-5fd61014b8ec tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:29.719892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87d81448-e069-46de-a219-5fd61014b8ec tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:29.750618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-87d81448-e069-46de-a219-5fd61014b8ec tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043200 Nov 02 23:14:29.751443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 632/1207] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:29 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:30.718325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f62028b5-f64f-4313-acb9-2be0188beac5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:30.719025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f62028b5-f64f-4313-acb9-2be0188beac5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:30.724908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f62028b5-f64f-4313-acb9-2be0188beac5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:30.725351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f62028b5-f64f-4313-acb9-2be0188beac5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:30.726112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f62028b5-f64f-4313-acb9-2be0188beac5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:30.726539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f62028b5-f64f-4313-acb9-2be0188beac5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:30.862770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f62028b5-f64f-4313-acb9-2be0188beac5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:30.871603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f62028b5-f64f-4313-acb9-2be0188beac5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:30.873011 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f62028b5-f64f-4313-acb9-2be0188beac5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:30.874175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f62028b5-f64f-4313-acb9-2be0188beac5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.160151 Nov 02 23:14:30.874731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 633/1208] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:30 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:30.879078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2002b9a4-da66-4a54-9d5d-d05872c51454 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:30.879984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2002b9a4-da66-4a54-9d5d-d05872c51454 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:30.885934 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2002b9a4-da66-4a54-9d5d-d05872c51454 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:30.886879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2002b9a4-da66-4a54-9d5d-d05872c51454 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:30.887681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2002b9a4-da66-4a54-9d5d-d05872c51454 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:30.888117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2002b9a4-da66-4a54-9d5d-d05872c51454 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:30.917132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2002b9a4-da66-4a54-9d5d-d05872c51454 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041343 Nov 02 23:14:30.917886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 634/1209] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:30 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:31.892144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7ae2889b-c08d-4e5d-b026-df68c9d11c36 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:31.892829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7ae2889b-c08d-4e5d-b026-df68c9d11c36 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:31.899050 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ae2889b-c08d-4e5d-b026-df68c9d11c36 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:31.899501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ae2889b-c08d-4e5d-b026-df68c9d11c36 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:31.900278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ae2889b-c08d-4e5d-b026-df68c9d11c36 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:31.900709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ae2889b-c08d-4e5d-b026-df68c9d11c36 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:32.033394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7ae2889b-c08d-4e5d-b026-df68c9d11c36 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:32.041585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7ae2889b-c08d-4e5d-b026-df68c9d11c36 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:32.043074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7ae2889b-c08d-4e5d-b026-df68c9d11c36 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:32.044243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7ae2889b-c08d-4e5d-b026-df68c9d11c36 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.155862 Nov 02 23:14:32.044792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 635/1210] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:31 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:32.049157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3dc9da0a-6705-426f-a3d0-33a58ffc8358 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:32.050048 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3dc9da0a-6705-426f-a3d0-33a58ffc8358 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:32.055886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dc9da0a-6705-426f-a3d0-33a58ffc8358 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:32.056337 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dc9da0a-6705-426f-a3d0-33a58ffc8358 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:32.057106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dc9da0a-6705-426f-a3d0-33a58ffc8358 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:32.057529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dc9da0a-6705-426f-a3d0-33a58ffc8358 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:32.088270 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3dc9da0a-6705-426f-a3d0-33a58ffc8358 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042448 Nov 02 23:14:32.088835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 636/1211] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:32 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:33.063369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5f6f8c12-7906-4290-afc3-5f6da6738056 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:33.064082 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5f6f8c12-7906-4290-afc3-5f6da6738056 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:33.070517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f6f8c12-7906-4290-afc3-5f6da6738056 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:33.070999 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f6f8c12-7906-4290-afc3-5f6da6738056 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:33.071781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f6f8c12-7906-4290-afc3-5f6da6738056 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:33.072246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f6f8c12-7906-4290-afc3-5f6da6738056 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:33.218636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5f6f8c12-7906-4290-afc3-5f6da6738056 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:33.227760 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5f6f8c12-7906-4290-afc3-5f6da6738056 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:33.229248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5f6f8c12-7906-4290-afc3-5f6da6738056 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:33.231199 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5f6f8c12-7906-4290-afc3-5f6da6738056 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.171357 Nov 02 23:14:33.231785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 637/1212] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:33 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:14:33.236589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2979ff7a-824e-4a95-85f0-90e4394bb7cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:33.237475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2979ff7a-824e-4a95-85f0-90e4394bb7cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:33.243990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2979ff7a-824e-4a95-85f0-90e4394bb7cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:33.244589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2979ff7a-824e-4a95-85f0-90e4394bb7cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:33.245376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2979ff7a-824e-4a95-85f0-90e4394bb7cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:33.245808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2979ff7a-824e-4a95-85f0-90e4394bb7cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:33.279249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2979ff7a-824e-4a95-85f0-90e4394bb7cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046114 Nov 02 23:14:33.280082 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 638/1213] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:33 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:34.255543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d2fbc532-52f4-4b7a-9799-1b48b647772c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:34.256218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d2fbc532-52f4-4b7a-9799-1b48b647772c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:34.263845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2fbc532-52f4-4b7a-9799-1b48b647772c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:34.264288 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2fbc532-52f4-4b7a-9799-1b48b647772c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:34.265061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2fbc532-52f4-4b7a-9799-1b48b647772c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:34.265667 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2fbc532-52f4-4b7a-9799-1b48b647772c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:34.403197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d2fbc532-52f4-4b7a-9799-1b48b647772c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:34.412160 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d2fbc532-52f4-4b7a-9799-1b48b647772c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:34.413766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d2fbc532-52f4-4b7a-9799-1b48b647772c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:34.414986 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d2fbc532-52f4-4b7a-9799-1b48b647772c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.163144 Nov 02 23:14:34.415539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 639/1214] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:34 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:34.420737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-393c0d28-3617-4d38-ac55-05c9e8866dbf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:34.421624 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-393c0d28-3617-4d38-ac55-05c9e8866dbf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:34.428083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-393c0d28-3617-4d38-ac55-05c9e8866dbf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:34.428632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-393c0d28-3617-4d38-ac55-05c9e8866dbf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:34.429438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-393c0d28-3617-4d38-ac55-05c9e8866dbf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:34.429874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-393c0d28-3617-4d38-ac55-05c9e8866dbf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:34.461440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-393c0d28-3617-4d38-ac55-05c9e8866dbf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044697 Nov 02 23:14:34.461916 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 640/1215] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:34 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:35.433993 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-66657541-73fd-46d8-8e0c-5896ba83c197 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:35.434666 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-66657541-73fd-46d8-8e0c-5896ba83c197 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:35.440859 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66657541-73fd-46d8-8e0c-5896ba83c197 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:35.441301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66657541-73fd-46d8-8e0c-5896ba83c197 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:35.442070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66657541-73fd-46d8-8e0c-5896ba83c197 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:35.442500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66657541-73fd-46d8-8e0c-5896ba83c197 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:35.566464 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-66657541-73fd-46d8-8e0c-5896ba83c197 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:35.574585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-66657541-73fd-46d8-8e0c-5896ba83c197 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:35.576102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-66657541-73fd-46d8-8e0c-5896ba83c197 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:35.577502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-66657541-73fd-46d8-8e0c-5896ba83c197 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.147547 Nov 02 23:14:35.578078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 641/1216] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:35 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:35.582303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d3f028ab-d224-42e9-b952-369078549621 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:35.583231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d3f028ab-d224-42e9-b952-369078549621 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:35.588670 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3f028ab-d224-42e9-b952-369078549621 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:35.589117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3f028ab-d224-42e9-b952-369078549621 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:35.590387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3f028ab-d224-42e9-b952-369078549621 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:35.590814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3f028ab-d224-42e9-b952-369078549621 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:35.617979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d3f028ab-d224-42e9-b952-369078549621 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038956 Nov 02 23:14:35.618515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 642/1217] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:35 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:36.595556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fb2e1104-1f75-40f0-b09b-84dc70790c2d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:36.596218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fb2e1104-1f75-40f0-b09b-84dc70790c2d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:36.602713 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fb2e1104-1f75-40f0-b09b-84dc70790c2d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:36.603190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fb2e1104-1f75-40f0-b09b-84dc70790c2d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:36.603985 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fb2e1104-1f75-40f0-b09b-84dc70790c2d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:36.604477 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fb2e1104-1f75-40f0-b09b-84dc70790c2d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:36.736008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fb2e1104-1f75-40f0-b09b-84dc70790c2d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:36.746215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fb2e1104-1f75-40f0-b09b-84dc70790c2d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:36.747768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fb2e1104-1f75-40f0-b09b-84dc70790c2d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:36.748935 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fb2e1104-1f75-40f0-b09b-84dc70790c2d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.157287 Nov 02 23:14:36.749494 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 643/1218] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:36 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:36.754027 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c3c8ba50-df11-4552-a4ae-c8037524655e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:36.754953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c3c8ba50-df11-4552-a4ae-c8037524655e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:36.760640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3c8ba50-df11-4552-a4ae-c8037524655e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:36.761610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3c8ba50-df11-4552-a4ae-c8037524655e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:36.762395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3c8ba50-df11-4552-a4ae-c8037524655e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:36.762837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3c8ba50-df11-4552-a4ae-c8037524655e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:36.790935 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c3c8ba50-df11-4552-a4ae-c8037524655e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040438 Nov 02 23:14:36.791491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 644/1219] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:36 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:37.767078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2f78a8c1-57b2-4900-923e-c34fc4af3cf0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:37.767716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2f78a8c1-57b2-4900-923e-c34fc4af3cf0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:37.773911 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2f78a8c1-57b2-4900-923e-c34fc4af3cf0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:37.774362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2f78a8c1-57b2-4900-923e-c34fc4af3cf0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:37.775160 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2f78a8c1-57b2-4900-923e-c34fc4af3cf0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:37.775596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2f78a8c1-57b2-4900-923e-c34fc4af3cf0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:37.919298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2f78a8c1-57b2-4900-923e-c34fc4af3cf0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:37.927866 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2f78a8c1-57b2-4900-923e-c34fc4af3cf0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:37.929349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2f78a8c1-57b2-4900-923e-c34fc4af3cf0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:37.930539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2f78a8c1-57b2-4900-923e-c34fc4af3cf0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.167308 Nov 02 23:14:37.931133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 645/1220] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:37 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:37.936278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ce686d27-f548-4ceb-bccb-35cb6b914cba tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:37.937201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ce686d27-f548-4ceb-bccb-35cb6b914cba tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:37.943494 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce686d27-f548-4ceb-bccb-35cb6b914cba tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:37.943968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce686d27-f548-4ceb-bccb-35cb6b914cba tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:37.944757 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce686d27-f548-4ceb-bccb-35cb6b914cba tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:37.945191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce686d27-f548-4ceb-bccb-35cb6b914cba tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:37.978359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ce686d27-f548-4ceb-bccb-35cb6b914cba tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046149 Nov 02 23:14:37.978964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 646/1221] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:37 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:38.949077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-52850eb6-3568-4942-b0d4-9bdf5746c05a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:38.949759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-52850eb6-3568-4942-b0d4-9bdf5746c05a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:38.956111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52850eb6-3568-4942-b0d4-9bdf5746c05a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:38.956551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52850eb6-3568-4942-b0d4-9bdf5746c05a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:38.957308 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52850eb6-3568-4942-b0d4-9bdf5746c05a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:38.957729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52850eb6-3568-4942-b0d4-9bdf5746c05a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:39.087992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-52850eb6-3568-4942-b0d4-9bdf5746c05a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:39.096474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-52850eb6-3568-4942-b0d4-9bdf5746c05a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:39.098005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-52850eb6-3568-4942-b0d4-9bdf5746c05a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:39.099254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-52850eb6-3568-4942-b0d4-9bdf5746c05a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.153856 Nov 02 23:14:39.099833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 647/1222] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:38 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:39.105163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8dd9854a-c33e-47fb-8a54-15575ecf157e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:39.106103 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8dd9854a-c33e-47fb-8a54-15575ecf157e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:39.112782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8dd9854a-c33e-47fb-8a54-15575ecf157e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:39.113238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8dd9854a-c33e-47fb-8a54-15575ecf157e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:39.114053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8dd9854a-c33e-47fb-8a54-15575ecf157e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:39.114486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8dd9854a-c33e-47fb-8a54-15575ecf157e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:39.143439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8dd9854a-c33e-47fb-8a54-15575ecf157e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042548 Nov 02 23:14:39.143990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 648/1223] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:39 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:40.118282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-64c21c35-266e-4046-9934-954c616ebd57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:40.119078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-64c21c35-266e-4046-9934-954c616ebd57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:40.125976 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-64c21c35-266e-4046-9934-954c616ebd57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:40.126419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-64c21c35-266e-4046-9934-954c616ebd57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:40.127208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-64c21c35-266e-4046-9934-954c616ebd57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:40.127635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-64c21c35-266e-4046-9934-954c616ebd57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:40.257054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-64c21c35-266e-4046-9934-954c616ebd57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:40.266013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-64c21c35-266e-4046-9934-954c616ebd57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:40.267519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-64c21c35-266e-4046-9934-954c616ebd57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:40.268661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-64c21c35-266e-4046-9934-954c616ebd57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.154784 Nov 02 23:14:40.269208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 649/1224] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:40 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:14:40.273681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-521da9f0-6c92-4093-a6df-c72969900337 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:40.274605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-521da9f0-6c92-4093-a6df-c72969900337 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:40.280360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-521da9f0-6c92-4093-a6df-c72969900337 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:40.280800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-521da9f0-6c92-4093-a6df-c72969900337 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:40.281558 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-521da9f0-6c92-4093-a6df-c72969900337 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:40.281986 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-521da9f0-6c92-4093-a6df-c72969900337 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:40.310025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-521da9f0-6c92-4093-a6df-c72969900337 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039648 Nov 02 23:14:40.310567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 650/1225] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:40 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:41.290502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-27a0f631-35ef-4955-b573-8c61efc9b09c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:41.291150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-27a0f631-35ef-4955-b573-8c61efc9b09c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:41.298080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27a0f631-35ef-4955-b573-8c61efc9b09c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:41.298412 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27a0f631-35ef-4955-b573-8c61efc9b09c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:41.299365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27a0f631-35ef-4955-b573-8c61efc9b09c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:41.299810 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27a0f631-35ef-4955-b573-8c61efc9b09c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:41.429237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-27a0f631-35ef-4955-b573-8c61efc9b09c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:41.437963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-27a0f631-35ef-4955-b573-8c61efc9b09c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:41.439496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-27a0f631-35ef-4955-b573-8c61efc9b09c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:41.440637 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-27a0f631-35ef-4955-b573-8c61efc9b09c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.153812 Nov 02 23:14:41.441192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 651/1226] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:41 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:41.445783 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ef6caaa5-576a-4ee1-abaf-bc38ccdbd623 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:41.446676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ef6caaa5-576a-4ee1-abaf-bc38ccdbd623 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:41.452406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ef6caaa5-576a-4ee1-abaf-bc38ccdbd623 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:41.452861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ef6caaa5-576a-4ee1-abaf-bc38ccdbd623 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:41.453626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ef6caaa5-576a-4ee1-abaf-bc38ccdbd623 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:41.454060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ef6caaa5-576a-4ee1-abaf-bc38ccdbd623 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:41.481949 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ef6caaa5-576a-4ee1-abaf-bc38ccdbd623 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039769 Nov 02 23:14:41.482494 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 652/1227] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:41 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:42.458975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fa92c614-f04f-40f6-9d5d-472a720be30c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:42.459686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fa92c614-f04f-40f6-9d5d-472a720be30c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:42.466217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fa92c614-f04f-40f6-9d5d-472a720be30c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:42.466658 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fa92c614-f04f-40f6-9d5d-472a720be30c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:42.467442 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fa92c614-f04f-40f6-9d5d-472a720be30c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:42.467868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fa92c614-f04f-40f6-9d5d-472a720be30c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:42.598851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fa92c614-f04f-40f6-9d5d-472a720be30c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:42.607664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fa92c614-f04f-40f6-9d5d-472a720be30c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:42.609137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fa92c614-f04f-40f6-9d5d-472a720be30c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:42.610302 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fa92c614-f04f-40f6-9d5d-472a720be30c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.155173 Nov 02 23:14:42.610849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 653/1228] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:42 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:42.615283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e2c80e3b-21bc-4c01-95bb-e7719b2fff4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:42.616174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e2c80e3b-21bc-4c01-95bb-e7719b2fff4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:42.621872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e2c80e3b-21bc-4c01-95bb-e7719b2fff4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:42.622308 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e2c80e3b-21bc-4c01-95bb-e7719b2fff4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:42.623100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e2c80e3b-21bc-4c01-95bb-e7719b2fff4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:42.623525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e2c80e3b-21bc-4c01-95bb-e7719b2fff4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:42.653626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e2c80e3b-21bc-4c01-95bb-e7719b2fff4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041740 Nov 02 23:14:42.654174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 654/1229] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:42 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:43.627819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-15622a3c-af30-44e1-a2c5-0cfc5dfc1615 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:43.628514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-15622a3c-af30-44e1-a2c5-0cfc5dfc1615 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:43.635059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15622a3c-af30-44e1-a2c5-0cfc5dfc1615 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:43.635502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15622a3c-af30-44e1-a2c5-0cfc5dfc1615 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:43.636319 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15622a3c-af30-44e1-a2c5-0cfc5dfc1615 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:43.636743 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15622a3c-af30-44e1-a2c5-0cfc5dfc1615 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:43.767135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-15622a3c-af30-44e1-a2c5-0cfc5dfc1615 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:43.777635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-15622a3c-af30-44e1-a2c5-0cfc5dfc1615 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:43.779139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-15622a3c-af30-44e1-a2c5-0cfc5dfc1615 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:43.780299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-15622a3c-af30-44e1-a2c5-0cfc5dfc1615 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.156183 Nov 02 23:14:43.780860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 655/1230] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:43 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:43.785396 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-229df37f-9b3d-4f5a-97de-5f2ffc04a3b2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:43.786293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-229df37f-9b3d-4f5a-97de-5f2ffc04a3b2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:43.792162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-229df37f-9b3d-4f5a-97de-5f2ffc04a3b2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:43.793112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-229df37f-9b3d-4f5a-97de-5f2ffc04a3b2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:43.793873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-229df37f-9b3d-4f5a-97de-5f2ffc04a3b2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:43.794301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-229df37f-9b3d-4f5a-97de-5f2ffc04a3b2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:43.822117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-229df37f-9b3d-4f5a-97de-5f2ffc04a3b2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040251 Nov 02 23:14:43.822663 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 656/1231] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:43 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:44.798118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4df9091c-b021-443a-8a1f-bcf8fa31ef76 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:44.798800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4df9091c-b021-443a-8a1f-bcf8fa31ef76 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:44.804889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4df9091c-b021-443a-8a1f-bcf8fa31ef76 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:44.805328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4df9091c-b021-443a-8a1f-bcf8fa31ef76 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:44.806083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4df9091c-b021-443a-8a1f-bcf8fa31ef76 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:44.806523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4df9091c-b021-443a-8a1f-bcf8fa31ef76 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:44.936678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4df9091c-b021-443a-8a1f-bcf8fa31ef76 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:44.944641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4df9091c-b021-443a-8a1f-bcf8fa31ef76 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:44.946107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4df9091c-b021-443a-8a1f-bcf8fa31ef76 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:44.947385 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4df9091c-b021-443a-8a1f-bcf8fa31ef76 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.152943 Nov 02 23:14:44.947935 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 657/1232] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:44 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:44.952586 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4340a3c3-15c5-4ef0-be25-69f3f1f8737a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:44.953459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4340a3c3-15c5-4ef0-be25-69f3f1f8737a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:44.958728 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4340a3c3-15c5-4ef0-be25-69f3f1f8737a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:44.959206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4340a3c3-15c5-4ef0-be25-69f3f1f8737a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:44.959958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4340a3c3-15c5-4ef0-be25-69f3f1f8737a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:44.960382 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4340a3c3-15c5-4ef0-be25-69f3f1f8737a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:44.988974 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4340a3c3-15c5-4ef0-be25-69f3f1f8737a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039988 Nov 02 23:14:44.989528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 658/1233] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:44 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:45.965672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a9abd335-d75f-43e9-bb6b-f969a84faa04 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:45.966372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a9abd335-d75f-43e9-bb6b-f969a84faa04 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:45.972473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9abd335-d75f-43e9-bb6b-f969a84faa04 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:45.972851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9abd335-d75f-43e9-bb6b-f969a84faa04 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:45.973604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9abd335-d75f-43e9-bb6b-f969a84faa04 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:45.974030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9abd335-d75f-43e9-bb6b-f969a84faa04 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:46.100217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a9abd335-d75f-43e9-bb6b-f969a84faa04 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:46.108906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a9abd335-d75f-43e9-bb6b-f969a84faa04 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:46.110373 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a9abd335-d75f-43e9-bb6b-f969a84faa04 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:46.111531 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a9abd335-d75f-43e9-bb6b-f969a84faa04 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.150249 Nov 02 23:14:46.112118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 659/1234] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:45 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:46.116365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-83fc20bd-be56-4196-9e05-acd381001368 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:46.117265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-83fc20bd-be56-4196-9e05-acd381001368 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:46.122657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83fc20bd-be56-4196-9e05-acd381001368 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:46.123140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83fc20bd-be56-4196-9e05-acd381001368 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:46.123904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83fc20bd-be56-4196-9e05-acd381001368 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:46.124333 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83fc20bd-be56-4196-9e05-acd381001368 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:46.153144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-83fc20bd-be56-4196-9e05-acd381001368 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040001 Nov 02 23:14:46.153690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 660/1235] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:46 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:47.129805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-166b87a5-be53-47e7-ab33-0e08289f3ca8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:47.130424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-166b87a5-be53-47e7-ab33-0e08289f3ca8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:47.137051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-166b87a5-be53-47e7-ab33-0e08289f3ca8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:47.137484 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-166b87a5-be53-47e7-ab33-0e08289f3ca8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:47.138243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-166b87a5-be53-47e7-ab33-0e08289f3ca8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:47.138664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-166b87a5-be53-47e7-ab33-0e08289f3ca8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:47.278798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-166b87a5-be53-47e7-ab33-0e08289f3ca8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:47.287642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-166b87a5-be53-47e7-ab33-0e08289f3ca8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:47.289132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-166b87a5-be53-47e7-ab33-0e08289f3ca8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:47.290337 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-166b87a5-be53-47e7-ab33-0e08289f3ca8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.164494 Nov 02 23:14:47.290906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 661/1236] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:47 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:47.295560 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-47bffeb0-b3f6-4164-b29f-f775fa5b504e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:47.296625 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-47bffeb0-b3f6-4164-b29f-f775fa5b504e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:47.302870 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47bffeb0-b3f6-4164-b29f-f775fa5b504e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:47.303343 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47bffeb0-b3f6-4164-b29f-f775fa5b504e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:47.304126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47bffeb0-b3f6-4164-b29f-f775fa5b504e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:47.304557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47bffeb0-b3f6-4164-b29f-f775fa5b504e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:47.342376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-47bffeb0-b3f6-4164-b29f-f775fa5b504e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045827 Nov 02 23:14:47.342376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 662/1237] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:47 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:48.309110 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-68973eb2-43dd-46ee-abaa-935061aa8e8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:48.309786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-68973eb2-43dd-46ee-abaa-935061aa8e8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:48.315984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-68973eb2-43dd-46ee-abaa-935061aa8e8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:48.316423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-68973eb2-43dd-46ee-abaa-935061aa8e8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:48.317196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-68973eb2-43dd-46ee-abaa-935061aa8e8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:48.317696 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-68973eb2-43dd-46ee-abaa-935061aa8e8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:48.445973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-68973eb2-43dd-46ee-abaa-935061aa8e8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:48.454450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-68973eb2-43dd-46ee-abaa-935061aa8e8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:48.455977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-68973eb2-43dd-46ee-abaa-935061aa8e8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:48.457127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-68973eb2-43dd-46ee-abaa-935061aa8e8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.151800 Nov 02 23:14:48.457680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 663/1238] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:48 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:48.462213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b5b68d0e-60d4-4b9a-9965-7dce0a8d8291 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:48.463138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b5b68d0e-60d4-4b9a-9965-7dce0a8d8291 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:48.469142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5b68d0e-60d4-4b9a-9965-7dce0a8d8291 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:48.469593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5b68d0e-60d4-4b9a-9965-7dce0a8d8291 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:48.470368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5b68d0e-60d4-4b9a-9965-7dce0a8d8291 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:48.470798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5b68d0e-60d4-4b9a-9965-7dce0a8d8291 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:48.499163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b5b68d0e-60d4-4b9a-9965-7dce0a8d8291 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040439 Nov 02 23:14:48.499713 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 664/1239] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:48 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:49.474508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c017ae0f-7798-44ca-98f1-65c559a3a7a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:49.475220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c017ae0f-7798-44ca-98f1-65c559a3a7a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:49.481968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c017ae0f-7798-44ca-98f1-65c559a3a7a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:49.482408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c017ae0f-7798-44ca-98f1-65c559a3a7a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:49.483211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c017ae0f-7798-44ca-98f1-65c559a3a7a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:49.483643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c017ae0f-7798-44ca-98f1-65c559a3a7a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:49.610419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c017ae0f-7798-44ca-98f1-65c559a3a7a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:49.618467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c017ae0f-7798-44ca-98f1-65c559a3a7a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:49.619982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c017ae0f-7798-44ca-98f1-65c559a3a7a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:49.621740 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c017ae0f-7798-44ca-98f1-65c559a3a7a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.150938 Nov 02 23:14:49.622292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 665/1240] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:49 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:49.626678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-683aaf10-a216-43e4-91e4-0b81d58d5568 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:49.627625 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-683aaf10-a216-43e4-91e4-0b81d58d5568 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:49.633666 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-683aaf10-a216-43e4-91e4-0b81d58d5568 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:49.634107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-683aaf10-a216-43e4-91e4-0b81d58d5568 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:49.634883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-683aaf10-a216-43e4-91e4-0b81d58d5568 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:49.635350 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-683aaf10-a216-43e4-91e4-0b81d58d5568 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:49.666513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-683aaf10-a216-43e4-91e4-0b81d58d5568 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043146 Nov 02 23:14:49.667662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 666/1241] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:49 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:50.640698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aec45558-bf77-4966-98e6-095fb24e3030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:50.641317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aec45558-bf77-4966-98e6-095fb24e3030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:50.647845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aec45558-bf77-4966-98e6-095fb24e3030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:50.648294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aec45558-bf77-4966-98e6-095fb24e3030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:50.649063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aec45558-bf77-4966-98e6-095fb24e3030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:50.649489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aec45558-bf77-4966-98e6-095fb24e3030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:51.002455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aec45558-bf77-4966-98e6-095fb24e3030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:51.010554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aec45558-bf77-4966-98e6-095fb24e3030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:51.012296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aec45558-bf77-4966-98e6-095fb24e3030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:51.013515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aec45558-bf77-4966-98e6-095fb24e3030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.376497 Nov 02 23:14:51.014079 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 667/1242] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:50 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:51.018608 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-871acbba-e3b4-49d3-9253-c7f50d0d2e93 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:51.019877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-871acbba-e3b4-49d3-9253-c7f50d0d2e93 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:51.026219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-871acbba-e3b4-49d3-9253-c7f50d0d2e93 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:51.026689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-871acbba-e3b4-49d3-9253-c7f50d0d2e93 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:51.027503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-871acbba-e3b4-49d3-9253-c7f50d0d2e93 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:51.027937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-871acbba-e3b4-49d3-9253-c7f50d0d2e93 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:51.056420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-871acbba-e3b4-49d3-9253-c7f50d0d2e93 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041251 Nov 02 23:14:51.056957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 668/1243] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:51 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:52.031749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d64ca65f-721d-44e1-b2e2-315aafb46abb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:52.032365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d64ca65f-721d-44e1-b2e2-315aafb46abb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:52.038446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d64ca65f-721d-44e1-b2e2-315aafb46abb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:52.038884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d64ca65f-721d-44e1-b2e2-315aafb46abb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:52.039669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d64ca65f-721d-44e1-b2e2-315aafb46abb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:52.040091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d64ca65f-721d-44e1-b2e2-315aafb46abb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:52.165522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d64ca65f-721d-44e1-b2e2-315aafb46abb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:52.173573 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d64ca65f-721d-44e1-b2e2-315aafb46abb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:52.175085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d64ca65f-721d-44e1-b2e2-315aafb46abb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:52.176243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d64ca65f-721d-44e1-b2e2-315aafb46abb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.148236 Nov 02 23:14:52.176800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 669/1244] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:52 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:52.181057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e478a603-d6e1-4ce4-8ea2-09565e19e093 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:52.181950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e478a603-d6e1-4ce4-8ea2-09565e19e093 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:52.187961 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e478a603-d6e1-4ce4-8ea2-09565e19e093 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:52.188410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e478a603-d6e1-4ce4-8ea2-09565e19e093 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:52.189179 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e478a603-d6e1-4ce4-8ea2-09565e19e093 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:52.189614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e478a603-d6e1-4ce4-8ea2-09565e19e093 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:52.220037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e478a603-d6e1-4ce4-8ea2-09565e19e093 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042220 Nov 02 23:14:52.220598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 670/1245] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:52 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:53.194541 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-eaefb824-c09b-4320-b243-78faabcd811d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:53.195311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-eaefb824-c09b-4320-b243-78faabcd811d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:53.201938 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eaefb824-c09b-4320-b243-78faabcd811d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:53.202645 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eaefb824-c09b-4320-b243-78faabcd811d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:53.203457 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eaefb824-c09b-4320-b243-78faabcd811d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:53.203894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eaefb824-c09b-4320-b243-78faabcd811d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:53.337284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-eaefb824-c09b-4320-b243-78faabcd811d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:53.346061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-eaefb824-c09b-4320-b243-78faabcd811d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:53.347593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-eaefb824-c09b-4320-b243-78faabcd811d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:53.348733 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-eaefb824-c09b-4320-b243-78faabcd811d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.157913 Nov 02 23:14:53.349281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 671/1246] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:53 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:53.353586 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a383fd4f-68a5-4fd3-8174-87dc910ec09d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:53.354483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a383fd4f-68a5-4fd3-8174-87dc910ec09d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:53.359907 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a383fd4f-68a5-4fd3-8174-87dc910ec09d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:53.360353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a383fd4f-68a5-4fd3-8174-87dc910ec09d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:53.361127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a383fd4f-68a5-4fd3-8174-87dc910ec09d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:53.361627 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a383fd4f-68a5-4fd3-8174-87dc910ec09d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:53.389436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a383fd4f-68a5-4fd3-8174-87dc910ec09d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039192 Nov 02 23:14:53.389994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 672/1247] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:53 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:54.366198 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c983a978-c105-4aab-b44c-55396972c4ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:54.366818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c983a978-c105-4aab-b44c-55396972c4ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:54.373341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c983a978-c105-4aab-b44c-55396972c4ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:54.373779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c983a978-c105-4aab-b44c-55396972c4ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:54.374533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c983a978-c105-4aab-b44c-55396972c4ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:54.374977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c983a978-c105-4aab-b44c-55396972c4ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:54.505511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c983a978-c105-4aab-b44c-55396972c4ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:54.514882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c983a978-c105-4aab-b44c-55396972c4ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:54.516422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c983a978-c105-4aab-b44c-55396972c4ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:54.517630 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c983a978-c105-4aab-b44c-55396972c4ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.155176 Nov 02 23:14:54.518196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 673/1248] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:54 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:54.522800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d2a23ce7-54e3-4c26-95df-5dcafc602845 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:54.523739 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d2a23ce7-54e3-4c26-95df-5dcafc602845 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:54.530269 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2a23ce7-54e3-4c26-95df-5dcafc602845 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:54.530718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2a23ce7-54e3-4c26-95df-5dcafc602845 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:54.531535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2a23ce7-54e3-4c26-95df-5dcafc602845 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:54.531967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2a23ce7-54e3-4c26-95df-5dcafc602845 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:54.563358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d2a23ce7-54e3-4c26-95df-5dcafc602845 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044051 Nov 02 23:14:54.563940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 674/1249] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:54 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:55.534928 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-66e008e3-7027-40d7-915e-00c97c0bb7e8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:55.535623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-66e008e3-7027-40d7-915e-00c97c0bb7e8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:55.542268 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66e008e3-7027-40d7-915e-00c97c0bb7e8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:55.542717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66e008e3-7027-40d7-915e-00c97c0bb7e8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:55.543535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66e008e3-7027-40d7-915e-00c97c0bb7e8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:55.543969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66e008e3-7027-40d7-915e-00c97c0bb7e8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:55.672322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-66e008e3-7027-40d7-915e-00c97c0bb7e8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:55.680423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-66e008e3-7027-40d7-915e-00c97c0bb7e8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:55.681931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-66e008e3-7027-40d7-915e-00c97c0bb7e8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:55.683712 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-66e008e3-7027-40d7-915e-00c97c0bb7e8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.152500 Nov 02 23:14:55.684265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 675/1250] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:55 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:55.688672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1c05f980-5c93-4665-a8c5-34962b5eb1f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:55.689563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1c05f980-5c93-4665-a8c5-34962b5eb1f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:55.695364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c05f980-5c93-4665-a8c5-34962b5eb1f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:55.695810 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c05f980-5c93-4665-a8c5-34962b5eb1f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:55.696580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c05f980-5c93-4665-a8c5-34962b5eb1f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:55.697006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c05f980-5c93-4665-a8c5-34962b5eb1f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:55.725952 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1c05f980-5c93-4665-a8c5-34962b5eb1f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040662 Nov 02 23:14:55.726519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 676/1251] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:55 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:56.701804 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0e4a1ebf-e088-46b9-aec0-b37592f59856 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:56.703304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0e4a1ebf-e088-46b9-aec0-b37592f59856 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:56.710072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e4a1ebf-e088-46b9-aec0-b37592f59856 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:56.710523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e4a1ebf-e088-46b9-aec0-b37592f59856 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:56.711365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e4a1ebf-e088-46b9-aec0-b37592f59856 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:56.711802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e4a1ebf-e088-46b9-aec0-b37592f59856 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:56.853347 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0e4a1ebf-e088-46b9-aec0-b37592f59856 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:56.862847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0e4a1ebf-e088-46b9-aec0-b37592f59856 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:56.864395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0e4a1ebf-e088-46b9-aec0-b37592f59856 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:56.865932 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0e4a1ebf-e088-46b9-aec0-b37592f59856 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.167702 Nov 02 23:14:56.866508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 677/1252] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:56 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:56.872064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ea3b36bb-541c-4da9-897e-317bfdd8fe28 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:56.872973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ea3b36bb-541c-4da9-897e-317bfdd8fe28 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:56.879161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea3b36bb-541c-4da9-897e-317bfdd8fe28 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:56.879613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea3b36bb-541c-4da9-897e-317bfdd8fe28 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:56.880400 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea3b36bb-541c-4da9-897e-317bfdd8fe28 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:56.880838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea3b36bb-541c-4da9-897e-317bfdd8fe28 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:56.912090 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ea3b36bb-541c-4da9-897e-317bfdd8fe28 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044413 Nov 02 23:14:56.912566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 678/1253] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:56 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:57.884512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7325afc7-7d16-4c48-b9e6-ea4dfa788b33 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:57.885168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7325afc7-7d16-4c48-b9e6-ea4dfa788b33 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:57.892278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7325afc7-7d16-4c48-b9e6-ea4dfa788b33 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:57.892720 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7325afc7-7d16-4c48-b9e6-ea4dfa788b33 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:57.893512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7325afc7-7d16-4c48-b9e6-ea4dfa788b33 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:57.893943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7325afc7-7d16-4c48-b9e6-ea4dfa788b33 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:58.021431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7325afc7-7d16-4c48-b9e6-ea4dfa788b33 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:58.029879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7325afc7-7d16-4c48-b9e6-ea4dfa788b33 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:58.031399 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7325afc7-7d16-4c48-b9e6-ea4dfa788b33 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:58.032554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7325afc7-7d16-4c48-b9e6-ea4dfa788b33 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.151968 Nov 02 23:14:58.033126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 679/1254] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:57 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:58.037575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-05c0f7d1-3715-426f-8549-0b209bb10cfc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:58.038485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-05c0f7d1-3715-426f-8549-0b209bb10cfc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:58.053023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05c0f7d1-3715-426f-8549-0b209bb10cfc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:58.053023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05c0f7d1-3715-426f-8549-0b209bb10cfc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:58.053023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05c0f7d1-3715-426f-8549-0b209bb10cfc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:58.053023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05c0f7d1-3715-426f-8549-0b209bb10cfc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:58.079431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-05c0f7d1-3715-426f-8549-0b209bb10cfc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045256 Nov 02 23:14:58.079984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 680/1255] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:58 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:14:59.051395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a9e11840-47f5-4098-a85e-b11a8d8bf3f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:59.052086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a9e11840-47f5-4098-a85e-b11a8d8bf3f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:59.058381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9e11840-47f5-4098-a85e-b11a8d8bf3f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:59.059217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9e11840-47f5-4098-a85e-b11a8d8bf3f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:59.059649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9e11840-47f5-4098-a85e-b11a8d8bf3f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:59.060078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9e11840-47f5-4098-a85e-b11a8d8bf3f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:59.196195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a9e11840-47f5-4098-a85e-b11a8d8bf3f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:59.205358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a9e11840-47f5-4098-a85e-b11a8d8bf3f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:59.206832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a9e11840-47f5-4098-a85e-b11a8d8bf3f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:14:59.208019 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a9e11840-47f5-4098-a85e-b11a8d8bf3f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.160360 Nov 02 23:14:59.208567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 681/1256] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:14:59 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:14:59.213231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-42b23dfc-fb71-4a16-b301-4e5f96e63833 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:14:59.214703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-42b23dfc-fb71-4a16-b301-4e5f96e63833 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:14:59.220429 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42b23dfc-fb71-4a16-b301-4e5f96e63833 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:59.220874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42b23dfc-fb71-4a16-b301-4e5f96e63833 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:59.221632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42b23dfc-fb71-4a16-b301-4e5f96e63833 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:14:59.222055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42b23dfc-fb71-4a16-b301-4e5f96e63833 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:14:59.250951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-42b23dfc-fb71-4a16-b301-4e5f96e63833 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041333 Nov 02 23:14:59.251499 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 682/1257] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:14:59 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:00.226316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e66f2478-7457-4573-adcc-f66edb90e760 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:00.227045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e66f2478-7457-4573-adcc-f66edb90e760 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:00.233082 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e66f2478-7457-4573-adcc-f66edb90e760 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:00.233535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e66f2478-7457-4573-adcc-f66edb90e760 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:00.234307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e66f2478-7457-4573-adcc-f66edb90e760 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:00.234735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e66f2478-7457-4573-adcc-f66edb90e760 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:00.368999 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e66f2478-7457-4573-adcc-f66edb90e760 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:00.378671 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e66f2478-7457-4573-adcc-f66edb90e760 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:00.380646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e66f2478-7457-4573-adcc-f66edb90e760 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:00.381320 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e66f2478-7457-4573-adcc-f66edb90e760 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.158816 Nov 02 23:15:00.381870 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 683/1258] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:00 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:00.386802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4176ffe5-88ad-4650-9c97-aa152fdc7add tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:00.387793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4176ffe5-88ad-4650-9c97-aa152fdc7add tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:00.395457 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4176ffe5-88ad-4650-9c97-aa152fdc7add tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:00.395897 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4176ffe5-88ad-4650-9c97-aa152fdc7add tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:00.396657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4176ffe5-88ad-4650-9c97-aa152fdc7add tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:00.397080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4176ffe5-88ad-4650-9c97-aa152fdc7add tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:00.426459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4176ffe5-88ad-4650-9c97-aa152fdc7add tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043561 Nov 02 23:15:00.427190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 684/1259] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:00 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:01.399940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-50393025-1301-4650-9111-79a13bad5ea5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:01.400581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-50393025-1301-4650-9111-79a13bad5ea5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:01.407545 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50393025-1301-4650-9111-79a13bad5ea5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:01.407994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50393025-1301-4650-9111-79a13bad5ea5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:01.408772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50393025-1301-4650-9111-79a13bad5ea5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:01.409226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50393025-1301-4650-9111-79a13bad5ea5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:01.543644 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-50393025-1301-4650-9111-79a13bad5ea5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:01.551907 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-50393025-1301-4650-9111-79a13bad5ea5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:01.553379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-50393025-1301-4650-9111-79a13bad5ea5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:01.555548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-50393025-1301-4650-9111-79a13bad5ea5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.158324 Nov 02 23:15:01.555548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 685/1260] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:01 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:01.559472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d193a0ee-d13d-4002-a523-749febaf4385 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:01.560372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d193a0ee-d13d-4002-a523-749febaf4385 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:01.566378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d193a0ee-d13d-4002-a523-749febaf4385 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:01.566823 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d193a0ee-d13d-4002-a523-749febaf4385 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:01.568191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d193a0ee-d13d-4002-a523-749febaf4385 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:01.568191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d193a0ee-d13d-4002-a523-749febaf4385 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:01.598062 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d193a0ee-d13d-4002-a523-749febaf4385 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041904 Nov 02 23:15:01.598618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 686/1261] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:01 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:02.572402 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f94b0e2c-63e2-4b43-824e-e64dead669c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:02.573736 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f94b0e2c-63e2-4b43-824e-e64dead669c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:02.580688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f94b0e2c-63e2-4b43-824e-e64dead669c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:02.581170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f94b0e2c-63e2-4b43-824e-e64dead669c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:02.581966 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f94b0e2c-63e2-4b43-824e-e64dead669c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:02.582878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f94b0e2c-63e2-4b43-824e-e64dead669c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:02.715794 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f94b0e2c-63e2-4b43-824e-e64dead669c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:02.723802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f94b0e2c-63e2-4b43-824e-e64dead669c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:02.725307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f94b0e2c-63e2-4b43-824e-e64dead669c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:02.726438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f94b0e2c-63e2-4b43-824e-e64dead669c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.157817 Nov 02 23:15:02.727010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 687/1262] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:02 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:02.731296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-37329949-dab5-47d6-aedf-49dc2fa7bc9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:02.732182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-37329949-dab5-47d6-aedf-49dc2fa7bc9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:02.738231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-37329949-dab5-47d6-aedf-49dc2fa7bc9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:02.738675 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-37329949-dab5-47d6-aedf-49dc2fa7bc9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:02.739502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-37329949-dab5-47d6-aedf-49dc2fa7bc9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:02.739929 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-37329949-dab5-47d6-aedf-49dc2fa7bc9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:02.769859 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-37329949-dab5-47d6-aedf-49dc2fa7bc9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041842 Nov 02 23:15:02.770460 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 688/1263] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:02 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:03.745009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-57338011-5ac1-4b1d-8087-8196563ee367 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:03.745657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-57338011-5ac1-4b1d-8087-8196563ee367 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:03.752234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-57338011-5ac1-4b1d-8087-8196563ee367 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:03.752674 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-57338011-5ac1-4b1d-8087-8196563ee367 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:03.753440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-57338011-5ac1-4b1d-8087-8196563ee367 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:03.753862 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-57338011-5ac1-4b1d-8087-8196563ee367 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:03.892940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-57338011-5ac1-4b1d-8087-8196563ee367 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:03.901340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-57338011-5ac1-4b1d-8087-8196563ee367 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:03.902816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-57338011-5ac1-4b1d-8087-8196563ee367 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:03.903993 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-57338011-5ac1-4b1d-8087-8196563ee367 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.163283 Nov 02 23:15:03.904551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 689/1264] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:03 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:03.908944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-216f7bbe-4dd3-4cdc-8604-4eaea0e50e29 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:03.909842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-216f7bbe-4dd3-4cdc-8604-4eaea0e50e29 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:03.915818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-216f7bbe-4dd3-4cdc-8604-4eaea0e50e29 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:03.916235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-216f7bbe-4dd3-4cdc-8604-4eaea0e50e29 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:03.917493 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-216f7bbe-4dd3-4cdc-8604-4eaea0e50e29 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:03.917923 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-216f7bbe-4dd3-4cdc-8604-4eaea0e50e29 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:03.947514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-216f7bbe-4dd3-4cdc-8604-4eaea0e50e29 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041922 Nov 02 23:15:03.948258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 690/1265] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:03 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:03.952970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4908cc28-d7e4-43ac-8a0f-4cd70913bdfb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:03.953889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4908cc28-d7e4-43ac-8a0f-4cd70913bdfb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:03.959443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4908cc28-d7e4-43ac-8a0f-4cd70913bdfb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:03.959887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4908cc28-d7e4-43ac-8a0f-4cd70913bdfb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:03.960650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4908cc28-d7e4-43ac-8a0f-4cd70913bdfb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:03.961078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4908cc28-d7e4-43ac-8a0f-4cd70913bdfb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:03.989466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4908cc28-d7e4-43ac-8a0f-4cd70913bdfb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040221 Nov 02 23:15:03.990015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 691/1266] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:03 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:04.921477 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2957d01c-d890-4d65-aa80-4181578c78b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:04.922112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2957d01c-d890-4d65-aa80-4181578c78b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:04.928356 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2957d01c-d890-4d65-aa80-4181578c78b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:04.928801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2957d01c-d890-4d65-aa80-4181578c78b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:04.929575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2957d01c-d890-4d65-aa80-4181578c78b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:04.930010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2957d01c-d890-4d65-aa80-4181578c78b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:05.064535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2957d01c-d890-4d65-aa80-4181578c78b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:05.073598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2957d01c-d890-4d65-aa80-4181578c78b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:05.075100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2957d01c-d890-4d65-aa80-4181578c78b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:05.076266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2957d01c-d890-4d65-aa80-4181578c78b1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.158722 Nov 02 23:15:05.077256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 692/1267] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:04 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:05.081580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2efc5a46-38f3-4e45-8942-8bea1b6123b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:05.082465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2efc5a46-38f3-4e45-8942-8bea1b6123b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:05.088181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2efc5a46-38f3-4e45-8942-8bea1b6123b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:05.088627 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2efc5a46-38f3-4e45-8942-8bea1b6123b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:05.089387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2efc5a46-38f3-4e45-8942-8bea1b6123b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:05.089815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2efc5a46-38f3-4e45-8942-8bea1b6123b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:05.118476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2efc5a46-38f3-4e45-8942-8bea1b6123b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040200 Nov 02 23:15:05.119046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 693/1268] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:05 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:05.123909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3bfc2a46-0838-4257-af02-90d7fb855492 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:05.124792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3bfc2a46-0838-4257-af02-90d7fb855492 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:05.130488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3bfc2a46-0838-4257-af02-90d7fb855492 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:05.131084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3bfc2a46-0838-4257-af02-90d7fb855492 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:05.132011 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3bfc2a46-0838-4257-af02-90d7fb855492 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:05.132457 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3bfc2a46-0838-4257-af02-90d7fb855492 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:05.160740 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3bfc2a46-0838-4257-af02-90d7fb855492 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040659 Nov 02 23:15:05.161292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 694/1269] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:05 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:06.096382 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-81ea7e3f-781b-44d3-bba1-38a37c7bae98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:06.097096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-81ea7e3f-781b-44d3-bba1-38a37c7bae98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:06.103335 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81ea7e3f-781b-44d3-bba1-38a37c7bae98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:06.103780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81ea7e3f-781b-44d3-bba1-38a37c7bae98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:06.104551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81ea7e3f-781b-44d3-bba1-38a37c7bae98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:06.104982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81ea7e3f-781b-44d3-bba1-38a37c7bae98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:06.241953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-81ea7e3f-781b-44d3-bba1-38a37c7bae98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:06.251741 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-81ea7e3f-781b-44d3-bba1-38a37c7bae98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:06.253364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-81ea7e3f-781b-44d3-bba1-38a37c7bae98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:06.254636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-81ea7e3f-781b-44d3-bba1-38a37c7bae98 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.162930 Nov 02 23:15:06.255283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 695/1270] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:06 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:06.260330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-74005547-d570-4cc3-9e69-d53adc2b3e46 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:06.261817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-74005547-d570-4cc3-9e69-d53adc2b3e46 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:06.268141 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74005547-d570-4cc3-9e69-d53adc2b3e46 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:06.268592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74005547-d570-4cc3-9e69-d53adc2b3e46 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:06.269359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74005547-d570-4cc3-9e69-d53adc2b3e46 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:06.269997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74005547-d570-4cc3-9e69-d53adc2b3e46 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:06.299009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-74005547-d570-4cc3-9e69-d53adc2b3e46 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042611 Nov 02 23:15:06.299565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 696/1271] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:06 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:06.303947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d8349737-be1d-4b44-95b7-8001b1000d3c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:06.304840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d8349737-be1d-4b44-95b7-8001b1000d3c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:06.311449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8349737-be1d-4b44-95b7-8001b1000d3c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:06.311887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8349737-be1d-4b44-95b7-8001b1000d3c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:06.312669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8349737-be1d-4b44-95b7-8001b1000d3c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:06.313090 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8349737-be1d-4b44-95b7-8001b1000d3c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:06.343669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d8349737-be1d-4b44-95b7-8001b1000d3c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043078 Nov 02 23:15:06.344213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 697/1272] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:06 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:07.272858 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-41a81bab-c2c2-4da8-9eaf-74a48173dac4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:07.273688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-41a81bab-c2c2-4da8-9eaf-74a48173dac4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:07.279845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-41a81bab-c2c2-4da8-9eaf-74a48173dac4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:07.280289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-41a81bab-c2c2-4da8-9eaf-74a48173dac4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:07.281061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-41a81bab-c2c2-4da8-9eaf-74a48173dac4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:07.281490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-41a81bab-c2c2-4da8-9eaf-74a48173dac4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:07.417278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-41a81bab-c2c2-4da8-9eaf-74a48173dac4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:07.425416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-41a81bab-c2c2-4da8-9eaf-74a48173dac4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:07.426875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-41a81bab-c2c2-4da8-9eaf-74a48173dac4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:07.428038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-41a81bab-c2c2-4da8-9eaf-74a48173dac4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.158920 Nov 02 23:15:07.428588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 698/1273] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:07 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:07.433925 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-530a45b9-284e-49b3-9bd3-63b3d026da82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:07.434843 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-530a45b9-284e-49b3-9bd3-63b3d026da82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:07.442670 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-530a45b9-284e-49b3-9bd3-63b3d026da82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:07.443443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-530a45b9-284e-49b3-9bd3-63b3d026da82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:07.444248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-530a45b9-284e-49b3-9bd3-63b3d026da82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:07.444690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-530a45b9-284e-49b3-9bd3-63b3d026da82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:07.477952 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-530a45b9-284e-49b3-9bd3-63b3d026da82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048323 Nov 02 23:15:07.478536 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 699/1274] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:07 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:07.483605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e563f666-1273-45da-a65b-6e5f98d3344e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:07.484443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e563f666-1273-45da-a65b-6e5f98d3344e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:07.490367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e563f666-1273-45da-a65b-6e5f98d3344e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:07.490807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e563f666-1273-45da-a65b-6e5f98d3344e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:07.491615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e563f666-1273-45da-a65b-6e5f98d3344e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:07.492061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e563f666-1273-45da-a65b-6e5f98d3344e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:07.521332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e563f666-1273-45da-a65b-6e5f98d3344e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041232 Nov 02 23:15:07.521883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 700/1275] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:07 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:08.446549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-feced805-2b9b-4d0c-823e-0aaa5d062fa1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:08.447256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-feced805-2b9b-4d0c-823e-0aaa5d062fa1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:08.453754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-feced805-2b9b-4d0c-823e-0aaa5d062fa1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:08.454195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-feced805-2b9b-4d0c-823e-0aaa5d062fa1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:08.454984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-feced805-2b9b-4d0c-823e-0aaa5d062fa1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:08.455417 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-feced805-2b9b-4d0c-823e-0aaa5d062fa1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:08.581676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-feced805-2b9b-4d0c-823e-0aaa5d062fa1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:08.590225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-feced805-2b9b-4d0c-823e-0aaa5d062fa1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:08.591735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-feced805-2b9b-4d0c-823e-0aaa5d062fa1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:08.592877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-feced805-2b9b-4d0c-823e-0aaa5d062fa1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.150055 Nov 02 23:15:08.593433 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 701/1276] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:08 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:08.597741 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fc5dc18a-62c2-45d9-9e92-bf0d6de50171 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:08.598638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fc5dc18a-62c2-45d9-9e92-bf0d6de50171 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:08.604911 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc5dc18a-62c2-45d9-9e92-bf0d6de50171 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:08.605356 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc5dc18a-62c2-45d9-9e92-bf0d6de50171 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:08.606120 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc5dc18a-62c2-45d9-9e92-bf0d6de50171 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:08.606550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc5dc18a-62c2-45d9-9e92-bf0d6de50171 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:08.634630 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fc5dc18a-62c2-45d9-9e92-bf0d6de50171 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040187 Nov 02 23:15:08.635225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 702/1277] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:08 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:08.639503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7821bd8e-aff5-430e-ab86-5a438e9bbd09 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:08.640893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7821bd8e-aff5-430e-ab86-5a438e9bbd09 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:08.646130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7821bd8e-aff5-430e-ab86-5a438e9bbd09 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:08.646573 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7821bd8e-aff5-430e-ab86-5a438e9bbd09 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:08.647374 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7821bd8e-aff5-430e-ab86-5a438e9bbd09 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:08.647839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7821bd8e-aff5-430e-ab86-5a438e9bbd09 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:08.677174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7821bd8e-aff5-430e-ab86-5a438e9bbd09 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040929 Nov 02 23:15:08.677718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 703/1278] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:08 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:09.610853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a9ec1544-c327-404c-9c93-f40b42f6ec13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:09.611513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a9ec1544-c327-404c-9c93-f40b42f6ec13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:09.617593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9ec1544-c327-404c-9c93-f40b42f6ec13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:09.618038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9ec1544-c327-404c-9c93-f40b42f6ec13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:09.618801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9ec1544-c327-404c-9c93-f40b42f6ec13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:09.619249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9ec1544-c327-404c-9c93-f40b42f6ec13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:09.747118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a9ec1544-c327-404c-9c93-f40b42f6ec13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:09.755385 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a9ec1544-c327-404c-9c93-f40b42f6ec13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:09.756856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a9ec1544-c327-404c-9c93-f40b42f6ec13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:09.758001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a9ec1544-c327-404c-9c93-f40b42f6ec13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.150803 Nov 02 23:15:09.758558 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 704/1279] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:09 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:09.763633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b64ea009-d93d-41d9-999d-17acb2fd6a20 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:09.764528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b64ea009-d93d-41d9-999d-17acb2fd6a20 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:09.770285 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b64ea009-d93d-41d9-999d-17acb2fd6a20 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:09.770728 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b64ea009-d93d-41d9-999d-17acb2fd6a20 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:09.771529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b64ea009-d93d-41d9-999d-17acb2fd6a20 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:09.771951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b64ea009-d93d-41d9-999d-17acb2fd6a20 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:09.800598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b64ea009-d93d-41d9-999d-17acb2fd6a20 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040918 Nov 02 23:15:09.801067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 705/1280] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:09 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:09.805460 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b83078cb-23d8-4c03-8ad6-7d294c223f20 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:09.806373 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b83078cb-23d8-4c03-8ad6-7d294c223f20 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:09.811801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b83078cb-23d8-4c03-8ad6-7d294c223f20 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:09.812241 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b83078cb-23d8-4c03-8ad6-7d294c223f20 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:09.812996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b83078cb-23d8-4c03-8ad6-7d294c223f20 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:09.813423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b83078cb-23d8-4c03-8ad6-7d294c223f20 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:09.842358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b83078cb-23d8-4c03-8ad6-7d294c223f20 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040283 Nov 02 23:15:09.842911 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 706/1281] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:09 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:10.776628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f9043107-621d-4e08-8feb-1012e26def5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:10.777294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f9043107-621d-4e08-8feb-1012e26def5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:10.783751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f9043107-621d-4e08-8feb-1012e26def5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:10.784197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f9043107-621d-4e08-8feb-1012e26def5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:10.784978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f9043107-621d-4e08-8feb-1012e26def5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:10.785410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f9043107-621d-4e08-8feb-1012e26def5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:10.926421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f9043107-621d-4e08-8feb-1012e26def5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:10.935896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f9043107-621d-4e08-8feb-1012e26def5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:10.937370 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f9043107-621d-4e08-8feb-1012e26def5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:10.938569 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f9043107-621d-4e08-8feb-1012e26def5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.165740 Nov 02 23:15:10.939184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 707/1282] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:10 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:10.943801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-52fe5038-5192-4774-8cc9-b9f03b74e26a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:10.944704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-52fe5038-5192-4774-8cc9-b9f03b74e26a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:10.950968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52fe5038-5192-4774-8cc9-b9f03b74e26a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:10.951418 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52fe5038-5192-4774-8cc9-b9f03b74e26a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:10.952467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52fe5038-5192-4774-8cc9-b9f03b74e26a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:10.952893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52fe5038-5192-4774-8cc9-b9f03b74e26a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:10.984946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-52fe5038-5192-4774-8cc9-b9f03b74e26a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044690 Nov 02 23:15:10.985528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 708/1283] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:10 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:10.990132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2fdb4bba-720a-445d-96f2-992699cfef73 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:10.991065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2fdb4bba-720a-445d-96f2-992699cfef73 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:10.997023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2fdb4bba-720a-445d-96f2-992699cfef73 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:10.997465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2fdb4bba-720a-445d-96f2-992699cfef73 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:10.998243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2fdb4bba-720a-445d-96f2-992699cfef73 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:10.998668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2fdb4bba-720a-445d-96f2-992699cfef73 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:11.029305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2fdb4bba-720a-445d-96f2-992699cfef73 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042713 Nov 02 23:15:11.029882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 709/1284] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:10 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:11.957833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2ffb81f9-f513-4d93-a217-12108dcc8465 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:11.958443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2ffb81f9-f513-4d93-a217-12108dcc8465 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:11.965081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ffb81f9-f513-4d93-a217-12108dcc8465 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:11.965516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ffb81f9-f513-4d93-a217-12108dcc8465 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:11.966269 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ffb81f9-f513-4d93-a217-12108dcc8465 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:11.966719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ffb81f9-f513-4d93-a217-12108dcc8465 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:12.091287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2ffb81f9-f513-4d93-a217-12108dcc8465 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:12.099338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2ffb81f9-f513-4d93-a217-12108dcc8465 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:12.100933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2ffb81f9-f513-4d93-a217-12108dcc8465 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:12.102194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2ffb81f9-f513-4d93-a217-12108dcc8465 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.148050 Nov 02 23:15:12.102970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 710/1285] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:11 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:12.107814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a40f9f15-f298-4d32-af50-bb6136e1f2ed tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:12.108821 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a40f9f15-f298-4d32-af50-bb6136e1f2ed tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:12.114672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a40f9f15-f298-4d32-af50-bb6136e1f2ed tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:12.115173 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a40f9f15-f298-4d32-af50-bb6136e1f2ed tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:12.115943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a40f9f15-f298-4d32-af50-bb6136e1f2ed tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:12.116430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a40f9f15-f298-4d32-af50-bb6136e1f2ed tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:12.146177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a40f9f15-f298-4d32-af50-bb6136e1f2ed tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042161 Nov 02 23:15:12.146741 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 711/1286] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:12 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:12.151633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c9545fb3-047d-4fbd-a934-d9b14cfaa51c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:12.152556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c9545fb3-047d-4fbd-a934-d9b14cfaa51c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:12.158195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c9545fb3-047d-4fbd-a934-d9b14cfaa51c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:12.158645 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c9545fb3-047d-4fbd-a934-d9b14cfaa51c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:12.159499 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c9545fb3-047d-4fbd-a934-d9b14cfaa51c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:12.159968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c9545fb3-047d-4fbd-a934-d9b14cfaa51c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:12.187971 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c9545fb3-047d-4fbd-a934-d9b14cfaa51c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040250 Nov 02 23:15:12.188510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 712/1287] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:12 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:13.121307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4f2f5bd6-a258-4082-996c-0d27b71a017d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:13.122001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4f2f5bd6-a258-4082-996c-0d27b71a017d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:13.128119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f2f5bd6-a258-4082-996c-0d27b71a017d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:13.128555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f2f5bd6-a258-4082-996c-0d27b71a017d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:13.129309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f2f5bd6-a258-4082-996c-0d27b71a017d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:13.129734 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f2f5bd6-a258-4082-996c-0d27b71a017d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:13.259350 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4f2f5bd6-a258-4082-996c-0d27b71a017d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:13.267375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4f2f5bd6-a258-4082-996c-0d27b71a017d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:13.268843 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4f2f5bd6-a258-4082-996c-0d27b71a017d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:13.269968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4f2f5bd6-a258-4082-996c-0d27b71a017d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.152402 Nov 02 23:15:13.270515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 713/1288] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:13 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:13.274721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-be48ba9c-9439-4f75-8aca-dafd5f99ad23 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:13.276140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-be48ba9c-9439-4f75-8aca-dafd5f99ad23 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:13.281431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be48ba9c-9439-4f75-8aca-dafd5f99ad23 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:13.281868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be48ba9c-9439-4f75-8aca-dafd5f99ad23 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:13.282623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be48ba9c-9439-4f75-8aca-dafd5f99ad23 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:13.283077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be48ba9c-9439-4f75-8aca-dafd5f99ad23 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:13.313388 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-be48ba9c-9439-4f75-8aca-dafd5f99ad23 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041530 Nov 02 23:15:13.314382 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 714/1289] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:13 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:13.319794 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fd471770-58b8-4cff-873f-c236ec294f55 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:13.320700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fd471770-58b8-4cff-873f-c236ec294f55 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:13.326240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd471770-58b8-4cff-873f-c236ec294f55 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:13.326679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd471770-58b8-4cff-873f-c236ec294f55 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:13.327752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd471770-58b8-4cff-873f-c236ec294f55 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:13.328180 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd471770-58b8-4cff-873f-c236ec294f55 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:13.356659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fd471770-58b8-4cff-873f-c236ec294f55 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040860 Nov 02 23:15:13.357191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 715/1290] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:13 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:14.288383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b54705e1-c071-43f1-8fb4-165fdbdb6ec5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:14.289068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b54705e1-c071-43f1-8fb4-165fdbdb6ec5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:14.295572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b54705e1-c071-43f1-8fb4-165fdbdb6ec5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:14.296014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b54705e1-c071-43f1-8fb4-165fdbdb6ec5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:14.296795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b54705e1-c071-43f1-8fb4-165fdbdb6ec5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:14.297222 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b54705e1-c071-43f1-8fb4-165fdbdb6ec5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:14.439095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b54705e1-c071-43f1-8fb4-165fdbdb6ec5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:14.448321 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b54705e1-c071-43f1-8fb4-165fdbdb6ec5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:14.449792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b54705e1-c071-43f1-8fb4-165fdbdb6ec5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:14.451009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b54705e1-c071-43f1-8fb4-165fdbdb6ec5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.166304 Nov 02 23:15:14.451571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 716/1291] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:14 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:14.456282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c39fa979-dd08-4a8c-acdf-384fa5eecd6e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:14.457208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c39fa979-dd08-4a8c-acdf-384fa5eecd6e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:14.467480 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c39fa979-dd08-4a8c-acdf-384fa5eecd6e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:14.468239 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c39fa979-dd08-4a8c-acdf-384fa5eecd6e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:14.469599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c39fa979-dd08-4a8c-acdf-384fa5eecd6e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:14.470358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c39fa979-dd08-4a8c-acdf-384fa5eecd6e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:14.505104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c39fa979-dd08-4a8c-acdf-384fa5eecd6e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052189 Nov 02 23:15:14.505701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 717/1292] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:14 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:14.511326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fd851f01-2a02-404d-bcbc-ba6bec6a5a08 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:14.512386 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fd851f01-2a02-404d-bcbc-ba6bec6a5a08 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:14.518887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd851f01-2a02-404d-bcbc-ba6bec6a5a08 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:14.519369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd851f01-2a02-404d-bcbc-ba6bec6a5a08 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:14.520151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd851f01-2a02-404d-bcbc-ba6bec6a5a08 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:14.520579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd851f01-2a02-404d-bcbc-ba6bec6a5a08 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:14.551202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fd851f01-2a02-404d-bcbc-ba6bec6a5a08 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044371 Nov 02 23:15:14.551779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 718/1293] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:14 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:15.470785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-abb8cd55-7f7d-49a0-bfd7-0200f6f5d692 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:15.471555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-abb8cd55-7f7d-49a0-bfd7-0200f6f5d692 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:15.477858 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-abb8cd55-7f7d-49a0-bfd7-0200f6f5d692 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:15.478300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-abb8cd55-7f7d-49a0-bfd7-0200f6f5d692 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:15.479105 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-abb8cd55-7f7d-49a0-bfd7-0200f6f5d692 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:15.479527 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-abb8cd55-7f7d-49a0-bfd7-0200f6f5d692 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:15.624535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-abb8cd55-7f7d-49a0-bfd7-0200f6f5d692 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:15.635602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-abb8cd55-7f7d-49a0-bfd7-0200f6f5d692 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:15.637680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-abb8cd55-7f7d-49a0-bfd7-0200f6f5d692 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:15.638862 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-abb8cd55-7f7d-49a0-bfd7-0200f6f5d692 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.171862 Nov 02 23:15:15.639461 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 719/1294] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:15 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:15.644157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7e2ecc3f-d2f6-4ee9-96b4-58f1bdca1dfc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:15.645082 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7e2ecc3f-d2f6-4ee9-96b4-58f1bdca1dfc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:15.651316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7e2ecc3f-d2f6-4ee9-96b4-58f1bdca1dfc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:15.651845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7e2ecc3f-d2f6-4ee9-96b4-58f1bdca1dfc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:15.654228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7e2ecc3f-d2f6-4ee9-96b4-58f1bdca1dfc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:15.654228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7e2ecc3f-d2f6-4ee9-96b4-58f1bdca1dfc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:15.686818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7e2ecc3f-d2f6-4ee9-96b4-58f1bdca1dfc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046296 Nov 02 23:15:15.687532 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 720/1295] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:15 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:15.692392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-697e46e0-7391-40c9-9899-239be4eda70a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:15.693422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-697e46e0-7391-40c9-9899-239be4eda70a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:15.699972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-697e46e0-7391-40c9-9899-239be4eda70a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:15.700687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-697e46e0-7391-40c9-9899-239be4eda70a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:15.701098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-697e46e0-7391-40c9-9899-239be4eda70a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:15.701525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-697e46e0-7391-40c9-9899-239be4eda70a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:15.732493 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-697e46e0-7391-40c9-9899-239be4eda70a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043723 Nov 02 23:15:15.732981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 721/1296] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:15 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:16.668839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6c27ef6e-39e6-4c97-b2d9-63042f5518e2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:16.669509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6c27ef6e-39e6-4c97-b2d9-63042f5518e2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:16.675826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c27ef6e-39e6-4c97-b2d9-63042f5518e2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:16.676264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c27ef6e-39e6-4c97-b2d9-63042f5518e2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:16.677041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c27ef6e-39e6-4c97-b2d9-63042f5518e2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:16.677469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c27ef6e-39e6-4c97-b2d9-63042f5518e2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:16.821266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6c27ef6e-39e6-4c97-b2d9-63042f5518e2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:16.829912 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6c27ef6e-39e6-4c97-b2d9-63042f5518e2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:16.831407 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6c27ef6e-39e6-4c97-b2d9-63042f5518e2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:16.832559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6c27ef6e-39e6-4c97-b2d9-63042f5518e2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.168148 Nov 02 23:15:16.833112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 722/1297] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:16 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:16.837573 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-100a1db1-9131-4bcb-9446-dcabf4fe43fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:16.839263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-100a1db1-9131-4bcb-9446-dcabf4fe43fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:16.846017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-100a1db1-9131-4bcb-9446-dcabf4fe43fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:16.846458 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-100a1db1-9131-4bcb-9446-dcabf4fe43fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:16.847317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-100a1db1-9131-4bcb-9446-dcabf4fe43fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:16.847744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-100a1db1-9131-4bcb-9446-dcabf4fe43fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:16.894439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-100a1db1-9131-4bcb-9446-dcabf4fe43fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059976 Nov 02 23:15:16.895512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 723/1298] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:16 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:16.902049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-681dea60-d695-45bd-adbd-07e5478de95b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:16.903161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-681dea60-d695-45bd-adbd-07e5478de95b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:16.913095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-681dea60-d695-45bd-adbd-07e5478de95b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:16.913680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-681dea60-d695-45bd-adbd-07e5478de95b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:16.915015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-681dea60-d695-45bd-adbd-07e5478de95b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:16.915706 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-681dea60-d695-45bd-adbd-07e5478de95b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:16.964112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-681dea60-d695-45bd-adbd-07e5478de95b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066710 Nov 02 23:15:16.964724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 724/1299] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:16 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:17.853395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-25dc5e02-c873-4ed5-ae11-1c1c8311bdab tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:17.854902 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-25dc5e02-c873-4ed5-ae11-1c1c8311bdab tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:17.861309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25dc5e02-c873-4ed5-ae11-1c1c8311bdab tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:17.861751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25dc5e02-c873-4ed5-ae11-1c1c8311bdab tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:17.862608 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25dc5e02-c873-4ed5-ae11-1c1c8311bdab tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:17.863077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25dc5e02-c873-4ed5-ae11-1c1c8311bdab tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:18.036469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-25dc5e02-c873-4ed5-ae11-1c1c8311bdab tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:18.046091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-25dc5e02-c873-4ed5-ae11-1c1c8311bdab tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:18.047750 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-25dc5e02-c873-4ed5-ae11-1c1c8311bdab tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:18.048977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-25dc5e02-c873-4ed5-ae11-1c1c8311bdab tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.199573 Nov 02 23:15:18.049580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 725/1300] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:17 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:18.055196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-380350a8-0574-4a3f-8723-6978b4542e22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:18.056128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-380350a8-0574-4a3f-8723-6978b4542e22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:18.063032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-380350a8-0574-4a3f-8723-6978b4542e22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:18.063505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-380350a8-0574-4a3f-8723-6978b4542e22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:18.064274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-380350a8-0574-4a3f-8723-6978b4542e22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:18.064696 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-380350a8-0574-4a3f-8723-6978b4542e22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:18.098483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-380350a8-0574-4a3f-8723-6978b4542e22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047815 Nov 02 23:15:18.099117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 726/1301] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:18 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:18.104860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d082de52-b1d6-4e78-a190-0dd5bec032aa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:18.105706 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d082de52-b1d6-4e78-a190-0dd5bec032aa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:18.112365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d082de52-b1d6-4e78-a190-0dd5bec032aa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:18.112808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d082de52-b1d6-4e78-a190-0dd5bec032aa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:18.113598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d082de52-b1d6-4e78-a190-0dd5bec032aa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:18.114026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d082de52-b1d6-4e78-a190-0dd5bec032aa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:18.149450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d082de52-b1d6-4e78-a190-0dd5bec032aa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049227 Nov 02 23:15:18.150047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 727/1302] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:18 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:19.070690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-55524d51-1a68-48ec-a8a3-1f0b10cbdc60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:19.071450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-55524d51-1a68-48ec-a8a3-1f0b10cbdc60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:19.080164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55524d51-1a68-48ec-a8a3-1f0b10cbdc60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:19.080777 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55524d51-1a68-48ec-a8a3-1f0b10cbdc60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:19.081580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55524d51-1a68-48ec-a8a3-1f0b10cbdc60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:19.082004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55524d51-1a68-48ec-a8a3-1f0b10cbdc60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:19.238601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-55524d51-1a68-48ec-a8a3-1f0b10cbdc60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:19.248213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-55524d51-1a68-48ec-a8a3-1f0b10cbdc60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:19.249730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-55524d51-1a68-48ec-a8a3-1f0b10cbdc60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:19.250941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-55524d51-1a68-48ec-a8a3-1f0b10cbdc60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.184732 Nov 02 23:15:19.251541 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 728/1303] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:19 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:19.263442 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d43872ab-0d6c-4502-9a31-5276b9584021 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:19.265330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d43872ab-0d6c-4502-9a31-5276b9584021 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:19.276685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d43872ab-0d6c-4502-9a31-5276b9584021 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:19.277251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d43872ab-0d6c-4502-9a31-5276b9584021 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:19.278665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d43872ab-0d6c-4502-9a31-5276b9584021 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:19.279508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d43872ab-0d6c-4502-9a31-5276b9584021 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:19.339888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d43872ab-0d6c-4502-9a31-5276b9584021 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082966 Nov 02 23:15:19.340837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 729/1304] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:19 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:19.347673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-747c47ad-a763-4236-b13b-10dcd100c7c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:19.349230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-747c47ad-a763-4236-b13b-10dcd100c7c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:19.359785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-747c47ad-a763-4236-b13b-10dcd100c7c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:19.360591 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-747c47ad-a763-4236-b13b-10dcd100c7c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:19.361928 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-747c47ad-a763-4236-b13b-10dcd100c7c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:19.362440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-747c47ad-a763-4236-b13b-10dcd100c7c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:19.399183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-747c47ad-a763-4236-b13b-10dcd100c7c1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056782 Nov 02 23:15:19.399796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 730/1305] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:19 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:20.269737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-747faaa3-2579-413e-aecd-31cc366ac08f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:20.270394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-747faaa3-2579-413e-aecd-31cc366ac08f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:20.277017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-747faaa3-2579-413e-aecd-31cc366ac08f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:20.277461 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-747faaa3-2579-413e-aecd-31cc366ac08f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:20.278245 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-747faaa3-2579-413e-aecd-31cc366ac08f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:20.278675 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-747faaa3-2579-413e-aecd-31cc366ac08f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:20.421830 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-747faaa3-2579-413e-aecd-31cc366ac08f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:20.432956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-747faaa3-2579-413e-aecd-31cc366ac08f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:20.434982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-747faaa3-2579-413e-aecd-31cc366ac08f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:20.436406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-747faaa3-2579-413e-aecd-31cc366ac08f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.170355 Nov 02 23:15:20.436986 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 731/1306] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:20 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:20.442158 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5b7583b4-5b0a-4e9b-97a9-785f6409a883 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:20.443235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5b7583b4-5b0a-4e9b-97a9-785f6409a883 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:20.450172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b7583b4-5b0a-4e9b-97a9-785f6409a883 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:20.450746 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b7583b4-5b0a-4e9b-97a9-785f6409a883 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:20.451619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b7583b4-5b0a-4e9b-97a9-785f6409a883 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:20.452312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b7583b4-5b0a-4e9b-97a9-785f6409a883 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:20.486871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5b7583b4-5b0a-4e9b-97a9-785f6409a883 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048766 Nov 02 23:15:20.487574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 732/1307] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:20 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:20.492414 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-92d7b055-2eb5-4538-8692-6f8d6249fbb7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:20.493322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-92d7b055-2eb5-4538-8692-6f8d6249fbb7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:20.499497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92d7b055-2eb5-4538-8692-6f8d6249fbb7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:20.499949 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92d7b055-2eb5-4538-8692-6f8d6249fbb7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:20.500807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92d7b055-2eb5-4538-8692-6f8d6249fbb7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:20.501263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92d7b055-2eb5-4538-8692-6f8d6249fbb7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:20.534076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-92d7b055-2eb5-4538-8692-6f8d6249fbb7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045372 Nov 02 23:15:20.534664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 733/1308] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:20 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:21.455982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a60fd93d-9a4c-4be7-be77-ed63bd6f50d7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:21.456742 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a60fd93d-9a4c-4be7-be77-ed63bd6f50d7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:21.464294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a60fd93d-9a4c-4be7-be77-ed63bd6f50d7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:21.464822 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a60fd93d-9a4c-4be7-be77-ed63bd6f50d7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:21.465658 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a60fd93d-9a4c-4be7-be77-ed63bd6f50d7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:21.466119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a60fd93d-9a4c-4be7-be77-ed63bd6f50d7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:21.651799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a60fd93d-9a4c-4be7-be77-ed63bd6f50d7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:21.661666 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a60fd93d-9a4c-4be7-be77-ed63bd6f50d7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:21.663187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a60fd93d-9a4c-4be7-be77-ed63bd6f50d7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:21.664378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a60fd93d-9a4c-4be7-be77-ed63bd6f50d7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.213004 Nov 02 23:15:21.664953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 734/1309] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:21 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:21.670892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ecda3f36-43c3-497b-b6ba-0f5ea6154142 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:21.672212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ecda3f36-43c3-497b-b6ba-0f5ea6154142 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:21.680044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ecda3f36-43c3-497b-b6ba-0f5ea6154142 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:21.680601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ecda3f36-43c3-497b-b6ba-0f5ea6154142 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:21.681466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ecda3f36-43c3-497b-b6ba-0f5ea6154142 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:21.682796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ecda3f36-43c3-497b-b6ba-0f5ea6154142 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:21.720358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ecda3f36-43c3-497b-b6ba-0f5ea6154142 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054289 Nov 02 23:15:21.720953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 735/1310] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:21 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:21.725499 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1ade463f-b1dc-42b4-b9d7-eb6e3c01f657 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:21.726430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1ade463f-b1dc-42b4-b9d7-eb6e3c01f657 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:21.733536 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ade463f-b1dc-42b4-b9d7-eb6e3c01f657 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:21.733982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ade463f-b1dc-42b4-b9d7-eb6e3c01f657 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:21.734776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ade463f-b1dc-42b4-b9d7-eb6e3c01f657 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:21.735349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ade463f-b1dc-42b4-b9d7-eb6e3c01f657 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:21.772746 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1ade463f-b1dc-42b4-b9d7-eb6e3c01f657 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050570 Nov 02 23:15:21.773352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 736/1311] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:21 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:22.685118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-13b88e05-8f5c-485a-83fc-b361fb0504a7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:22.685742 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-13b88e05-8f5c-485a-83fc-b361fb0504a7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:22.693932 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-13b88e05-8f5c-485a-83fc-b361fb0504a7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:22.694459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-13b88e05-8f5c-485a-83fc-b361fb0504a7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:22.697349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-13b88e05-8f5c-485a-83fc-b361fb0504a7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:22.697349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-13b88e05-8f5c-485a-83fc-b361fb0504a7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:22.842185 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-13b88e05-8f5c-485a-83fc-b361fb0504a7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:22.852470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-13b88e05-8f5c-485a-83fc-b361fb0504a7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:22.855539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-13b88e05-8f5c-485a-83fc-b361fb0504a7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:22.857080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-13b88e05-8f5c-485a-83fc-b361fb0504a7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.176316 Nov 02 23:15:22.857933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 737/1312] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:22 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:22.866304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d539ba28-5d2d-4eb8-bed3-02e2713d49d1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:22.867352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d539ba28-5d2d-4eb8-bed3-02e2713d49d1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:22.874450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d539ba28-5d2d-4eb8-bed3-02e2713d49d1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:22.874947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d539ba28-5d2d-4eb8-bed3-02e2713d49d1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:22.875800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d539ba28-5d2d-4eb8-bed3-02e2713d49d1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:22.876229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d539ba28-5d2d-4eb8-bed3-02e2713d49d1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:22.911578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d539ba28-5d2d-4eb8-bed3-02e2713d49d1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052272 Nov 02 23:15:22.912157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 738/1313] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:22 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:22.917282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-26098f8c-dad4-42c6-a3d2-87a5e15d2b8c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:22.918249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-26098f8c-dad4-42c6-a3d2-87a5e15d2b8c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:22.924555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26098f8c-dad4-42c6-a3d2-87a5e15d2b8c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:22.925020 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26098f8c-dad4-42c6-a3d2-87a5e15d2b8c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:22.925821 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26098f8c-dad4-42c6-a3d2-87a5e15d2b8c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:22.926274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26098f8c-dad4-42c6-a3d2-87a5e15d2b8c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:22.958791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-26098f8c-dad4-42c6-a3d2-87a5e15d2b8c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045493 Nov 02 23:15:22.959310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 739/1314] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:22 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:23.876936 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-679c1ce3-28e2-45ab-87b2-3f970764a04a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:23.877992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-679c1ce3-28e2-45ab-87b2-3f970764a04a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:23.884454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-679c1ce3-28e2-45ab-87b2-3f970764a04a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:23.885446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-679c1ce3-28e2-45ab-87b2-3f970764a04a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:23.886310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-679c1ce3-28e2-45ab-87b2-3f970764a04a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:23.886820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-679c1ce3-28e2-45ab-87b2-3f970764a04a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:24.054962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-679c1ce3-28e2-45ab-87b2-3f970764a04a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:24.065170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-679c1ce3-28e2-45ab-87b2-3f970764a04a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:24.066845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-679c1ce3-28e2-45ab-87b2-3f970764a04a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:24.068307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-679c1ce3-28e2-45ab-87b2-3f970764a04a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.195442 Nov 02 23:15:24.068860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 740/1315] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:23 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:24.074206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-adfeb40f-885c-44d3-a874-7245b3ad6219 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:24.075147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-adfeb40f-885c-44d3-a874-7245b3ad6219 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:24.081807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-adfeb40f-885c-44d3-a874-7245b3ad6219 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:24.082320 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-adfeb40f-885c-44d3-a874-7245b3ad6219 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:24.083163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-adfeb40f-885c-44d3-a874-7245b3ad6219 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:24.083670 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-adfeb40f-885c-44d3-a874-7245b3ad6219 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:24.118423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-adfeb40f-885c-44d3-a874-7245b3ad6219 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048264 Nov 02 23:15:24.119539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 741/1316] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:24 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:24.124043 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5ea02f34-0f73-452a-aac3-3514a1730cc9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:24.124989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5ea02f34-0f73-452a-aac3-3514a1730cc9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:24.132288 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ea02f34-0f73-452a-aac3-3514a1730cc9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:24.132704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ea02f34-0f73-452a-aac3-3514a1730cc9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:24.133646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ea02f34-0f73-452a-aac3-3514a1730cc9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:24.134126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ea02f34-0f73-452a-aac3-3514a1730cc9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:24.170801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5ea02f34-0f73-452a-aac3-3514a1730cc9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050412 Nov 02 23:15:24.171453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 742/1317] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:24 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:25.092712 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-320e44d7-a171-4b16-9daf-eff9dfbc0cdc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:25.093808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-320e44d7-a171-4b16-9daf-eff9dfbc0cdc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:25.104873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-320e44d7-a171-4b16-9daf-eff9dfbc0cdc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:25.105639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-320e44d7-a171-4b16-9daf-eff9dfbc0cdc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:25.107003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-320e44d7-a171-4b16-9daf-eff9dfbc0cdc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:25.107784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-320e44d7-a171-4b16-9daf-eff9dfbc0cdc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:25.251613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-320e44d7-a171-4b16-9daf-eff9dfbc0cdc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:25.261174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-320e44d7-a171-4b16-9daf-eff9dfbc0cdc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:25.262700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-320e44d7-a171-4b16-9daf-eff9dfbc0cdc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:25.263891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-320e44d7-a171-4b16-9daf-eff9dfbc0cdc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.178573 Nov 02 23:15:25.264445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 743/1318] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:25 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:25.269489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-77cc89a4-36d5-4dc5-a0dd-3e412e9d8041 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:25.270496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-77cc89a4-36d5-4dc5-a0dd-3e412e9d8041 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:25.276611 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-77cc89a4-36d5-4dc5-a0dd-3e412e9d8041 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:25.277053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-77cc89a4-36d5-4dc5-a0dd-3e412e9d8041 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:25.277884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-77cc89a4-36d5-4dc5-a0dd-3e412e9d8041 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:25.278262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-77cc89a4-36d5-4dc5-a0dd-3e412e9d8041 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:25.307925 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-77cc89a4-36d5-4dc5-a0dd-3e412e9d8041 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041840 Nov 02 23:15:25.308511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 744/1319] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:25 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:25.313133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-67220798-f4ff-48c2-b16e-5f180d9495eb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:25.314114 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-67220798-f4ff-48c2-b16e-5f180d9495eb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:25.320446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67220798-f4ff-48c2-b16e-5f180d9495eb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:25.320808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67220798-f4ff-48c2-b16e-5f180d9495eb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:25.321589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67220798-f4ff-48c2-b16e-5f180d9495eb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:25.322021 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67220798-f4ff-48c2-b16e-5f180d9495eb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:25.363251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-67220798-f4ff-48c2-b16e-5f180d9495eb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047688 Nov 02 23:15:25.363251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 745/1320] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:25 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:26.285945 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-977540da-896e-44f4-8330-9ec6da261a5b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:26.286618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-977540da-896e-44f4-8330-9ec6da261a5b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:26.293574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-977540da-896e-44f4-8330-9ec6da261a5b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:26.294022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-977540da-896e-44f4-8330-9ec6da261a5b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:26.294808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-977540da-896e-44f4-8330-9ec6da261a5b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:26.295284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-977540da-896e-44f4-8330-9ec6da261a5b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:26.458315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-977540da-896e-44f4-8330-9ec6da261a5b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:26.468367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-977540da-896e-44f4-8330-9ec6da261a5b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:26.469906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-977540da-896e-44f4-8330-9ec6da261a5b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:26.471158 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-977540da-896e-44f4-8330-9ec6da261a5b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.191402 Nov 02 23:15:26.471714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 746/1321] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:26 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:26.476183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-67c4487b-893a-40c2-a081-2575a4fc9e82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:26.477151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-67c4487b-893a-40c2-a081-2575a4fc9e82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:26.484000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67c4487b-893a-40c2-a081-2575a4fc9e82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:26.484440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67c4487b-893a-40c2-a081-2575a4fc9e82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:26.485205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67c4487b-893a-40c2-a081-2575a4fc9e82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:26.485702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67c4487b-893a-40c2-a081-2575a4fc9e82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:26.518386 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-67c4487b-893a-40c2-a081-2575a4fc9e82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045517 Nov 02 23:15:26.519076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 747/1322] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:26 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:26.524010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d9b59303-1266-4b08-b1c8-7929c3c6a136 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:26.524973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d9b59303-1266-4b08-b1c8-7929c3c6a136 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:26.532445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9b59303-1266-4b08-b1c8-7929c3c6a136 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:26.532886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9b59303-1266-4b08-b1c8-7929c3c6a136 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:26.533752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9b59303-1266-4b08-b1c8-7929c3c6a136 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:26.534252 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9b59303-1266-4b08-b1c8-7929c3c6a136 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:26.569677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d9b59303-1266-4b08-b1c8-7929c3c6a136 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049432 Nov 02 23:15:26.570248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 748/1323] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:26 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:27.502289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6c38ed14-392e-4ec4-90e2-587a105ea712 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:27.503237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6c38ed14-392e-4ec4-90e2-587a105ea712 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:27.512699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c38ed14-392e-4ec4-90e2-587a105ea712 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:27.513218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c38ed14-392e-4ec4-90e2-587a105ea712 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:27.514081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c38ed14-392e-4ec4-90e2-587a105ea712 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:27.514536 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c38ed14-392e-4ec4-90e2-587a105ea712 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:27.683895 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6c38ed14-392e-4ec4-90e2-587a105ea712 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:27.692202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6c38ed14-392e-4ec4-90e2-587a105ea712 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:27.693894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6c38ed14-392e-4ec4-90e2-587a105ea712 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:27.694845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6c38ed14-392e-4ec4-90e2-587a105ea712 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.200812 Nov 02 23:15:27.695567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 749/1324] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:27 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:15:27.700392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7264c76d-c4fc-4980-b93f-05e0f53fe6ec tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:27.701443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7264c76d-c4fc-4980-b93f-05e0f53fe6ec tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:27.707987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7264c76d-c4fc-4980-b93f-05e0f53fe6ec tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:27.708477 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7264c76d-c4fc-4980-b93f-05e0f53fe6ec tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:27.709321 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7264c76d-c4fc-4980-b93f-05e0f53fe6ec tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:27.709764 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7264c76d-c4fc-4980-b93f-05e0f53fe6ec tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:27.743721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7264c76d-c4fc-4980-b93f-05e0f53fe6ec tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047085 Nov 02 23:15:27.744370 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 750/1325] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:27 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:27.749662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-24e879ba-ae89-4334-b6a5-107671e04fe1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:27.750559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-24e879ba-ae89-4334-b6a5-107671e04fe1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:27.756876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24e879ba-ae89-4334-b6a5-107671e04fe1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:27.757322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24e879ba-ae89-4334-b6a5-107671e04fe1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:27.758179 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24e879ba-ae89-4334-b6a5-107671e04fe1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:27.758625 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24e879ba-ae89-4334-b6a5-107671e04fe1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:27.788063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-24e879ba-ae89-4334-b6a5-107671e04fe1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042606 Nov 02 23:15:27.788632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 751/1326] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:27 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:28.716437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6c63e9ac-b2d0-4cb1-b483-7eecb687bd39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:28.717075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6c63e9ac-b2d0-4cb1-b483-7eecb687bd39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:28.723425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c63e9ac-b2d0-4cb1-b483-7eecb687bd39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:28.723875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c63e9ac-b2d0-4cb1-b483-7eecb687bd39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:28.724653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c63e9ac-b2d0-4cb1-b483-7eecb687bd39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:28.725083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c63e9ac-b2d0-4cb1-b483-7eecb687bd39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:28.866225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6c63e9ac-b2d0-4cb1-b483-7eecb687bd39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:28.875603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6c63e9ac-b2d0-4cb1-b483-7eecb687bd39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:28.877087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6c63e9ac-b2d0-4cb1-b483-7eecb687bd39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:28.878246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6c63e9ac-b2d0-4cb1-b483-7eecb687bd39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.166178 Nov 02 23:15:28.878808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 752/1327] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:28 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:28.883292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0c22be7a-f5a7-4ca1-a5b4-371158b176c9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:28.884203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0c22be7a-f5a7-4ca1-a5b4-371158b176c9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:28.890462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0c22be7a-f5a7-4ca1-a5b4-371158b176c9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:28.890905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0c22be7a-f5a7-4ca1-a5b4-371158b176c9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:28.891707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0c22be7a-f5a7-4ca1-a5b4-371158b176c9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:28.892211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0c22be7a-f5a7-4ca1-a5b4-371158b176c9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:28.922271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0c22be7a-f5a7-4ca1-a5b4-371158b176c9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042415 Nov 02 23:15:28.922836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 753/1328] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:28 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:28.928122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b019d856-71a1-46df-a5c2-a076dfd18095 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:28.929089 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b019d856-71a1-46df-a5c2-a076dfd18095 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:28.935041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b019d856-71a1-46df-a5c2-a076dfd18095 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:28.935489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b019d856-71a1-46df-a5c2-a076dfd18095 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:28.936266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b019d856-71a1-46df-a5c2-a076dfd18095 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:28.936730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b019d856-71a1-46df-a5c2-a076dfd18095 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:28.968686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b019d856-71a1-46df-a5c2-a076dfd18095 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044774 Nov 02 23:15:28.969389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 754/1329] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:28 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:29.898501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-43e7d1e2-46a7-4d1b-857f-638fbf1e9313 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:29.899222 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-43e7d1e2-46a7-4d1b-857f-638fbf1e9313 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:29.905596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-43e7d1e2-46a7-4d1b-857f-638fbf1e9313 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:29.906097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-43e7d1e2-46a7-4d1b-857f-638fbf1e9313 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:29.906884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-43e7d1e2-46a7-4d1b-857f-638fbf1e9313 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:29.907341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-43e7d1e2-46a7-4d1b-857f-638fbf1e9313 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:30.070677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-43e7d1e2-46a7-4d1b-857f-638fbf1e9313 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:30.080377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-43e7d1e2-46a7-4d1b-857f-638fbf1e9313 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:30.081856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-43e7d1e2-46a7-4d1b-857f-638fbf1e9313 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:30.083274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-43e7d1e2-46a7-4d1b-857f-638fbf1e9313 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.188631 Nov 02 23:15:30.084204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 755/1330] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:29 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:30.089794 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e74ca7a7-7dc7-41ab-8d9c-4e8cfa7f5e6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:30.090695 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e74ca7a7-7dc7-41ab-8d9c-4e8cfa7f5e6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:30.097746 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e74ca7a7-7dc7-41ab-8d9c-4e8cfa7f5e6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:30.098193 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e74ca7a7-7dc7-41ab-8d9c-4e8cfa7f5e6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:30.098999 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e74ca7a7-7dc7-41ab-8d9c-4e8cfa7f5e6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:30.099428 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e74ca7a7-7dc7-41ab-8d9c-4e8cfa7f5e6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:30.134530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e74ca7a7-7dc7-41ab-8d9c-4e8cfa7f5e6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049216 Nov 02 23:15:30.136051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 756/1331] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:30 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:30.146155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7113ad7c-fbf6-4083-8794-fe3bfb76015b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:30.147897 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7113ad7c-fbf6-4083-8794-fe3bfb76015b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:30.161110 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7113ad7c-fbf6-4083-8794-fe3bfb76015b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:30.162078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7113ad7c-fbf6-4083-8794-fe3bfb76015b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:30.163646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7113ad7c-fbf6-4083-8794-fe3bfb76015b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:30.164408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7113ad7c-fbf6-4083-8794-fe3bfb76015b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:30.202506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7113ad7c-fbf6-4083-8794-fe3bfb76015b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064587 Nov 02 23:15:30.203125 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 757/1332] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:30 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:31.106344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-02e5ca3c-4a6d-4ad0-8d1e-9060fc41ba55 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:31.107126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-02e5ca3c-4a6d-4ad0-8d1e-9060fc41ba55 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:31.114009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-02e5ca3c-4a6d-4ad0-8d1e-9060fc41ba55 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:31.114650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-02e5ca3c-4a6d-4ad0-8d1e-9060fc41ba55 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:31.115677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-02e5ca3c-4a6d-4ad0-8d1e-9060fc41ba55 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:31.116269 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-02e5ca3c-4a6d-4ad0-8d1e-9060fc41ba55 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:31.277249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-02e5ca3c-4a6d-4ad0-8d1e-9060fc41ba55 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:31.286141 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-02e5ca3c-4a6d-4ad0-8d1e-9060fc41ba55 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:31.287652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-02e5ca3c-4a6d-4ad0-8d1e-9060fc41ba55 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:31.288803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-02e5ca3c-4a6d-4ad0-8d1e-9060fc41ba55 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.187052 Nov 02 23:15:31.289359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 758/1333] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:31 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:31.294245 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c201b939-7d24-4426-ad3a-d3229a56935b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:31.295170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c201b939-7d24-4426-ad3a-d3229a56935b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:31.301312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c201b939-7d24-4426-ad3a-d3229a56935b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:31.301755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c201b939-7d24-4426-ad3a-d3229a56935b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:31.302549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c201b939-7d24-4426-ad3a-d3229a56935b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:31.302998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c201b939-7d24-4426-ad3a-d3229a56935b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:31.336729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c201b939-7d24-4426-ad3a-d3229a56935b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046265 Nov 02 23:15:31.337355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 759/1334] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:31 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:31.342624 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-57eda700-02a8-4af1-a0ed-f63225557ad2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:31.343497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-57eda700-02a8-4af1-a0ed-f63225557ad2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:31.350594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-57eda700-02a8-4af1-a0ed-f63225557ad2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:31.351115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-57eda700-02a8-4af1-a0ed-f63225557ad2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:31.352031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-57eda700-02a8-4af1-a0ed-f63225557ad2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:31.352461 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-57eda700-02a8-4af1-a0ed-f63225557ad2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:31.383926 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-57eda700-02a8-4af1-a0ed-f63225557ad2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044858 Nov 02 23:15:31.384545 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 760/1335] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:31 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:32.307020 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-42134099-703f-4731-86da-657356264362 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:32.308308 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-42134099-703f-4731-86da-657356264362 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:32.315151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42134099-703f-4731-86da-657356264362 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:32.315597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42134099-703f-4731-86da-657356264362 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:32.316415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42134099-703f-4731-86da-657356264362 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:32.316889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42134099-703f-4731-86da-657356264362 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:32.461752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-42134099-703f-4731-86da-657356264362 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:32.470988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-42134099-703f-4731-86da-657356264362 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:32.472484 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-42134099-703f-4731-86da-657356264362 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:32.473638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-42134099-703f-4731-86da-657356264362 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.170333 Nov 02 23:15:32.474359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 761/1336] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:32 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:32.479636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b4768658-a94f-49d1-bba7-8ce7161649cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:32.480683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b4768658-a94f-49d1-bba7-8ce7161649cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:32.487439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b4768658-a94f-49d1-bba7-8ce7161649cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:32.487886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b4768658-a94f-49d1-bba7-8ce7161649cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:32.488661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b4768658-a94f-49d1-bba7-8ce7161649cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:32.489232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b4768658-a94f-49d1-bba7-8ce7161649cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:32.520188 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b4768658-a94f-49d1-bba7-8ce7161649cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044562 Nov 02 23:15:32.520774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 762/1337] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:32 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:32.526110 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5bc14e9f-96e7-4241-95de-d3d618700bb0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:32.527220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5bc14e9f-96e7-4241-95de-d3d618700bb0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:32.533559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5bc14e9f-96e7-4241-95de-d3d618700bb0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:32.534006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5bc14e9f-96e7-4241-95de-d3d618700bb0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:32.534786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5bc14e9f-96e7-4241-95de-d3d618700bb0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:32.535253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5bc14e9f-96e7-4241-95de-d3d618700bb0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:32.569788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5bc14e9f-96e7-4241-95de-d3d618700bb0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047871 Nov 02 23:15:32.570432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 763/1338] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:32 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:33.493898 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-987aab3b-2cef-4781-b6d8-41550cd70c7c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:33.494607 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-987aab3b-2cef-4781-b6d8-41550cd70c7c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:33.501149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-987aab3b-2cef-4781-b6d8-41550cd70c7c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:33.501601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-987aab3b-2cef-4781-b6d8-41550cd70c7c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:33.502386 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-987aab3b-2cef-4781-b6d8-41550cd70c7c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:33.502823 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-987aab3b-2cef-4781-b6d8-41550cd70c7c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:33.648201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-987aab3b-2cef-4781-b6d8-41550cd70c7c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:33.657492 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-987aab3b-2cef-4781-b6d8-41550cd70c7c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:33.659061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-987aab3b-2cef-4781-b6d8-41550cd70c7c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:33.660215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-987aab3b-2cef-4781-b6d8-41550cd70c7c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.170202 Nov 02 23:15:33.660771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 764/1339] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:33 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:33.665476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b044b690-c387-4c93-828e-dde79260f406 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:33.666467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b044b690-c387-4c93-828e-dde79260f406 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:33.674991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b044b690-c387-4c93-828e-dde79260f406 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:33.675477 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b044b690-c387-4c93-828e-dde79260f406 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:33.676283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b044b690-c387-4c93-828e-dde79260f406 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:33.676707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b044b690-c387-4c93-828e-dde79260f406 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:33.709683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b044b690-c387-4c93-828e-dde79260f406 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047861 Nov 02 23:15:33.710258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 765/1340] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:33 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:33.715740 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-94a24c00-b02c-4dce-85a6-becefeb577cf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:33.716725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-94a24c00-b02c-4dce-85a6-becefeb577cf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:33.723506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94a24c00-b02c-4dce-85a6-becefeb577cf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:33.723990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94a24c00-b02c-4dce-85a6-becefeb577cf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:33.724799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94a24c00-b02c-4dce-85a6-becefeb577cf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:33.725270 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94a24c00-b02c-4dce-85a6-becefeb577cf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:33.760684 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-94a24c00-b02c-4dce-85a6-becefeb577cf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048553 Nov 02 23:15:33.760955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 766/1341] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:33 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:34.677857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c6fcf4ec-6343-4fe8-929a-c4a8be298e03 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:34.678530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c6fcf4ec-6343-4fe8-929a-c4a8be298e03 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:34.686510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6fcf4ec-6343-4fe8-929a-c4a8be298e03 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:34.686977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6fcf4ec-6343-4fe8-929a-c4a8be298e03 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:34.687749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6fcf4ec-6343-4fe8-929a-c4a8be298e03 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:34.688175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6fcf4ec-6343-4fe8-929a-c4a8be298e03 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:34.847446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c6fcf4ec-6343-4fe8-929a-c4a8be298e03 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:34.859098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c6fcf4ec-6343-4fe8-929a-c4a8be298e03 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:34.860937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c6fcf4ec-6343-4fe8-929a-c4a8be298e03 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:34.862276 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c6fcf4ec-6343-4fe8-929a-c4a8be298e03 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.188175 Nov 02 23:15:34.873745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 767/1342] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:34 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:34.873745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c5001296-f0c3-4e03-8daa-657950b7f221 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:34.873745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c5001296-f0c3-4e03-8daa-657950b7f221 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:34.879335 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c5001296-f0c3-4e03-8daa-657950b7f221 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:34.880069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c5001296-f0c3-4e03-8daa-657950b7f221 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:34.881209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c5001296-f0c3-4e03-8daa-657950b7f221 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:34.881647 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c5001296-f0c3-4e03-8daa-657950b7f221 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:34.923905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c5001296-f0c3-4e03-8daa-657950b7f221 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059470 Nov 02 23:15:34.924441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 768/1343] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:34 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:34.929432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cf9b886a-36de-4659-a86b-09a7a5d2a9cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:34.930522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cf9b886a-36de-4659-a86b-09a7a5d2a9cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:34.936988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf9b886a-36de-4659-a86b-09a7a5d2a9cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:34.937503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf9b886a-36de-4659-a86b-09a7a5d2a9cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:34.938326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf9b886a-36de-4659-a86b-09a7a5d2a9cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:34.938833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf9b886a-36de-4659-a86b-09a7a5d2a9cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:34.973002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cf9b886a-36de-4659-a86b-09a7a5d2a9cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047446 Nov 02 23:15:34.973651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 769/1344] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:34 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:35.881104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-04b680a3-a6dc-492a-86a0-dcff91564896 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:35.881705 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-04b680a3-a6dc-492a-86a0-dcff91564896 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:35.889270 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-04b680a3-a6dc-492a-86a0-dcff91564896 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:35.889715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-04b680a3-a6dc-492a-86a0-dcff91564896 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:35.890557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-04b680a3-a6dc-492a-86a0-dcff91564896 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:35.891054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-04b680a3-a6dc-492a-86a0-dcff91564896 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:36.064812 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-04b680a3-a6dc-492a-86a0-dcff91564896 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:36.074333 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-04b680a3-a6dc-492a-86a0-dcff91564896 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:36.076051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-04b680a3-a6dc-492a-86a0-dcff91564896 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:36.077558 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-04b680a3-a6dc-492a-86a0-dcff91564896 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.200214 Nov 02 23:15:36.078124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 770/1345] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:35 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:36.082913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e1adbf20-edde-434b-9472-e1dfd46ea041 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:36.083882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e1adbf20-edde-434b-9472-e1dfd46ea041 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:36.090894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e1adbf20-edde-434b-9472-e1dfd46ea041 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:36.091402 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e1adbf20-edde-434b-9472-e1dfd46ea041 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:36.092225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e1adbf20-edde-434b-9472-e1dfd46ea041 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:36.092700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e1adbf20-edde-434b-9472-e1dfd46ea041 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:36.135417 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e1adbf20-edde-434b-9472-e1dfd46ea041 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055615 Nov 02 23:15:36.136358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 771/1346] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:36 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:36.141285 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-767bf736-d494-48d3-baac-41041dec0ade tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:36.142225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-767bf736-d494-48d3-baac-41041dec0ade tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:36.148649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-767bf736-d494-48d3-baac-41041dec0ade tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:36.149167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-767bf736-d494-48d3-baac-41041dec0ade tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:36.149972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-767bf736-d494-48d3-baac-41041dec0ade tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:36.151119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-767bf736-d494-48d3-baac-41041dec0ade tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:36.184678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-767bf736-d494-48d3-baac-41041dec0ade tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047221 Nov 02 23:15:36.185389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 772/1347] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:36 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:37.097254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a251c6bf-43e3-4a35-b827-4ba9bcd0f71c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:37.097937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a251c6bf-43e3-4a35-b827-4ba9bcd0f71c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:37.105098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a251c6bf-43e3-4a35-b827-4ba9bcd0f71c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:37.105536 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a251c6bf-43e3-4a35-b827-4ba9bcd0f71c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:37.106323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a251c6bf-43e3-4a35-b827-4ba9bcd0f71c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:37.106749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a251c6bf-43e3-4a35-b827-4ba9bcd0f71c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:37.248120 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a251c6bf-43e3-4a35-b827-4ba9bcd0f71c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:37.257409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a251c6bf-43e3-4a35-b827-4ba9bcd0f71c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:37.258877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a251c6bf-43e3-4a35-b827-4ba9bcd0f71c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:37.260090 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a251c6bf-43e3-4a35-b827-4ba9bcd0f71c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.167392 Nov 02 23:15:37.260756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 773/1348] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:37 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:37.265159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b307deaf-e0ce-4d0d-91b7-e2f833fbc803 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:37.266066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b307deaf-e0ce-4d0d-91b7-e2f833fbc803 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:37.273973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b307deaf-e0ce-4d0d-91b7-e2f833fbc803 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:37.274582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b307deaf-e0ce-4d0d-91b7-e2f833fbc803 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:37.276197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b307deaf-e0ce-4d0d-91b7-e2f833fbc803 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:37.276641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b307deaf-e0ce-4d0d-91b7-e2f833fbc803 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:37.308421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b307deaf-e0ce-4d0d-91b7-e2f833fbc803 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046532 Nov 02 23:15:37.308992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 774/1349] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:37 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:37.313699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5e15795a-3ca0-4d2c-b580-4b6671ea8700 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:37.314714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5e15795a-3ca0-4d2c-b580-4b6671ea8700 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:37.321115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5e15795a-3ca0-4d2c-b580-4b6671ea8700 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:37.321613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5e15795a-3ca0-4d2c-b580-4b6671ea8700 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:37.322390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5e15795a-3ca0-4d2c-b580-4b6671ea8700 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:37.322824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5e15795a-3ca0-4d2c-b580-4b6671ea8700 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:37.354761 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5e15795a-3ca0-4d2c-b580-4b6671ea8700 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044705 Nov 02 23:15:37.355347 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 775/1350] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:37 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:38.278929 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2a83c3d8-d8c9-4259-881f-e23442c37aca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:38.279630 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2a83c3d8-d8c9-4259-881f-e23442c37aca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:38.286244 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a83c3d8-d8c9-4259-881f-e23442c37aca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:38.286684 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a83c3d8-d8c9-4259-881f-e23442c37aca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:38.287487 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a83c3d8-d8c9-4259-881f-e23442c37aca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:38.287913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a83c3d8-d8c9-4259-881f-e23442c37aca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:38.423036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2a83c3d8-d8c9-4259-881f-e23442c37aca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:38.431249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2a83c3d8-d8c9-4259-881f-e23442c37aca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:38.433290 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2a83c3d8-d8c9-4259-881f-e23442c37aca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:38.434434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2a83c3d8-d8c9-4259-881f-e23442c37aca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.159324 Nov 02 23:15:38.435006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 776/1351] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:38 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:38.439445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-38046793-dabe-41fc-ad6b-7cf25a19bb54 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:38.440344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-38046793-dabe-41fc-ad6b-7cf25a19bb54 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:38.445952 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-38046793-dabe-41fc-ad6b-7cf25a19bb54 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:38.446391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-38046793-dabe-41fc-ad6b-7cf25a19bb54 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:38.447191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-38046793-dabe-41fc-ad6b-7cf25a19bb54 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:38.447619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-38046793-dabe-41fc-ad6b-7cf25a19bb54 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:38.476369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-38046793-dabe-41fc-ad6b-7cf25a19bb54 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040255 Nov 02 23:15:38.476913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 777/1352] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:38 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:38.481350 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-98a2a1cf-9b4a-48b1-878f-5f47e4b64898 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:38.482226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-98a2a1cf-9b4a-48b1-878f-5f47e4b64898 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:38.487755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98a2a1cf-9b4a-48b1-878f-5f47e4b64898 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:38.488193 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98a2a1cf-9b4a-48b1-878f-5f47e4b64898 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:38.488949 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98a2a1cf-9b4a-48b1-878f-5f47e4b64898 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:38.489424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98a2a1cf-9b4a-48b1-878f-5f47e4b64898 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:38.518344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-98a2a1cf-9b4a-48b1-878f-5f47e4b64898 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040411 Nov 02 23:15:38.518882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 778/1353] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:38 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:39.454116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9b4dd921-fab2-4ef6-aaec-351617c050c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:39.454780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9b4dd921-fab2-4ef6-aaec-351617c050c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:39.461087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9b4dd921-fab2-4ef6-aaec-351617c050c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:39.461528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9b4dd921-fab2-4ef6-aaec-351617c050c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:39.462325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9b4dd921-fab2-4ef6-aaec-351617c050c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:39.462749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9b4dd921-fab2-4ef6-aaec-351617c050c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:39.596302 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9b4dd921-fab2-4ef6-aaec-351617c050c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:39.604954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9b4dd921-fab2-4ef6-aaec-351617c050c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:39.606436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9b4dd921-fab2-4ef6-aaec-351617c050c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:39.607619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9b4dd921-fab2-4ef6-aaec-351617c050c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.157546 Nov 02 23:15:39.608170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 779/1354] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:39 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:39.612583 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-eeae7db8-9a87-4948-857b-bb75efb1453f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:39.613472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-eeae7db8-9a87-4948-857b-bb75efb1453f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:39.619989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eeae7db8-9a87-4948-857b-bb75efb1453f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:39.620429 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eeae7db8-9a87-4948-857b-bb75efb1453f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:39.621191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eeae7db8-9a87-4948-857b-bb75efb1453f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:39.621617 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eeae7db8-9a87-4948-857b-bb75efb1453f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:39.650030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-eeae7db8-9a87-4948-857b-bb75efb1453f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040835 Nov 02 23:15:39.650587 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 780/1355] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:39 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:39.655094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4a6cb4e9-52a6-44b0-b435-15721a41ee6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:39.655975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4a6cb4e9-52a6-44b0-b435-15721a41ee6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:39.661619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a6cb4e9-52a6-44b0-b435-15721a41ee6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:39.662057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a6cb4e9-52a6-44b0-b435-15721a41ee6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:39.662817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a6cb4e9-52a6-44b0-b435-15721a41ee6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:39.663266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a6cb4e9-52a6-44b0-b435-15721a41ee6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:39.694446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4a6cb4e9-52a6-44b0-b435-15721a41ee6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042674 Nov 02 23:15:39.695065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 781/1356] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:39 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:40.626895 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b893e05c-b777-4131-b4ab-afd9e571e9d1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:40.627593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b893e05c-b777-4131-b4ab-afd9e571e9d1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:40.633726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b893e05c-b777-4131-b4ab-afd9e571e9d1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:40.634169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b893e05c-b777-4131-b4ab-afd9e571e9d1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:40.634964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b893e05c-b777-4131-b4ab-afd9e571e9d1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:40.635398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b893e05c-b777-4131-b4ab-afd9e571e9d1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:40.762897 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b893e05c-b777-4131-b4ab-afd9e571e9d1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:40.771106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b893e05c-b777-4131-b4ab-afd9e571e9d1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:40.772597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b893e05c-b777-4131-b4ab-afd9e571e9d1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:40.773749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b893e05c-b777-4131-b4ab-afd9e571e9d1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.150635 Nov 02 23:15:40.774305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 782/1357] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:40 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:40.779310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ce6de039-008f-434f-8465-1fb603bece61 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:40.780210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ce6de039-008f-434f-8465-1fb603bece61 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:40.785881 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce6de039-008f-434f-8465-1fb603bece61 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:40.786327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce6de039-008f-434f-8465-1fb603bece61 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:40.787136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce6de039-008f-434f-8465-1fb603bece61 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:40.787571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce6de039-008f-434f-8465-1fb603bece61 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:40.816322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ce6de039-008f-434f-8465-1fb603bece61 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040997 Nov 02 23:15:40.816876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 783/1358] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:40 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:40.821198 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-67a5b72a-54c0-436e-bf68-e56446293938 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:40.822115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-67a5b72a-54c0-436e-bf68-e56446293938 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:40.828013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67a5b72a-54c0-436e-bf68-e56446293938 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:40.828459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67a5b72a-54c0-436e-bf68-e56446293938 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:40.829229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67a5b72a-54c0-436e-bf68-e56446293938 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:40.829656 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67a5b72a-54c0-436e-bf68-e56446293938 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:40.860414 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-67a5b72a-54c0-436e-bf68-e56446293938 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042396 Nov 02 23:15:40.861055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 784/1359] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:40 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:41.793879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-73fce322-4c02-49e2-8a46-fa4da81302aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:41.794571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-73fce322-4c02-49e2-8a46-fa4da81302aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:41.800734 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73fce322-4c02-49e2-8a46-fa4da81302aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:41.801177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73fce322-4c02-49e2-8a46-fa4da81302aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:41.801938 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73fce322-4c02-49e2-8a46-fa4da81302aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:41.802363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73fce322-4c02-49e2-8a46-fa4da81302aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:41.955913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-73fce322-4c02-49e2-8a46-fa4da81302aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:41.964636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-73fce322-4c02-49e2-8a46-fa4da81302aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:41.966107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-73fce322-4c02-49e2-8a46-fa4da81302aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:41.967276 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-73fce322-4c02-49e2-8a46-fa4da81302aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.177677 Nov 02 23:15:41.967833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 785/1360] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:41 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:41.972138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-06175efe-9b36-4048-9717-d104ac8e9bc5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:41.973025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-06175efe-9b36-4048-9717-d104ac8e9bc5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:41.978873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06175efe-9b36-4048-9717-d104ac8e9bc5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:41.979359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06175efe-9b36-4048-9717-d104ac8e9bc5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:41.980173 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06175efe-9b36-4048-9717-d104ac8e9bc5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:41.980602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06175efe-9b36-4048-9717-d104ac8e9bc5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:42.009138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-06175efe-9b36-4048-9717-d104ac8e9bc5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040272 Nov 02 23:15:42.010200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 786/1361] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:41 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:42.014537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-336072b0-3ea6-45a1-806b-d9a1ba052ed5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:42.015468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-336072b0-3ea6-45a1-806b-d9a1ba052ed5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:42.021091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-336072b0-3ea6-45a1-806b-d9a1ba052ed5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:42.021533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-336072b0-3ea6-45a1-806b-d9a1ba052ed5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:42.022314 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-336072b0-3ea6-45a1-806b-d9a1ba052ed5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:42.022721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-336072b0-3ea6-45a1-806b-d9a1ba052ed5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:42.055032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-336072b0-3ea6-45a1-806b-d9a1ba052ed5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043709 Nov 02 23:15:42.055537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 787/1362] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:42 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:42.985251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ea68df6f-efc0-4ffe-a3db-5f8df531da5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:42.985888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ea68df6f-efc0-4ffe-a3db-5f8df531da5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:42.992129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea68df6f-efc0-4ffe-a3db-5f8df531da5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:42.992568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea68df6f-efc0-4ffe-a3db-5f8df531da5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:42.993324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea68df6f-efc0-4ffe-a3db-5f8df531da5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:42.993797 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea68df6f-efc0-4ffe-a3db-5f8df531da5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:43.124787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ea68df6f-efc0-4ffe-a3db-5f8df531da5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:43.133094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ea68df6f-efc0-4ffe-a3db-5f8df531da5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:43.134578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ea68df6f-efc0-4ffe-a3db-5f8df531da5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:43.135760 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ea68df6f-efc0-4ffe-a3db-5f8df531da5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.154244 Nov 02 23:15:43.136313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 788/1363] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:42 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:43.140664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e099917f-03d1-454b-8612-4c47f3ac8d37 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:43.141561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e099917f-03d1-454b-8612-4c47f3ac8d37 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:43.147317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e099917f-03d1-454b-8612-4c47f3ac8d37 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:43.147757 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e099917f-03d1-454b-8612-4c47f3ac8d37 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:43.148520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e099917f-03d1-454b-8612-4c47f3ac8d37 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:43.148945 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e099917f-03d1-454b-8612-4c47f3ac8d37 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:43.177788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e099917f-03d1-454b-8612-4c47f3ac8d37 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040487 Nov 02 23:15:43.178335 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 789/1364] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:43 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:43.182658 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e94c79d8-8fd0-4a87-8398-89ceb93a0609 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:43.183580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e94c79d8-8fd0-4a87-8398-89ceb93a0609 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:43.188964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e94c79d8-8fd0-4a87-8398-89ceb93a0609 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:43.189406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e94c79d8-8fd0-4a87-8398-89ceb93a0609 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:43.190198 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e94c79d8-8fd0-4a87-8398-89ceb93a0609 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:43.190625 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e94c79d8-8fd0-4a87-8398-89ceb93a0609 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:43.219888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e94c79d8-8fd0-4a87-8398-89ceb93a0609 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040540 Nov 02 23:15:43.220458 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 790/1365] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:43 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:44.161921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-45dc7c63-dc5e-4544-93ac-89889e4615b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:44.162616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-45dc7c63-dc5e-4544-93ac-89889e4615b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:44.169426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45dc7c63-dc5e-4544-93ac-89889e4615b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:44.169873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45dc7c63-dc5e-4544-93ac-89889e4615b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:44.170640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45dc7c63-dc5e-4544-93ac-89889e4615b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:44.171106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45dc7c63-dc5e-4544-93ac-89889e4615b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:44.300232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-45dc7c63-dc5e-4544-93ac-89889e4615b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:44.311219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-45dc7c63-dc5e-4544-93ac-89889e4615b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:44.313025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-45dc7c63-dc5e-4544-93ac-89889e4615b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:44.314385 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-45dc7c63-dc5e-4544-93ac-89889e4615b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.156124 Nov 02 23:15:44.315083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 791/1366] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:44 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:44.319875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-48058c33-03f2-4555-a8ba-d16e7f71adfb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:44.320965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-48058c33-03f2-4555-a8ba-d16e7f71adfb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:44.331309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48058c33-03f2-4555-a8ba-d16e7f71adfb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:44.331753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48058c33-03f2-4555-a8ba-d16e7f71adfb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:44.332552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48058c33-03f2-4555-a8ba-d16e7f71adfb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:44.333006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48058c33-03f2-4555-a8ba-d16e7f71adfb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:44.364359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-48058c33-03f2-4555-a8ba-d16e7f71adfb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048140 Nov 02 23:15:44.364954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 792/1367] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:44 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:44.370163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c6df53c6-2e14-49d5-83e9-01188f75c943 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:44.371107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c6df53c6-2e14-49d5-83e9-01188f75c943 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:44.377294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6df53c6-2e14-49d5-83e9-01188f75c943 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:44.377729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6df53c6-2e14-49d5-83e9-01188f75c943 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:44.378506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6df53c6-2e14-49d5-83e9-01188f75c943 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:44.378946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6df53c6-2e14-49d5-83e9-01188f75c943 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:44.407366 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c6df53c6-2e14-49d5-83e9-01188f75c943 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041332 Nov 02 23:15:44.407923 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 793/1368] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:44 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:45.332983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b2754748-6ff6-43d7-9b37-d051f7c5cad4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:45.333819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b2754748-6ff6-43d7-9b37-d051f7c5cad4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:45.340787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b2754748-6ff6-43d7-9b37-d051f7c5cad4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:45.341167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b2754748-6ff6-43d7-9b37-d051f7c5cad4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:45.341952 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b2754748-6ff6-43d7-9b37-d051f7c5cad4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:45.342469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b2754748-6ff6-43d7-9b37-d051f7c5cad4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:45.483213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b2754748-6ff6-43d7-9b37-d051f7c5cad4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:45.491482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b2754748-6ff6-43d7-9b37-d051f7c5cad4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:45.492989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b2754748-6ff6-43d7-9b37-d051f7c5cad4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:45.494685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b2754748-6ff6-43d7-9b37-d051f7c5cad4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.165754 Nov 02 23:15:45.495277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 794/1369] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:45 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:45.499677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a904b666-1e28-4c53-aacc-33e5a1079f89 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:45.500582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a904b666-1e28-4c53-aacc-33e5a1079f89 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:45.506430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a904b666-1e28-4c53-aacc-33e5a1079f89 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:45.506904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a904b666-1e28-4c53-aacc-33e5a1079f89 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:45.507705 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a904b666-1e28-4c53-aacc-33e5a1079f89 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:45.508131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a904b666-1e28-4c53-aacc-33e5a1079f89 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:45.536842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a904b666-1e28-4c53-aacc-33e5a1079f89 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040550 Nov 02 23:15:45.537432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 795/1370] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:45 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:45.541705 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3646306f-e4d7-4654-a584-ac9be5081faf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:45.542587 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3646306f-e4d7-4654-a584-ac9be5081faf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:45.548163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3646306f-e4d7-4654-a584-ac9be5081faf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:45.548603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3646306f-e4d7-4654-a584-ac9be5081faf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:45.549363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3646306f-e4d7-4654-a584-ac9be5081faf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:45.549786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3646306f-e4d7-4654-a584-ac9be5081faf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:45.579410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3646306f-e4d7-4654-a584-ac9be5081faf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040951 Nov 02 23:15:45.579958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 796/1371] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:45 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:46.512894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e66d639d-6539-4447-b4a8-8c5732286e01 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:46.513582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e66d639d-6539-4447-b4a8-8c5732286e01 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:46.519685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e66d639d-6539-4447-b4a8-8c5732286e01 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:46.520122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e66d639d-6539-4447-b4a8-8c5732286e01 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:46.520881 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e66d639d-6539-4447-b4a8-8c5732286e01 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:46.521304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e66d639d-6539-4447-b4a8-8c5732286e01 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:46.652892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e66d639d-6539-4447-b4a8-8c5732286e01 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:46.661266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e66d639d-6539-4447-b4a8-8c5732286e01 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:46.662751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e66d639d-6539-4447-b4a8-8c5732286e01 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:46.664079 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e66d639d-6539-4447-b4a8-8c5732286e01 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.154911 Nov 02 23:15:46.668384 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 797/1372] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:46 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:46.673303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9e849c7e-fea4-4c6b-8242-ec7fbb35ad02 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:46.674222 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9e849c7e-fea4-4c6b-8242-ec7fbb35ad02 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:46.680155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e849c7e-fea4-4c6b-8242-ec7fbb35ad02 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:46.680602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e849c7e-fea4-4c6b-8242-ec7fbb35ad02 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:46.681917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e849c7e-fea4-4c6b-8242-ec7fbb35ad02 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:46.682352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e849c7e-fea4-4c6b-8242-ec7fbb35ad02 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:46.711160 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9e849c7e-fea4-4c6b-8242-ec7fbb35ad02 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041471 Nov 02 23:15:46.711732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 798/1373] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:46 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:46.716907 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-71be38d7-25d9-4610-a789-487150b406b0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:46.717831 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-71be38d7-25d9-4610-a789-487150b406b0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:46.724133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-71be38d7-25d9-4610-a789-487150b406b0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:46.724580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-71be38d7-25d9-4610-a789-487150b406b0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:46.725368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-71be38d7-25d9-4610-a789-487150b406b0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:46.725805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-71be38d7-25d9-4610-a789-487150b406b0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:46.759721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-71be38d7-25d9-4610-a789-487150b406b0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046922 Nov 02 23:15:46.760583 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 799/1374] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:46 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:47.681320 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9a191b99-c3d1-4fc7-b923-e929ee2eaec3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:47.681939 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9a191b99-c3d1-4fc7-b923-e929ee2eaec3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:47.688078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a191b99-c3d1-4fc7-b923-e929ee2eaec3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:47.688519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a191b99-c3d1-4fc7-b923-e929ee2eaec3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:47.689272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a191b99-c3d1-4fc7-b923-e929ee2eaec3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:47.689701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a191b99-c3d1-4fc7-b923-e929ee2eaec3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:47.820393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9a191b99-c3d1-4fc7-b923-e929ee2eaec3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:47.828679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9a191b99-c3d1-4fc7-b923-e929ee2eaec3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:47.830150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9a191b99-c3d1-4fc7-b923-e929ee2eaec3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:47.831322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9a191b99-c3d1-4fc7-b923-e929ee2eaec3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.153778 Nov 02 23:15:47.831874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 800/1375] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:47 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:47.836119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5cc835a1-3485-4950-913b-ae6c6cf057f4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:47.836997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5cc835a1-3485-4950-913b-ae6c6cf057f4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:47.842900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5cc835a1-3485-4950-913b-ae6c6cf057f4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:47.843374 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5cc835a1-3485-4950-913b-ae6c6cf057f4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:47.844127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5cc835a1-3485-4950-913b-ae6c6cf057f4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:47.844553 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5cc835a1-3485-4950-913b-ae6c6cf057f4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:47.874360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5cc835a1-3485-4950-913b-ae6c6cf057f4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041460 Nov 02 23:15:47.874941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 801/1376] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:47 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:47.879249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-eabea628-3ea6-4b9b-93be-8f82a8f52c4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:47.880151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-eabea628-3ea6-4b9b-93be-8f82a8f52c4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:47.886207 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eabea628-3ea6-4b9b-93be-8f82a8f52c4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:47.886658 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eabea628-3ea6-4b9b-93be-8f82a8f52c4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:47.887461 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eabea628-3ea6-4b9b-93be-8f82a8f52c4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:47.887898 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eabea628-3ea6-4b9b-93be-8f82a8f52c4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:47.916597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-eabea628-3ea6-4b9b-93be-8f82a8f52c4c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040554 Nov 02 23:15:47.917074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 802/1377] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:47 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:48.849639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3f4bb58a-b778-4cc2-a3f4-5bc64fc47c8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:48.850266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3f4bb58a-b778-4cc2-a3f4-5bc64fc47c8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:48.857496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f4bb58a-b778-4cc2-a3f4-5bc64fc47c8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:48.857947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f4bb58a-b778-4cc2-a3f4-5bc64fc47c8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:48.858912 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f4bb58a-b778-4cc2-a3f4-5bc64fc47c8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:48.859278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f4bb58a-b778-4cc2-a3f4-5bc64fc47c8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:48.987210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3f4bb58a-b778-4cc2-a3f4-5bc64fc47c8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:48.995867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3f4bb58a-b778-4cc2-a3f4-5bc64fc47c8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:48.997333 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3f4bb58a-b778-4cc2-a3f4-5bc64fc47c8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:48.998464 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3f4bb58a-b778-4cc2-a3f4-5bc64fc47c8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.152627 Nov 02 23:15:48.999041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 803/1378] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:48 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:49.003345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6f350d81-36c6-4594-b401-4f18d72befea tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:49.004235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6f350d81-36c6-4594-b401-4f18d72befea tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:49.009879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f350d81-36c6-4594-b401-4f18d72befea tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:49.010316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f350d81-36c6-4594-b401-4f18d72befea tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:49.011134 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f350d81-36c6-4594-b401-4f18d72befea tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:49.011570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f350d81-36c6-4594-b401-4f18d72befea tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:49.040200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6f350d81-36c6-4594-b401-4f18d72befea tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040138 Nov 02 23:15:49.041312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 804/1379] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:48 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:49.045570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ad1ebfad-dd57-47ff-92fd-9ac714891201 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:49.046444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ad1ebfad-dd57-47ff-92fd-9ac714891201 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:49.052449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad1ebfad-dd57-47ff-92fd-9ac714891201 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:49.052892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad1ebfad-dd57-47ff-92fd-9ac714891201 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:49.053643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad1ebfad-dd57-47ff-92fd-9ac714891201 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:49.054067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad1ebfad-dd57-47ff-92fd-9ac714891201 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:49.081944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ad1ebfad-dd57-47ff-92fd-9ac714891201 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039620 Nov 02 23:15:49.082498 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 805/1380] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:49 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:50.016427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-be23bd26-6610-4c7d-afd6-c778d24f657c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:50.017073 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-be23bd26-6610-4c7d-afd6-c778d24f657c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:50.023208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be23bd26-6610-4c7d-afd6-c778d24f657c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:50.023652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be23bd26-6610-4c7d-afd6-c778d24f657c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:50.024414 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be23bd26-6610-4c7d-afd6-c778d24f657c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:50.024929 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be23bd26-6610-4c7d-afd6-c778d24f657c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:50.159616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-be23bd26-6610-4c7d-afd6-c778d24f657c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:50.168855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-be23bd26-6610-4c7d-afd6-c778d24f657c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:50.170322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-be23bd26-6610-4c7d-afd6-c778d24f657c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:50.171863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-be23bd26-6610-4c7d-afd6-c778d24f657c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.158916 Nov 02 23:15:50.172068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 806/1381] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:50 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:50.176459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f92641f8-7182-4a4d-b967-e020923a62f6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:50.177356 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f92641f8-7182-4a4d-b967-e020923a62f6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:50.185677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f92641f8-7182-4a4d-b967-e020923a62f6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:50.185677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f92641f8-7182-4a4d-b967-e020923a62f6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:50.185677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f92641f8-7182-4a4d-b967-e020923a62f6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:50.185677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f92641f8-7182-4a4d-b967-e020923a62f6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:50.215090 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f92641f8-7182-4a4d-b967-e020923a62f6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041951 Nov 02 23:15:50.215661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 807/1382] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:50 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:50.219981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9efa1e6e-55cb-45ba-95e0-271ae61936d2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:50.220867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9efa1e6e-55cb-45ba-95e0-271ae61936d2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:50.226863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9efa1e6e-55cb-45ba-95e0-271ae61936d2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:50.227357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9efa1e6e-55cb-45ba-95e0-271ae61936d2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:50.228610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9efa1e6e-55cb-45ba-95e0-271ae61936d2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:50.229038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9efa1e6e-55cb-45ba-95e0-271ae61936d2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:50.259846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9efa1e6e-55cb-45ba-95e0-271ae61936d2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043158 Nov 02 23:15:50.260404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 808/1383] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:50 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:51.189900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-096c54ba-8982-4bed-ab91-4c2e05cf4fe2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:51.190545 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-096c54ba-8982-4bed-ab91-4c2e05cf4fe2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:51.197149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-096c54ba-8982-4bed-ab91-4c2e05cf4fe2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:51.197594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-096c54ba-8982-4bed-ab91-4c2e05cf4fe2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:51.198353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-096c54ba-8982-4bed-ab91-4c2e05cf4fe2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:51.198774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-096c54ba-8982-4bed-ab91-4c2e05cf4fe2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:51.334655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-096c54ba-8982-4bed-ab91-4c2e05cf4fe2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:51.343028 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-096c54ba-8982-4bed-ab91-4c2e05cf4fe2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:51.344501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-096c54ba-8982-4bed-ab91-4c2e05cf4fe2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:51.345647 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-096c54ba-8982-4bed-ab91-4c2e05cf4fe2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.159782 Nov 02 23:15:51.346205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 809/1384] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:51 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:51.350684 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c6d241ce-1e58-49e5-a5a7-528da3d21d1c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:51.351619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c6d241ce-1e58-49e5-a5a7-528da3d21d1c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:51.358093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6d241ce-1e58-49e5-a5a7-528da3d21d1c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:51.358543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6d241ce-1e58-49e5-a5a7-528da3d21d1c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:51.359401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6d241ce-1e58-49e5-a5a7-528da3d21d1c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:51.359842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6d241ce-1e58-49e5-a5a7-528da3d21d1c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:51.389909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c6d241ce-1e58-49e5-a5a7-528da3d21d1c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042681 Nov 02 23:15:51.390480 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 810/1385] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:51 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:51.395000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-edeba361-4003-4c41-afa5-e224c2702722 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:51.395898 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-edeba361-4003-4c41-afa5-e224c2702722 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:51.401467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-edeba361-4003-4c41-afa5-e224c2702722 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:51.401913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-edeba361-4003-4c41-afa5-e224c2702722 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:51.402678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-edeba361-4003-4c41-afa5-e224c2702722 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:51.403144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-edeba361-4003-4c41-afa5-e224c2702722 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:51.432015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-edeba361-4003-4c41-afa5-e224c2702722 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040468 Nov 02 23:15:51.432579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 811/1386] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:51 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:52.364022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2357db23-5283-4783-9d07-199ee046553e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:52.364767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2357db23-5283-4783-9d07-199ee046553e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:52.372199 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2357db23-5283-4783-9d07-199ee046553e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:52.372657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2357db23-5283-4783-9d07-199ee046553e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:52.373481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2357db23-5283-4783-9d07-199ee046553e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:52.373921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2357db23-5283-4783-9d07-199ee046553e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:52.514482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2357db23-5283-4783-9d07-199ee046553e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:52.522862 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2357db23-5283-4783-9d07-199ee046553e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:52.524412 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2357db23-5283-4783-9d07-199ee046553e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:52.525568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2357db23-5283-4783-9d07-199ee046553e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.165522 Nov 02 23:15:52.526129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 812/1387] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:52 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:52.530491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9c65eb3e-9496-4bb6-80ce-665094fd7d6a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:52.531429 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9c65eb3e-9496-4bb6-80ce-665094fd7d6a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:52.537501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c65eb3e-9496-4bb6-80ce-665094fd7d6a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:52.537951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c65eb3e-9496-4bb6-80ce-665094fd7d6a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:52.538725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c65eb3e-9496-4bb6-80ce-665094fd7d6a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:52.539196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c65eb3e-9496-4bb6-80ce-665094fd7d6a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:52.569205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9c65eb3e-9496-4bb6-80ce-665094fd7d6a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042033 Nov 02 23:15:52.569771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 813/1388] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:52 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:52.574218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7046b346-8a2c-4eb9-b361-d932a72b812d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:52.575149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7046b346-8a2c-4eb9-b361-d932a72b812d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:52.581366 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7046b346-8a2c-4eb9-b361-d932a72b812d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:52.581811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7046b346-8a2c-4eb9-b361-d932a72b812d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:52.582591 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7046b346-8a2c-4eb9-b361-d932a72b812d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:52.583065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7046b346-8a2c-4eb9-b361-d932a72b812d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:52.613048 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7046b346-8a2c-4eb9-b361-d932a72b812d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042238 Nov 02 23:15:52.613619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 814/1389] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:52 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:53.544500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6ef97da9-0591-4f2a-8346-8477966a8223 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:53.545177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6ef97da9-0591-4f2a-8346-8477966a8223 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:53.551514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ef97da9-0591-4f2a-8346-8477966a8223 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:53.551956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ef97da9-0591-4f2a-8346-8477966a8223 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:53.552743 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ef97da9-0591-4f2a-8346-8477966a8223 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:53.553168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ef97da9-0591-4f2a-8346-8477966a8223 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:53.691466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6ef97da9-0591-4f2a-8346-8477966a8223 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:53.700780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6ef97da9-0591-4f2a-8346-8477966a8223 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:53.702560 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6ef97da9-0591-4f2a-8346-8477966a8223 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:53.703772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6ef97da9-0591-4f2a-8346-8477966a8223 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.163524 Nov 02 23:15:53.704351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 815/1390] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:53 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:53.709276 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0adbe523-119f-4669-93f7-41ac837c1255 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:53.710209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0adbe523-119f-4669-93f7-41ac837c1255 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:53.717434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0adbe523-119f-4669-93f7-41ac837c1255 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:53.717875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0adbe523-119f-4669-93f7-41ac837c1255 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:53.718712 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0adbe523-119f-4669-93f7-41ac837c1255 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:53.719131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0adbe523-119f-4669-93f7-41ac837c1255 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:53.753746 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0adbe523-119f-4669-93f7-41ac837c1255 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048193 Nov 02 23:15:53.757918 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 816/1391] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:53 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:53.758971 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-74943b8f-44d3-4a6f-8035-dc2e69392a45 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:53.759918 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-74943b8f-44d3-4a6f-8035-dc2e69392a45 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:53.766353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74943b8f-44d3-4a6f-8035-dc2e69392a45 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:53.766805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74943b8f-44d3-4a6f-8035-dc2e69392a45 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:53.767613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74943b8f-44d3-4a6f-8035-dc2e69392a45 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:53.768044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74943b8f-44d3-4a6f-8035-dc2e69392a45 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:53.800303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-74943b8f-44d3-4a6f-8035-dc2e69392a45 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044823 Nov 02 23:15:53.800816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 817/1392] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:53 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:54.722546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6cc7d9bc-d903-4896-9bcd-fcd25f6f486f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:54.723346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6cc7d9bc-d903-4896-9bcd-fcd25f6f486f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:54.729661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6cc7d9bc-d903-4896-9bcd-fcd25f6f486f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:54.730098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6cc7d9bc-d903-4896-9bcd-fcd25f6f486f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:54.730910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6cc7d9bc-d903-4896-9bcd-fcd25f6f486f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:54.731368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6cc7d9bc-d903-4896-9bcd-fcd25f6f486f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:54.879379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6cc7d9bc-d903-4896-9bcd-fcd25f6f486f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:54.888741 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6cc7d9bc-d903-4896-9bcd-fcd25f6f486f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:54.890234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6cc7d9bc-d903-4896-9bcd-fcd25f6f486f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:54.891480 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6cc7d9bc-d903-4896-9bcd-fcd25f6f486f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.172747 Nov 02 23:15:54.892053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 818/1393] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:54 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:54.896808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3345429d-a343-4a92-90ba-7c6bc8324295 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:54.897720 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3345429d-a343-4a92-90ba-7c6bc8324295 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:54.904572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3345429d-a343-4a92-90ba-7c6bc8324295 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:54.905018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3345429d-a343-4a92-90ba-7c6bc8324295 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:54.905866 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3345429d-a343-4a92-90ba-7c6bc8324295 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:54.906251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3345429d-a343-4a92-90ba-7c6bc8324295 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:54.938006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3345429d-a343-4a92-90ba-7c6bc8324295 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044678 Nov 02 23:15:54.938504 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 819/1394] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:54 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:54.943514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4daeeed0-5b41-4aff-b3e4-2ed76b579f9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:54.944443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4daeeed0-5b41-4aff-b3e4-2ed76b579f9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:54.955741 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4daeeed0-5b41-4aff-b3e4-2ed76b579f9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:54.956187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4daeeed0-5b41-4aff-b3e4-2ed76b579f9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:54.956960 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4daeeed0-5b41-4aff-b3e4-2ed76b579f9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:54.957385 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4daeeed0-5b41-4aff-b3e4-2ed76b579f9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:54.991748 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4daeeed0-5b41-4aff-b3e4-2ed76b579f9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051964 Nov 02 23:15:54.992529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 820/1395] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:54 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:55.911659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-db7e6736-fdce-4524-8cfc-c741d6e7a7d7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:55.912372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-db7e6736-fdce-4524-8cfc-c741d6e7a7d7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:55.922095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db7e6736-fdce-4524-8cfc-c741d6e7a7d7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:55.922574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db7e6736-fdce-4524-8cfc-c741d6e7a7d7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:55.923601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db7e6736-fdce-4524-8cfc-c741d6e7a7d7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:55.924341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db7e6736-fdce-4524-8cfc-c741d6e7a7d7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:56.084289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-db7e6736-fdce-4524-8cfc-c741d6e7a7d7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:56.094909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-db7e6736-fdce-4524-8cfc-c741d6e7a7d7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:56.096508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-db7e6736-fdce-4524-8cfc-c741d6e7a7d7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:56.097812 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-db7e6736-fdce-4524-8cfc-c741d6e7a7d7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.190813 Nov 02 23:15:56.098383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 821/1396] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:55 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:56.103590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e512ed1c-894f-4403-a61e-6186e603ef96 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:56.104548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e512ed1c-894f-4403-a61e-6186e603ef96 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:56.111246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e512ed1c-894f-4403-a61e-6186e603ef96 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:56.111734 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e512ed1c-894f-4403-a61e-6186e603ef96 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:56.112515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e512ed1c-894f-4403-a61e-6186e603ef96 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:56.112944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e512ed1c-894f-4403-a61e-6186e603ef96 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:56.153517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e512ed1c-894f-4403-a61e-6186e603ef96 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054067 Nov 02 23:15:56.154101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 822/1397] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:56 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:56.158547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-97dbb9c7-c5a3-43d0-be53-90b5f80595f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:56.159486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-97dbb9c7-c5a3-43d0-be53-90b5f80595f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:56.165979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-97dbb9c7-c5a3-43d0-be53-90b5f80595f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:56.166424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-97dbb9c7-c5a3-43d0-be53-90b5f80595f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:56.167312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-97dbb9c7-c5a3-43d0-be53-90b5f80595f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:56.167779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-97dbb9c7-c5a3-43d0-be53-90b5f80595f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:56.198826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-97dbb9c7-c5a3-43d0-be53-90b5f80595f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043649 Nov 02 23:15:56.199436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 823/1398] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:56 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:57.117895 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8a338c87-2904-4f64-af5e-33daad112a42 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:57.118564 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8a338c87-2904-4f64-af5e-33daad112a42 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:57.129459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a338c87-2904-4f64-af5e-33daad112a42 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:57.129859 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a338c87-2904-4f64-af5e-33daad112a42 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:57.130826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a338c87-2904-4f64-af5e-33daad112a42 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:57.131375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a338c87-2904-4f64-af5e-33daad112a42 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:57.296257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8a338c87-2904-4f64-af5e-33daad112a42 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:57.306714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8a338c87-2904-4f64-af5e-33daad112a42 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:57.308349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8a338c87-2904-4f64-af5e-33daad112a42 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:57.309563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8a338c87-2904-4f64-af5e-33daad112a42 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.195398 Nov 02 23:15:57.310134 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 824/1399] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:57 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:57.314820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c5b7f2a5-e9bd-4c3a-a23e-14c00bfc284f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:57.315768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c5b7f2a5-e9bd-4c3a-a23e-14c00bfc284f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:57.322946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c5b7f2a5-e9bd-4c3a-a23e-14c00bfc284f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:57.323536 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c5b7f2a5-e9bd-4c3a-a23e-14c00bfc284f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:57.324506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c5b7f2a5-e9bd-4c3a-a23e-14c00bfc284f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:57.324942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c5b7f2a5-e9bd-4c3a-a23e-14c00bfc284f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:57.370591 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c5b7f2a5-e9bd-4c3a-a23e-14c00bfc284f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059174 Nov 02 23:15:57.371453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 825/1400] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:57 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:57.377494 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f787f0ee-bfdb-4840-a165-0c6342bd56f3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:57.378602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f787f0ee-bfdb-4840-a165-0c6342bd56f3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:57.387021 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f787f0ee-bfdb-4840-a165-0c6342bd56f3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:57.387543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f787f0ee-bfdb-4840-a165-0c6342bd56f3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:57.388634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f787f0ee-bfdb-4840-a165-0c6342bd56f3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:57.389171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f787f0ee-bfdb-4840-a165-0c6342bd56f3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:57.425856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f787f0ee-bfdb-4840-a165-0c6342bd56f3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053036 Nov 02 23:15:57.426766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 826/1401] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:57 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:58.330136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-243ecd86-fca7-47bb-8da0-04d05df754fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:58.331040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-243ecd86-fca7-47bb-8da0-04d05df754fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:58.337184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-243ecd86-fca7-47bb-8da0-04d05df754fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:58.337626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-243ecd86-fca7-47bb-8da0-04d05df754fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:58.338395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-243ecd86-fca7-47bb-8da0-04d05df754fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:58.338817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-243ecd86-fca7-47bb-8da0-04d05df754fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:58.485295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-243ecd86-fca7-47bb-8da0-04d05df754fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:58.495205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-243ecd86-fca7-47bb-8da0-04d05df754fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:58.496827 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-243ecd86-fca7-47bb-8da0-04d05df754fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:58.498024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-243ecd86-fca7-47bb-8da0-04d05df754fc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.171807 Nov 02 23:15:58.498653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 827/1402] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:58 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:58.503276 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-15633a7d-9211-45d7-aef1-255f08ff202a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:58.504183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-15633a7d-9211-45d7-aef1-255f08ff202a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:58.510638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15633a7d-9211-45d7-aef1-255f08ff202a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:58.511163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15633a7d-9211-45d7-aef1-255f08ff202a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:58.512028 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15633a7d-9211-45d7-aef1-255f08ff202a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:58.512555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15633a7d-9211-45d7-aef1-255f08ff202a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:58.544516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-15633a7d-9211-45d7-aef1-255f08ff202a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044741 Nov 02 23:15:58.545078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 828/1403] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:58 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:58.549490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c325c0bb-7eee-4e94-ac4d-097caae9a1f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:58.550392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c325c0bb-7eee-4e94-ac4d-097caae9a1f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:58.558044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c325c0bb-7eee-4e94-ac4d-097caae9a1f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:58.558488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c325c0bb-7eee-4e94-ac4d-097caae9a1f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:58.559319 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c325c0bb-7eee-4e94-ac4d-097caae9a1f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:58.559847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c325c0bb-7eee-4e94-ac4d-097caae9a1f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:58.592304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c325c0bb-7eee-4e94-ac4d-097caae9a1f9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046184 Nov 02 23:15:58.592877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 829/1404] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:58 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:59.518406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-543fc8f0-ca44-468f-9020-1ca379f8763e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:59.519205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-543fc8f0-ca44-468f-9020-1ca379f8763e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:59.527042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-543fc8f0-ca44-468f-9020-1ca379f8763e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:59.527542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-543fc8f0-ca44-468f-9020-1ca379f8763e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:59.528482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-543fc8f0-ca44-468f-9020-1ca379f8763e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:59.528910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-543fc8f0-ca44-468f-9020-1ca379f8763e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:59.680107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-543fc8f0-ca44-468f-9020-1ca379f8763e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:59.690360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-543fc8f0-ca44-468f-9020-1ca379f8763e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:59.692061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-543fc8f0-ca44-468f-9020-1ca379f8763e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:15:59.693347 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-543fc8f0-ca44-468f-9020-1ca379f8763e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.179347 Nov 02 23:15:59.693998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 830/1405] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:15:59 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:15:59.699017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9bd76936-7f62-434f-9c53-70f225f7aa85 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:59.700051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9bd76936-7f62-434f-9c53-70f225f7aa85 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:59.706791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9bd76936-7f62-434f-9c53-70f225f7aa85 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:59.707285 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9bd76936-7f62-434f-9c53-70f225f7aa85 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:59.708251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9bd76936-7f62-434f-9c53-70f225f7aa85 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:59.708796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9bd76936-7f62-434f-9c53-70f225f7aa85 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:59.744849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9bd76936-7f62-434f-9c53-70f225f7aa85 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049664 Nov 02 23:15:59.745527 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 831/1406] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:59 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:15:59.750869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-48b1481e-e366-484c-b5b0-843ac3264856 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:15:59.752774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-48b1481e-e366-484c-b5b0-843ac3264856 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:15:59.758755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48b1481e-e366-484c-b5b0-843ac3264856 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:59.759317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48b1481e-e366-484c-b5b0-843ac3264856 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:59.760107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48b1481e-e366-484c-b5b0-843ac3264856 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:15:59.760545 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48b1481e-e366-484c-b5b0-843ac3264856 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:15:59.805373 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-48b1481e-e366-484c-b5b0-843ac3264856 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058658 Nov 02 23:15:59.805941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 832/1407] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:15:59 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:00.712075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-943cd0b7-5962-4b47-8e95-9d9e592a6745 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:00.712766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-943cd0b7-5962-4b47-8e95-9d9e592a6745 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:00.719574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-943cd0b7-5962-4b47-8e95-9d9e592a6745 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:00.720030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-943cd0b7-5962-4b47-8e95-9d9e592a6745 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:00.720885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-943cd0b7-5962-4b47-8e95-9d9e592a6745 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:00.721410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-943cd0b7-5962-4b47-8e95-9d9e592a6745 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:00.892925 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-943cd0b7-5962-4b47-8e95-9d9e592a6745 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:00.902052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-943cd0b7-5962-4b47-8e95-9d9e592a6745 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:00.903729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-943cd0b7-5962-4b47-8e95-9d9e592a6745 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:00.904998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-943cd0b7-5962-4b47-8e95-9d9e592a6745 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.196694 Nov 02 23:16:00.905575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 833/1408] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:00 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:00.910282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4b6192f3-9958-46ff-af9e-1710451b799d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:00.911266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4b6192f3-9958-46ff-af9e-1710451b799d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:00.918128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b6192f3-9958-46ff-af9e-1710451b799d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:00.918632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b6192f3-9958-46ff-af9e-1710451b799d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:00.919526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b6192f3-9958-46ff-af9e-1710451b799d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:00.919962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b6192f3-9958-46ff-af9e-1710451b799d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:00.953459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4b6192f3-9958-46ff-af9e-1710451b799d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046688 Nov 02 23:16:00.953976 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 834/1409] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:00 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:00.958754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e35282a5-6e5f-4c78-a6c8-ae5d76ad7a34 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:00.959687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e35282a5-6e5f-4c78-a6c8-ae5d76ad7a34 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:00.966688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e35282a5-6e5f-4c78-a6c8-ae5d76ad7a34 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:00.967181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e35282a5-6e5f-4c78-a6c8-ae5d76ad7a34 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:00.968026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e35282a5-6e5f-4c78-a6c8-ae5d76ad7a34 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:00.968504 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e35282a5-6e5f-4c78-a6c8-ae5d76ad7a34 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:01.002785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e35282a5-6e5f-4c78-a6c8-ae5d76ad7a34 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047685 Nov 02 23:16:01.003415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 835/1410] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:00 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:01.928151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c7772662-ba17-4303-aa14-a83e9f8251b9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:01.928948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c7772662-ba17-4303-aa14-a83e9f8251b9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:01.936855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7772662-ba17-4303-aa14-a83e9f8251b9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:01.937300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7772662-ba17-4303-aa14-a83e9f8251b9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:01.938122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7772662-ba17-4303-aa14-a83e9f8251b9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:01.938636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7772662-ba17-4303-aa14-a83e9f8251b9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:02.093946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c7772662-ba17-4303-aa14-a83e9f8251b9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:02.107551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c7772662-ba17-4303-aa14-a83e9f8251b9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:02.109138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c7772662-ba17-4303-aa14-a83e9f8251b9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:02.110838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c7772662-ba17-4303-aa14-a83e9f8251b9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.187316 Nov 02 23:16:02.111572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 836/1411] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:01 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:02.116780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-357ed766-c87f-45e2-8c5b-b7ac98df6c23 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:02.117712 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-357ed766-c87f-45e2-8c5b-b7ac98df6c23 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:02.126398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-357ed766-c87f-45e2-8c5b-b7ac98df6c23 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:02.127169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-357ed766-c87f-45e2-8c5b-b7ac98df6c23 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:02.128037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-357ed766-c87f-45e2-8c5b-b7ac98df6c23 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:02.128537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-357ed766-c87f-45e2-8c5b-b7ac98df6c23 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:02.166159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-357ed766-c87f-45e2-8c5b-b7ac98df6c23 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053185 Nov 02 23:16:02.166831 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 837/1412] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:02 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:02.171647 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7f91548f-cf5d-457a-9fd3-65c3a72e0a88 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:02.172645 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7f91548f-cf5d-457a-9fd3-65c3a72e0a88 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:02.178775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f91548f-cf5d-457a-9fd3-65c3a72e0a88 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:02.179183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f91548f-cf5d-457a-9fd3-65c3a72e0a88 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:02.179958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f91548f-cf5d-457a-9fd3-65c3a72e0a88 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:02.180470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f91548f-cf5d-457a-9fd3-65c3a72e0a88 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:02.217118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7f91548f-cf5d-457a-9fd3-65c3a72e0a88 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049150 Nov 02 23:16:02.217754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 838/1413] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:02 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:03.129430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aed0fd2f-1e2b-4f59-888c-9eda067103c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:03.130108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aed0fd2f-1e2b-4f59-888c-9eda067103c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:03.136932 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aed0fd2f-1e2b-4f59-888c-9eda067103c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:03.137371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aed0fd2f-1e2b-4f59-888c-9eda067103c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:03.138139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aed0fd2f-1e2b-4f59-888c-9eda067103c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:03.138567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aed0fd2f-1e2b-4f59-888c-9eda067103c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:03.277151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aed0fd2f-1e2b-4f59-888c-9eda067103c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:03.291998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aed0fd2f-1e2b-4f59-888c-9eda067103c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:03.293521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aed0fd2f-1e2b-4f59-888c-9eda067103c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:03.294701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aed0fd2f-1e2b-4f59-888c-9eda067103c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.168946 Nov 02 23:16:03.295281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 839/1414] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:03 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:03.302160 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0946cb7f-eab6-4a88-862f-6518e8170e8c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:03.303080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0946cb7f-eab6-4a88-862f-6518e8170e8c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:03.309447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0946cb7f-eab6-4a88-862f-6518e8170e8c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:03.309885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0946cb7f-eab6-4a88-862f-6518e8170e8c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:03.310648 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0946cb7f-eab6-4a88-862f-6518e8170e8c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:03.311106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0946cb7f-eab6-4a88-862f-6518e8170e8c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:03.339629 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0946cb7f-eab6-4a88-862f-6518e8170e8c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041010 Nov 02 23:16:03.340188 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 840/1415] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:03 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:03.344788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cf650a39-c5ee-4d4f-86ee-ae61325c68d2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:03.345673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cf650a39-c5ee-4d4f-86ee-ae61325c68d2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:03.351235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf650a39-c5ee-4d4f-86ee-ae61325c68d2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:03.351677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf650a39-c5ee-4d4f-86ee-ae61325c68d2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:03.352444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf650a39-c5ee-4d4f-86ee-ae61325c68d2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:03.352914 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf650a39-c5ee-4d4f-86ee-ae61325c68d2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:03.381908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cf650a39-c5ee-4d4f-86ee-ae61325c68d2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040485 Nov 02 23:16:03.382389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 841/1416] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:03 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:04.312030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8108fa2b-c95f-44ab-9f97-05398112d56a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:04.312642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8108fa2b-c95f-44ab-9f97-05398112d56a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:04.318802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8108fa2b-c95f-44ab-9f97-05398112d56a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:04.319278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8108fa2b-c95f-44ab-9f97-05398112d56a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:04.320048 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8108fa2b-c95f-44ab-9f97-05398112d56a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:04.320477 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8108fa2b-c95f-44ab-9f97-05398112d56a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:04.452610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8108fa2b-c95f-44ab-9f97-05398112d56a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:04.460759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8108fa2b-c95f-44ab-9f97-05398112d56a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:04.462783 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8108fa2b-c95f-44ab-9f97-05398112d56a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:04.463945 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8108fa2b-c95f-44ab-9f97-05398112d56a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.155691 Nov 02 23:16:04.464606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 842/1417] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:04 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:04.469008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2182c0f4-db9f-4792-a302-623ff508ae65 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:04.469901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2182c0f4-db9f-4792-a302-623ff508ae65 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:04.476004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2182c0f4-db9f-4792-a302-623ff508ae65 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:04.476508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2182c0f4-db9f-4792-a302-623ff508ae65 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:04.477303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2182c0f4-db9f-4792-a302-623ff508ae65 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:04.477736 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2182c0f4-db9f-4792-a302-623ff508ae65 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:04.506581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2182c0f4-db9f-4792-a302-623ff508ae65 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040962 Nov 02 23:16:04.507194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 843/1418] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:04 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:04.512015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dfcc8554-beb6-4948-aed0-f176862929a7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:04.512896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dfcc8554-beb6-4948-aed0-f176862929a7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:04.518479 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dfcc8554-beb6-4948-aed0-f176862929a7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:04.518944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dfcc8554-beb6-4948-aed0-f176862929a7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:04.519718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dfcc8554-beb6-4948-aed0-f176862929a7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:04.520142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dfcc8554-beb6-4948-aed0-f176862929a7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:04.548723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dfcc8554-beb6-4948-aed0-f176862929a7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040517 Nov 02 23:16:04.549273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 844/1419] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:04 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:05.481453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-87c7c60d-0aa5-49e2-8eaa-e97bb6d3e97c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:05.482083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-87c7c60d-0aa5-49e2-8eaa-e97bb6d3e97c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:05.488316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87c7c60d-0aa5-49e2-8eaa-e97bb6d3e97c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:05.488759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87c7c60d-0aa5-49e2-8eaa-e97bb6d3e97c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:05.489516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87c7c60d-0aa5-49e2-8eaa-e97bb6d3e97c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:05.489940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87c7c60d-0aa5-49e2-8eaa-e97bb6d3e97c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:05.617321 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-87c7c60d-0aa5-49e2-8eaa-e97bb6d3e97c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:05.625861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-87c7c60d-0aa5-49e2-8eaa-e97bb6d3e97c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:05.627376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-87c7c60d-0aa5-49e2-8eaa-e97bb6d3e97c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:05.628512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-87c7c60d-0aa5-49e2-8eaa-e97bb6d3e97c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.150803 Nov 02 23:16:05.629063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 845/1420] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:05 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:05.633340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-87bf3c2f-c53d-4ded-a84a-ff9c03826b87 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:05.634784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-87bf3c2f-c53d-4ded-a84a-ff9c03826b87 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:05.640378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87bf3c2f-c53d-4ded-a84a-ff9c03826b87 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:05.640819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87bf3c2f-c53d-4ded-a84a-ff9c03826b87 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:05.641574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87bf3c2f-c53d-4ded-a84a-ff9c03826b87 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:05.641997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87bf3c2f-c53d-4ded-a84a-ff9c03826b87 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:05.671405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-87bf3c2f-c53d-4ded-a84a-ff9c03826b87 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041273 Nov 02 23:16:05.671967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 846/1421] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:05 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:05.676463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0646ac5a-c815-47c8-979a-a016d91bfe4a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:05.677356 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0646ac5a-c815-47c8-979a-a016d91bfe4a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:05.683871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0646ac5a-c815-47c8-979a-a016d91bfe4a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:05.684316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0646ac5a-c815-47c8-979a-a016d91bfe4a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:05.685093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0646ac5a-c815-47c8-979a-a016d91bfe4a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:05.685527 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0646ac5a-c815-47c8-979a-a016d91bfe4a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:05.716377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0646ac5a-c815-47c8-979a-a016d91bfe4a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043339 Nov 02 23:16:05.716981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 847/1422] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:05 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:06.646781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5c97ece3-66cd-43a7-8e73-1597128644b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:06.647476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5c97ece3-66cd-43a7-8e73-1597128644b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:06.654278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5c97ece3-66cd-43a7-8e73-1597128644b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:06.654728 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5c97ece3-66cd-43a7-8e73-1597128644b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:06.655540 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5c97ece3-66cd-43a7-8e73-1597128644b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:06.655978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5c97ece3-66cd-43a7-8e73-1597128644b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:06.783738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5c97ece3-66cd-43a7-8e73-1597128644b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:06.791889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5c97ece3-66cd-43a7-8e73-1597128644b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:06.793437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5c97ece3-66cd-43a7-8e73-1597128644b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:06.794590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5c97ece3-66cd-43a7-8e73-1597128644b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.151570 Nov 02 23:16:06.795198 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 848/1423] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:06 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:06.799488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d6c296a4-6318-48ed-8632-cd797ca71d96 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:06.800394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d6c296a4-6318-48ed-8632-cd797ca71d96 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:06.805902 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6c296a4-6318-48ed-8632-cd797ca71d96 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:06.806348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6c296a4-6318-48ed-8632-cd797ca71d96 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:06.807157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6c296a4-6318-48ed-8632-cd797ca71d96 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:06.807594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6c296a4-6318-48ed-8632-cd797ca71d96 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:06.838132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d6c296a4-6318-48ed-8632-cd797ca71d96 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041794 Nov 02 23:16:06.838646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 849/1424] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:06 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:06.843139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fb6e558d-b3fc-4302-b680-6dfb54c9f3db tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:06.844040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fb6e558d-b3fc-4302-b680-6dfb54c9f3db tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:06.849785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fb6e558d-b3fc-4302-b680-6dfb54c9f3db tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:06.850234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fb6e558d-b3fc-4302-b680-6dfb54c9f3db tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:06.851042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fb6e558d-b3fc-4302-b680-6dfb54c9f3db tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:06.851482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fb6e558d-b3fc-4302-b680-6dfb54c9f3db tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:06.888065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fb6e558d-b3fc-4302-b680-6dfb54c9f3db tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048298 Nov 02 23:16:06.888989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 850/1425] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:06 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:07.812196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2492817b-f476-4ef1-9680-5326ef0385d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:07.812875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2492817b-f476-4ef1-9680-5326ef0385d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:07.819025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2492817b-f476-4ef1-9680-5326ef0385d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:07.819472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2492817b-f476-4ef1-9680-5326ef0385d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:07.820241 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2492817b-f476-4ef1-9680-5326ef0385d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:07.820672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2492817b-f476-4ef1-9680-5326ef0385d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:07.957516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2492817b-f476-4ef1-9680-5326ef0385d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:07.965592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2492817b-f476-4ef1-9680-5326ef0385d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:07.967148 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2492817b-f476-4ef1-9680-5326ef0385d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:07.968301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2492817b-f476-4ef1-9680-5326ef0385d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.159871 Nov 02 23:16:07.968868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 851/1426] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:07 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:07.973197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ddde623a-3ae0-4a1e-91d4-b96624829771 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:07.974130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ddde623a-3ae0-4a1e-91d4-b96624829771 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:07.979656 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddde623a-3ae0-4a1e-91d4-b96624829771 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:07.980107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddde623a-3ae0-4a1e-91d4-b96624829771 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:07.980884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddde623a-3ae0-4a1e-91d4-b96624829771 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:07.981316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddde623a-3ae0-4a1e-91d4-b96624829771 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:08.010377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ddde623a-3ae0-4a1e-91d4-b96624829771 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040526 Nov 02 23:16:08.010931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 852/1427] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:07 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:08.015168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8d244f04-329d-4922-8ee7-787ec3ece419 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:08.016040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8d244f04-329d-4922-8ee7-787ec3ece419 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:08.021294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d244f04-329d-4922-8ee7-787ec3ece419 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:08.021743 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d244f04-329d-4922-8ee7-787ec3ece419 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:08.022511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d244f04-329d-4922-8ee7-787ec3ece419 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:08.022975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d244f04-329d-4922-8ee7-787ec3ece419 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:08.050120 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8d244f04-329d-4922-8ee7-787ec3ece419 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038215 Nov 02 23:16:08.050665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 853/1428] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:08 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:08.985444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3714f058-5257-406b-966b-da17a6f9afd7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:08.986108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3714f058-5257-406b-966b-da17a6f9afd7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:08.992306 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3714f058-5257-406b-966b-da17a6f9afd7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:08.992744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3714f058-5257-406b-966b-da17a6f9afd7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:08.993504 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3714f058-5257-406b-966b-da17a6f9afd7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:08.993928 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3714f058-5257-406b-966b-da17a6f9afd7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:09.120978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3714f058-5257-406b-966b-da17a6f9afd7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:09.129059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3714f058-5257-406b-966b-da17a6f9afd7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:09.130517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3714f058-5257-406b-966b-da17a6f9afd7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:09.131680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3714f058-5257-406b-966b-da17a6f9afd7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.149974 Nov 02 23:16:09.132233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 854/1429] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:08 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:09.137100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-48a06a2e-7684-4abc-b919-27f68e3476d0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:09.137985 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-48a06a2e-7684-4abc-b919-27f68e3476d0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:09.143978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48a06a2e-7684-4abc-b919-27f68e3476d0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:09.144424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48a06a2e-7684-4abc-b919-27f68e3476d0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:09.145197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48a06a2e-7684-4abc-b919-27f68e3476d0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:09.145623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48a06a2e-7684-4abc-b919-27f68e3476d0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:09.174941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-48a06a2e-7684-4abc-b919-27f68e3476d0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041642 Nov 02 23:16:09.175508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 855/1430] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:09 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:09.179817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1b927bf1-5457-4aeb-951c-caf8256b5b22 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:09.180703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1b927bf1-5457-4aeb-951c-caf8256b5b22 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:09.186261 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1b927bf1-5457-4aeb-951c-caf8256b5b22 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:09.186704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1b927bf1-5457-4aeb-951c-caf8256b5b22 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:09.187520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1b927bf1-5457-4aeb-951c-caf8256b5b22 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:09.187954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1b927bf1-5457-4aeb-951c-caf8256b5b22 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:09.217644 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1b927bf1-5457-4aeb-951c-caf8256b5b22 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041113 Nov 02 23:16:09.218212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 856/1431] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:09 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:10.149953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-11ca6944-4dab-4f5a-8573-ea469e1f9b11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:10.150650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-11ca6944-4dab-4f5a-8573-ea469e1f9b11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:10.156721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-11ca6944-4dab-4f5a-8573-ea469e1f9b11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:10.157158 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-11ca6944-4dab-4f5a-8573-ea469e1f9b11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:10.157914 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-11ca6944-4dab-4f5a-8573-ea469e1f9b11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:10.158342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-11ca6944-4dab-4f5a-8573-ea469e1f9b11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:10.292186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-11ca6944-4dab-4f5a-8573-ea469e1f9b11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:10.300413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-11ca6944-4dab-4f5a-8573-ea469e1f9b11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:10.301897 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-11ca6944-4dab-4f5a-8573-ea469e1f9b11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:10.303076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-11ca6944-4dab-4f5a-8573-ea469e1f9b11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.157431 Nov 02 23:16:10.303640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 857/1432] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:10 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:10.308018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cdcd8626-5d4e-4df0-93e0-3301a7c06f2e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:10.308950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cdcd8626-5d4e-4df0-93e0-3301a7c06f2e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:10.315023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cdcd8626-5d4e-4df0-93e0-3301a7c06f2e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:10.315479 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cdcd8626-5d4e-4df0-93e0-3301a7c06f2e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:10.316248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cdcd8626-5d4e-4df0-93e0-3301a7c06f2e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:10.316709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cdcd8626-5d4e-4df0-93e0-3301a7c06f2e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:10.345599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cdcd8626-5d4e-4df0-93e0-3301a7c06f2e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040944 Nov 02 23:16:10.346161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 858/1433] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:10 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:10.350619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-05d62457-4b13-46d5-9d5a-747ee23088e9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:10.351546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-05d62457-4b13-46d5-9d5a-747ee23088e9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:10.357825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05d62457-4b13-46d5-9d5a-747ee23088e9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:10.358265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05d62457-4b13-46d5-9d5a-747ee23088e9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:10.359072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05d62457-4b13-46d5-9d5a-747ee23088e9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:10.359502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05d62457-4b13-46d5-9d5a-747ee23088e9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:10.387613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-05d62457-4b13-46d5-9d5a-747ee23088e9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040466 Nov 02 23:16:10.388168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 859/1434] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:10 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:11.321854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a0232a79-1875-4859-ac42-a53966a6f635 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:11.322531 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a0232a79-1875-4859-ac42-a53966a6f635 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:11.329404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0232a79-1875-4859-ac42-a53966a6f635 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:11.329844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0232a79-1875-4859-ac42-a53966a6f635 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:11.330623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0232a79-1875-4859-ac42-a53966a6f635 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:11.331151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0232a79-1875-4859-ac42-a53966a6f635 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:11.467782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a0232a79-1875-4859-ac42-a53966a6f635 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:11.476100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a0232a79-1875-4859-ac42-a53966a6f635 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:11.478226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a0232a79-1875-4859-ac42-a53966a6f635 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:11.479516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a0232a79-1875-4859-ac42-a53966a6f635 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.161850 Nov 02 23:16:11.480074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 860/1435] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:11 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:16:11.484628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f6748ffb-0fbf-49a2-934c-08c97d82aca8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:11.485529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f6748ffb-0fbf-49a2-934c-08c97d82aca8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:11.493375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f6748ffb-0fbf-49a2-934c-08c97d82aca8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:11.493863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f6748ffb-0fbf-49a2-934c-08c97d82aca8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:11.494664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f6748ffb-0fbf-49a2-934c-08c97d82aca8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:11.495142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f6748ffb-0fbf-49a2-934c-08c97d82aca8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:11.526842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f6748ffb-0fbf-49a2-934c-08c97d82aca8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045636 Nov 02 23:16:11.527441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 861/1436] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:11 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:11.531828 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-960d23d1-209c-4b03-ac0d-ecc7ffe83193 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:11.532722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-960d23d1-209c-4b03-ac0d-ecc7ffe83193 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:11.538425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-960d23d1-209c-4b03-ac0d-ecc7ffe83193 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:11.538873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-960d23d1-209c-4b03-ac0d-ecc7ffe83193 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:11.539687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-960d23d1-209c-4b03-ac0d-ecc7ffe83193 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:11.540718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-960d23d1-209c-4b03-ac0d-ecc7ffe83193 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:11.573377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-960d23d1-209c-4b03-ac0d-ecc7ffe83193 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044883 Nov 02 23:16:11.573953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 862/1437] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:11 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:12.505318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f219c077-2aa2-4a7c-8e16-71885ec911a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:12.505972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f219c077-2aa2-4a7c-8e16-71885ec911a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:12.512887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f219c077-2aa2-4a7c-8e16-71885ec911a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:12.513331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f219c077-2aa2-4a7c-8e16-71885ec911a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:12.514105 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f219c077-2aa2-4a7c-8e16-71885ec911a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:12.514533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f219c077-2aa2-4a7c-8e16-71885ec911a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:12.645125 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f219c077-2aa2-4a7c-8e16-71885ec911a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:12.654135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f219c077-2aa2-4a7c-8e16-71885ec911a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:12.655649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f219c077-2aa2-4a7c-8e16-71885ec911a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:12.656794 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f219c077-2aa2-4a7c-8e16-71885ec911a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.155216 Nov 02 23:16:12.657342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 863/1438] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:12 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:12.661649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-03a23083-ba4a-4f4e-9d77-57cd1ab98744 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:12.662535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-03a23083-ba4a-4f4e-9d77-57cd1ab98744 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:12.670409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03a23083-ba4a-4f4e-9d77-57cd1ab98744 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:12.670855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03a23083-ba4a-4f4e-9d77-57cd1ab98744 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:12.671660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03a23083-ba4a-4f4e-9d77-57cd1ab98744 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:12.672383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03a23083-ba4a-4f4e-9d77-57cd1ab98744 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:12.707613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-03a23083-ba4a-4f4e-9d77-57cd1ab98744 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049240 Nov 02 23:16:12.709376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 864/1439] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:12 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:12.714642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-992b1746-f675-4429-9dec-afb38005a41a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:12.715790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-992b1746-f675-4429-9dec-afb38005a41a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:12.721709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-992b1746-f675-4429-9dec-afb38005a41a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:12.722169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-992b1746-f675-4429-9dec-afb38005a41a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:12.722971 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-992b1746-f675-4429-9dec-afb38005a41a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:12.723409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-992b1746-f675-4429-9dec-afb38005a41a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:12.753298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-992b1746-f675-4429-9dec-afb38005a41a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044028 Nov 02 23:16:12.753874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 865/1440] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:12 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:13.675300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6ac18606-6ae0-4787-87a3-45d9ea416f06 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:13.675944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6ac18606-6ae0-4787-87a3-45d9ea416f06 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:13.682336 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ac18606-6ae0-4787-87a3-45d9ea416f06 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:13.682810 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ac18606-6ae0-4787-87a3-45d9ea416f06 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:13.683614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ac18606-6ae0-4787-87a3-45d9ea416f06 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:13.684042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ac18606-6ae0-4787-87a3-45d9ea416f06 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:13.825706 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6ac18606-6ae0-4787-87a3-45d9ea416f06 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:13.834338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6ac18606-6ae0-4787-87a3-45d9ea416f06 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:13.835857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6ac18606-6ae0-4787-87a3-45d9ea416f06 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:13.837020 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6ac18606-6ae0-4787-87a3-45d9ea416f06 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.165478 Nov 02 23:16:13.837582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 866/1441] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:13 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:13.841968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-953b01c4-4d11-462c-b72c-6d83b9b28702 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:13.842909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-953b01c4-4d11-462c-b72c-6d83b9b28702 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:13.848904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-953b01c4-4d11-462c-b72c-6d83b9b28702 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:13.849353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-953b01c4-4d11-462c-b72c-6d83b9b28702 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:13.850136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-953b01c4-4d11-462c-b72c-6d83b9b28702 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:13.850572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-953b01c4-4d11-462c-b72c-6d83b9b28702 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:13.884844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-953b01c4-4d11-462c-b72c-6d83b9b28702 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046148 Nov 02 23:16:13.885468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 867/1442] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:13 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:13.890351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-edcb5cc5-06bc-482c-8713-0c7779815d9e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:13.891429 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-edcb5cc5-06bc-482c-8713-0c7779815d9e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:13.900704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-edcb5cc5-06bc-482c-8713-0c7779815d9e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:13.901504 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-edcb5cc5-06bc-482c-8713-0c7779815d9e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:13.902734 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-edcb5cc5-06bc-482c-8713-0c7779815d9e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:13.903570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-edcb5cc5-06bc-482c-8713-0c7779815d9e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:13.942942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-edcb5cc5-06bc-482c-8713-0c7779815d9e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056287 Nov 02 23:16:13.943809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 868/1443] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:13 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:14.855661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e583fa11-0808-4a5a-a1a9-df94247950c4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:14.856395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e583fa11-0808-4a5a-a1a9-df94247950c4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:14.863526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e583fa11-0808-4a5a-a1a9-df94247950c4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:14.864016 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e583fa11-0808-4a5a-a1a9-df94247950c4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:14.864853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e583fa11-0808-4a5a-a1a9-df94247950c4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:14.865325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e583fa11-0808-4a5a-a1a9-df94247950c4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:15.010743 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e583fa11-0808-4a5a-a1a9-df94247950c4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:15.019220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e583fa11-0808-4a5a-a1a9-df94247950c4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:15.020711 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e583fa11-0808-4a5a-a1a9-df94247950c4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:15.021879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e583fa11-0808-4a5a-a1a9-df94247950c4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.170677 Nov 02 23:16:15.022441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 869/1444] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:14 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:15.027636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-caa2cef0-75dc-438a-b227-4a6f08395a73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:15.028551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-caa2cef0-75dc-438a-b227-4a6f08395a73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:15.034448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-caa2cef0-75dc-438a-b227-4a6f08395a73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:15.034903 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-caa2cef0-75dc-438a-b227-4a6f08395a73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:15.035718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-caa2cef0-75dc-438a-b227-4a6f08395a73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:15.036155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-caa2cef0-75dc-438a-b227-4a6f08395a73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:15.068215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-caa2cef0-75dc-438a-b227-4a6f08395a73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044615 Nov 02 23:16:15.068787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 870/1445] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:15 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:15.073927 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3a0e8224-475b-4664-94cc-a2d4904aa2e3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:15.074832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3a0e8224-475b-4664-94cc-a2d4904aa2e3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:15.081043 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a0e8224-475b-4664-94cc-a2d4904aa2e3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:15.081488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a0e8224-475b-4664-94cc-a2d4904aa2e3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:15.082273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a0e8224-475b-4664-94cc-a2d4904aa2e3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:15.082708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a0e8224-475b-4664-94cc-a2d4904aa2e3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:15.113100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3a0e8224-475b-4664-94cc-a2d4904aa2e3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043258 Nov 02 23:16:15.113673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 871/1446] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:15 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:16.041437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1ee9d67e-4d4e-4df6-a67d-c05b6d0781ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:16.042046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1ee9d67e-4d4e-4df6-a67d-c05b6d0781ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:16.048279 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ee9d67e-4d4e-4df6-a67d-c05b6d0781ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:16.048861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ee9d67e-4d4e-4df6-a67d-c05b6d0781ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:16.049594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ee9d67e-4d4e-4df6-a67d-c05b6d0781ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:16.050036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ee9d67e-4d4e-4df6-a67d-c05b6d0781ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:16.184634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1ee9d67e-4d4e-4df6-a67d-c05b6d0781ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:16.192882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1ee9d67e-4d4e-4df6-a67d-c05b6d0781ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:16.194351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1ee9d67e-4d4e-4df6-a67d-c05b6d0781ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:16.195515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1ee9d67e-4d4e-4df6-a67d-c05b6d0781ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.158440 Nov 02 23:16:16.196088 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 872/1447] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:16 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:16.200484 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0e30cca6-6f2a-4f62-b875-9ef01d33cecf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:16.201628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0e30cca6-6f2a-4f62-b875-9ef01d33cecf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:16.208043 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e30cca6-6f2a-4f62-b875-9ef01d33cecf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:16.208491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e30cca6-6f2a-4f62-b875-9ef01d33cecf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:16.209266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e30cca6-6f2a-4f62-b875-9ef01d33cecf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:16.209670 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e30cca6-6f2a-4f62-b875-9ef01d33cecf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:16.239426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0e30cca6-6f2a-4f62-b875-9ef01d33cecf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042268 Nov 02 23:16:16.240000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 873/1448] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:16 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:16.244396 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-df2dc868-f65f-4be4-bf4e-80717afd7730 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:16.245381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-df2dc868-f65f-4be4-bf4e-80717afd7730 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:16.251730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-df2dc868-f65f-4be4-bf4e-80717afd7730 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:16.252222 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-df2dc868-f65f-4be4-bf4e-80717afd7730 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:16.253034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-df2dc868-f65f-4be4-bf4e-80717afd7730 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:16.253497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-df2dc868-f65f-4be4-bf4e-80717afd7730 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:16.285430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-df2dc868-f65f-4be4-bf4e-80717afd7730 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044366 Nov 02 23:16:16.286011 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 874/1449] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:16 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:17.213599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-61d55c6c-674e-4b60-af4a-03657a2d609d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:17.214199 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-61d55c6c-674e-4b60-af4a-03657a2d609d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:17.220447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-61d55c6c-674e-4b60-af4a-03657a2d609d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:17.220881 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-61d55c6c-674e-4b60-af4a-03657a2d609d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:17.221643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-61d55c6c-674e-4b60-af4a-03657a2d609d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:17.222067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-61d55c6c-674e-4b60-af4a-03657a2d609d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:17.360887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-61d55c6c-674e-4b60-af4a-03657a2d609d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:17.370690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-61d55c6c-674e-4b60-af4a-03657a2d609d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:17.372222 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-61d55c6c-674e-4b60-af4a-03657a2d609d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:17.373399 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-61d55c6c-674e-4b60-af4a-03657a2d609d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.163584 Nov 02 23:16:17.373969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 875/1450] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:17 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:17.381058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3b91079f-8d50-4e01-bcdf-6ed0cc727ad4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:17.382609 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3b91079f-8d50-4e01-bcdf-6ed0cc727ad4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:17.392396 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b91079f-8d50-4e01-bcdf-6ed0cc727ad4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:17.392943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b91079f-8d50-4e01-bcdf-6ed0cc727ad4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:17.393767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b91079f-8d50-4e01-bcdf-6ed0cc727ad4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:17.394192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b91079f-8d50-4e01-bcdf-6ed0cc727ad4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:17.424254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3b91079f-8d50-4e01-bcdf-6ed0cc727ad4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049247 Nov 02 23:16:17.424820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 876/1451] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:17 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:17.429126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6d122a38-9213-4685-982c-97be1faa81e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:17.430013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6d122a38-9213-4685-982c-97be1faa81e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:17.436426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6d122a38-9213-4685-982c-97be1faa81e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:17.436860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6d122a38-9213-4685-982c-97be1faa81e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:17.437622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6d122a38-9213-4685-982c-97be1faa81e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:17.438044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6d122a38-9213-4685-982c-97be1faa81e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:17.467170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6d122a38-9213-4685-982c-97be1faa81e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041280 Nov 02 23:16:17.467735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 877/1452] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:17 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:18.391879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-21d72dc0-8fb3-4036-9b8a-765894dd7ab7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:18.392522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-21d72dc0-8fb3-4036-9b8a-765894dd7ab7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:18.398723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21d72dc0-8fb3-4036-9b8a-765894dd7ab7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:18.399225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21d72dc0-8fb3-4036-9b8a-765894dd7ab7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:18.399998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21d72dc0-8fb3-4036-9b8a-765894dd7ab7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:18.400426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21d72dc0-8fb3-4036-9b8a-765894dd7ab7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:18.534460 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-21d72dc0-8fb3-4036-9b8a-765894dd7ab7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:18.542685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-21d72dc0-8fb3-4036-9b8a-765894dd7ab7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:18.544192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-21d72dc0-8fb3-4036-9b8a-765894dd7ab7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:18.545333 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-21d72dc0-8fb3-4036-9b8a-765894dd7ab7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.157177 Nov 02 23:16:18.545886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 878/1453] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:18 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:18.550124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ba757f13-6df4-4d9a-805c-b1a23365d579 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:18.551047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ba757f13-6df4-4d9a-805c-b1a23365d579 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:18.557544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ba757f13-6df4-4d9a-805c-b1a23365d579 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:18.557986 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ba757f13-6df4-4d9a-805c-b1a23365d579 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:18.558761 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ba757f13-6df4-4d9a-805c-b1a23365d579 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:18.559230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ba757f13-6df4-4d9a-805c-b1a23365d579 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:18.589440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ba757f13-6df4-4d9a-805c-b1a23365d579 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042509 Nov 02 23:16:18.590026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 879/1454] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:18 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:18.594394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1ef3050b-e234-4287-9e21-a47615507d63 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:18.595315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1ef3050b-e234-4287-9e21-a47615507d63 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:18.601081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ef3050b-e234-4287-9e21-a47615507d63 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:18.601529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ef3050b-e234-4287-9e21-a47615507d63 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:18.602826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ef3050b-e234-4287-9e21-a47615507d63 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:18.603299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ef3050b-e234-4287-9e21-a47615507d63 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:18.632090 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1ef3050b-e234-4287-9e21-a47615507d63 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041039 Nov 02 23:16:18.632659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 880/1455] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:18 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:19.564687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-93209c55-8d34-40cf-985a-1dc7f2265d4c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:19.565367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-93209c55-8d34-40cf-985a-1dc7f2265d4c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:19.572149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93209c55-8d34-40cf-985a-1dc7f2265d4c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:19.572588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93209c55-8d34-40cf-985a-1dc7f2265d4c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:19.573369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93209c55-8d34-40cf-985a-1dc7f2265d4c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:19.573792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93209c55-8d34-40cf-985a-1dc7f2265d4c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:19.709404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-93209c55-8d34-40cf-985a-1dc7f2265d4c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:19.718513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-93209c55-8d34-40cf-985a-1dc7f2265d4c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:19.720053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-93209c55-8d34-40cf-985a-1dc7f2265d4c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:19.721256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-93209c55-8d34-40cf-985a-1dc7f2265d4c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.160326 Nov 02 23:16:19.721813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 881/1456] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:19 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:19.726407 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-eebb8aca-38a7-4b8d-87ee-8a03231d7ae2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:19.727382 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-eebb8aca-38a7-4b8d-87ee-8a03231d7ae2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:19.733637 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eebb8aca-38a7-4b8d-87ee-8a03231d7ae2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:19.734082 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eebb8aca-38a7-4b8d-87ee-8a03231d7ae2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:19.734903 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eebb8aca-38a7-4b8d-87ee-8a03231d7ae2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:19.737444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eebb8aca-38a7-4b8d-87ee-8a03231d7ae2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:19.769166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-eebb8aca-38a7-4b8d-87ee-8a03231d7ae2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046082 Nov 02 23:16:19.769870 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 882/1457] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:19 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:19.774892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c61a7806-323b-436e-82a9-463dcfd054ed tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:19.775794 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c61a7806-323b-436e-82a9-463dcfd054ed tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:19.782353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c61a7806-323b-436e-82a9-463dcfd054ed tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:19.782792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c61a7806-323b-436e-82a9-463dcfd054ed tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:19.783596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c61a7806-323b-436e-82a9-463dcfd054ed tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:19.784021 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c61a7806-323b-436e-82a9-463dcfd054ed tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:19.813779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c61a7806-323b-436e-82a9-463dcfd054ed tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042874 Nov 02 23:16:19.814391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 883/1458] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:19 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:20.740881 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7f65a40c-f187-4bbf-9ec4-eb47876f781e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:20.741523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7f65a40c-f187-4bbf-9ec4-eb47876f781e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:20.748233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f65a40c-f187-4bbf-9ec4-eb47876f781e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:20.748681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f65a40c-f187-4bbf-9ec4-eb47876f781e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:20.749461 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f65a40c-f187-4bbf-9ec4-eb47876f781e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:20.749891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f65a40c-f187-4bbf-9ec4-eb47876f781e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:20.878893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7f65a40c-f187-4bbf-9ec4-eb47876f781e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:20.887550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7f65a40c-f187-4bbf-9ec4-eb47876f781e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:20.889017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7f65a40c-f187-4bbf-9ec4-eb47876f781e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:20.890147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7f65a40c-f187-4bbf-9ec4-eb47876f781e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.153019 Nov 02 23:16:20.890697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 884/1459] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:20 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:16:20.894974 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2064fb0f-e934-42e2-9034-36fdb6d7d613 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:20.895888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2064fb0f-e934-42e2-9034-36fdb6d7d613 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:20.901889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2064fb0f-e934-42e2-9034-36fdb6d7d613 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:20.902340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2064fb0f-e934-42e2-9034-36fdb6d7d613 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:20.903136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2064fb0f-e934-42e2-9034-36fdb6d7d613 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:20.903563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2064fb0f-e934-42e2-9034-36fdb6d7d613 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:20.931238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2064fb0f-e934-42e2-9034-36fdb6d7d613 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039494 Nov 02 23:16:20.931784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 885/1460] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:20 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:20.936034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-17965353-f635-4042-8498-d28d5d0251ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:20.936846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-17965353-f635-4042-8498-d28d5d0251ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:20.942093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17965353-f635-4042-8498-d28d5d0251ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:20.942531 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17965353-f635-4042-8498-d28d5d0251ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:20.943322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17965353-f635-4042-8498-d28d5d0251ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:20.943781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17965353-f635-4042-8498-d28d5d0251ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:20.972481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-17965353-f635-4042-8498-d28d5d0251ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039722 Nov 02 23:16:20.973023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 886/1461] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:20 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:21.908832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-955c7a4a-7875-452f-add4-f3cfd38d0683 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:21.909489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-955c7a4a-7875-452f-add4-f3cfd38d0683 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:21.915639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-955c7a4a-7875-452f-add4-f3cfd38d0683 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:21.916086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-955c7a4a-7875-452f-add4-f3cfd38d0683 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:21.916856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-955c7a4a-7875-452f-add4-f3cfd38d0683 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:21.917290 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-955c7a4a-7875-452f-add4-f3cfd38d0683 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:22.051745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-955c7a4a-7875-452f-add4-f3cfd38d0683 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:22.060486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-955c7a4a-7875-452f-add4-f3cfd38d0683 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:22.061958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-955c7a4a-7875-452f-add4-f3cfd38d0683 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:22.063171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-955c7a4a-7875-452f-add4-f3cfd38d0683 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.158166 Nov 02 23:16:22.063714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 887/1462] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:21 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:22.068101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ff7a401d-25ab-49fa-bca0-159a43aa80b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:22.068987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ff7a401d-25ab-49fa-bca0-159a43aa80b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:22.074946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff7a401d-25ab-49fa-bca0-159a43aa80b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:22.075397 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff7a401d-25ab-49fa-bca0-159a43aa80b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:22.076168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff7a401d-25ab-49fa-bca0-159a43aa80b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:22.076963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff7a401d-25ab-49fa-bca0-159a43aa80b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:22.106810 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ff7a401d-25ab-49fa-bca0-159a43aa80b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042064 Nov 02 23:16:22.110470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 888/1463] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:22 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:22.112148 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b7f80d7b-ddd4-41e8-a8d3-d63a38b0c04a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:22.113040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b7f80d7b-ddd4-41e8-a8d3-d63a38b0c04a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:22.120623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b7f80d7b-ddd4-41e8-a8d3-d63a38b0c04a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:22.121071 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b7f80d7b-ddd4-41e8-a8d3-d63a38b0c04a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:22.121841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b7f80d7b-ddd4-41e8-a8d3-d63a38b0c04a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:22.122268 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b7f80d7b-ddd4-41e8-a8d3-d63a38b0c04a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:22.151752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b7f80d7b-ddd4-41e8-a8d3-d63a38b0c04a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042935 Nov 02 23:16:22.152639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 889/1464] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:22 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:23.081693 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4a4181de-1ba2-4572-ba69-c58b067fe668 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:23.082375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4a4181de-1ba2-4572-ba69-c58b067fe668 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:23.089263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a4181de-1ba2-4572-ba69-c58b067fe668 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:23.089709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a4181de-1ba2-4572-ba69-c58b067fe668 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:23.090486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a4181de-1ba2-4572-ba69-c58b067fe668 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:23.090934 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a4181de-1ba2-4572-ba69-c58b067fe668 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:23.222199 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4a4181de-1ba2-4572-ba69-c58b067fe668 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:23.230527 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4a4181de-1ba2-4572-ba69-c58b067fe668 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:23.232024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4a4181de-1ba2-4572-ba69-c58b067fe668 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:23.233183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4a4181de-1ba2-4572-ba69-c58b067fe668 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.155273 Nov 02 23:16:23.233737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 890/1465] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:23 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:23.238238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-52658968-160b-427b-bee7-9c2bd31aeedd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:23.239167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-52658968-160b-427b-bee7-9c2bd31aeedd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:23.244849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52658968-160b-427b-bee7-9c2bd31aeedd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:23.245293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52658968-160b-427b-bee7-9c2bd31aeedd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:23.246055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52658968-160b-427b-bee7-9c2bd31aeedd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:23.246482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52658968-160b-427b-bee7-9c2bd31aeedd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:23.277047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-52658968-160b-427b-bee7-9c2bd31aeedd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042224 Nov 02 23:16:23.277607 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 891/1466] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:23 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:23.282019 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3a603989-4ab9-4fef-b3a2-c23d520cdd17 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:23.282897 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3a603989-4ab9-4fef-b3a2-c23d520cdd17 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:23.288380 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a603989-4ab9-4fef-b3a2-c23d520cdd17 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:23.288823 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a603989-4ab9-4fef-b3a2-c23d520cdd17 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:23.289694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a603989-4ab9-4fef-b3a2-c23d520cdd17 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:23.290049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a603989-4ab9-4fef-b3a2-c23d520cdd17 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:23.317664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3a603989-4ab9-4fef-b3a2-c23d520cdd17 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039087 Nov 02 23:16:23.318213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 892/1467] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:23 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:24.251426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5b9bc746-5a54-4fbd-a373-9d597ad69d79 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:24.252524 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5b9bc746-5a54-4fbd-a373-9d597ad69d79 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:24.260749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b9bc746-5a54-4fbd-a373-9d597ad69d79 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:24.261260 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b9bc746-5a54-4fbd-a373-9d597ad69d79 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:24.262139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b9bc746-5a54-4fbd-a373-9d597ad69d79 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:24.262567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b9bc746-5a54-4fbd-a373-9d597ad69d79 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:24.407305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5b9bc746-5a54-4fbd-a373-9d597ad69d79 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:24.415753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5b9bc746-5a54-4fbd-a373-9d597ad69d79 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:24.417274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5b9bc746-5a54-4fbd-a373-9d597ad69d79 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:24.418439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5b9bc746-5a54-4fbd-a373-9d597ad69d79 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.170737 Nov 02 23:16:24.419012 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 893/1468] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:24 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:16:24.424069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-03b2736c-d5ac-453d-9839-b74b7498164c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:24.424740 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-03b2736c-d5ac-453d-9839-b74b7498164c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:24.430862 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03b2736c-d5ac-453d-9839-b74b7498164c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:24.431349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03b2736c-d5ac-453d-9839-b74b7498164c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:24.432121 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03b2736c-d5ac-453d-9839-b74b7498164c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:24.432537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03b2736c-d5ac-453d-9839-b74b7498164c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:24.463252 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-03b2736c-d5ac-453d-9839-b74b7498164c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043073 Nov 02 23:16:24.463727 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 894/1469] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:24 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:24.468231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-eef00a94-3391-4454-8528-da49663e1704 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:24.469132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-eef00a94-3391-4454-8528-da49663e1704 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:24.474893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eef00a94-3391-4454-8528-da49663e1704 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:24.475358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eef00a94-3391-4454-8528-da49663e1704 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:24.476126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eef00a94-3391-4454-8528-da49663e1704 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:24.476550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eef00a94-3391-4454-8528-da49663e1704 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:24.506154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-eef00a94-3391-4454-8528-da49663e1704 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041325 Nov 02 23:16:24.506722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 895/1470] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:24 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:25.437254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dfb42c22-6d67-4e5c-9caf-0fd5a6459b8d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:25.437956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dfb42c22-6d67-4e5c-9caf-0fd5a6459b8d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:25.444184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dfb42c22-6d67-4e5c-9caf-0fd5a6459b8d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:25.444627 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dfb42c22-6d67-4e5c-9caf-0fd5a6459b8d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:25.445380 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dfb42c22-6d67-4e5c-9caf-0fd5a6459b8d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:25.445870 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dfb42c22-6d67-4e5c-9caf-0fd5a6459b8d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:25.585726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dfb42c22-6d67-4e5c-9caf-0fd5a6459b8d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:25.593991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dfb42c22-6d67-4e5c-9caf-0fd5a6459b8d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:25.595546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dfb42c22-6d67-4e5c-9caf-0fd5a6459b8d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:25.596704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dfb42c22-6d67-4e5c-9caf-0fd5a6459b8d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.163188 Nov 02 23:16:25.597271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 896/1471] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:25 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:25.601624 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2870a438-bb93-4623-ad2d-ef3695c18128 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:25.603097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2870a438-bb93-4623-ad2d-ef3695c18128 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:25.608949 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2870a438-bb93-4623-ad2d-ef3695c18128 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:25.609399 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2870a438-bb93-4623-ad2d-ef3695c18128 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:25.610177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2870a438-bb93-4623-ad2d-ef3695c18128 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:25.610610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2870a438-bb93-4623-ad2d-ef3695c18128 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:25.640283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2870a438-bb93-4623-ad2d-ef3695c18128 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041974 Nov 02 23:16:25.641093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 897/1472] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:25 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:25.645225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5e2d9c54-da71-4f0c-a33d-ccd7efb8b3b6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:25.646161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5e2d9c54-da71-4f0c-a33d-ccd7efb8b3b6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:25.658454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5e2d9c54-da71-4f0c-a33d-ccd7efb8b3b6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:25.659052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5e2d9c54-da71-4f0c-a33d-ccd7efb8b3b6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:25.660105 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5e2d9c54-da71-4f0c-a33d-ccd7efb8b3b6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:25.660539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5e2d9c54-da71-4f0c-a33d-ccd7efb8b3b6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:25.690600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5e2d9c54-da71-4f0c-a33d-ccd7efb8b3b6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048719 Nov 02 23:16:25.691190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 898/1473] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:25 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:26.615290 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c8d91865-66ae-4aab-8d4d-b7fbe84e516e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:26.615941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c8d91865-66ae-4aab-8d4d-b7fbe84e516e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:26.621959 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8d91865-66ae-4aab-8d4d-b7fbe84e516e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:26.622407 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8d91865-66ae-4aab-8d4d-b7fbe84e516e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:26.623216 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8d91865-66ae-4aab-8d4d-b7fbe84e516e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:26.623653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8d91865-66ae-4aab-8d4d-b7fbe84e516e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:26.764530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c8d91865-66ae-4aab-8d4d-b7fbe84e516e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:26.772769 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c8d91865-66ae-4aab-8d4d-b7fbe84e516e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:26.774755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c8d91865-66ae-4aab-8d4d-b7fbe84e516e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:26.775920 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c8d91865-66ae-4aab-8d4d-b7fbe84e516e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.164315 Nov 02 23:16:26.776478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 899/1474] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:26 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:26.780924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-97fa1b74-d558-40cd-99d7-885436705975 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:26.781890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-97fa1b74-d558-40cd-99d7-885436705975 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:26.787773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-97fa1b74-d558-40cd-99d7-885436705975 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:26.788215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-97fa1b74-d558-40cd-99d7-885436705975 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:26.788983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-97fa1b74-d558-40cd-99d7-885436705975 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:26.789409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-97fa1b74-d558-40cd-99d7-885436705975 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:26.817926 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-97fa1b74-d558-40cd-99d7-885436705975 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040453 Nov 02 23:16:26.818474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 900/1475] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:26 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:26.823006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bc164e9d-e56e-4aed-8bd5-eec4c3e4ddb2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:26.823884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bc164e9d-e56e-4aed-8bd5-eec4c3e4ddb2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:26.829566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc164e9d-e56e-4aed-8bd5-eec4c3e4ddb2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:26.830003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc164e9d-e56e-4aed-8bd5-eec4c3e4ddb2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:26.830758 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc164e9d-e56e-4aed-8bd5-eec4c3e4ddb2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:26.831211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc164e9d-e56e-4aed-8bd5-eec4c3e4ddb2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:26.859708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bc164e9d-e56e-4aed-8bd5-eec4c3e4ddb2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040165 Nov 02 23:16:26.860249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 901/1476] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:26 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:27.793530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2eb3bb04-68eb-486e-8202-b13e25c04641 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:27.794176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2eb3bb04-68eb-486e-8202-b13e25c04641 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:27.800506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2eb3bb04-68eb-486e-8202-b13e25c04641 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:27.800960 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2eb3bb04-68eb-486e-8202-b13e25c04641 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:27.801744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2eb3bb04-68eb-486e-8202-b13e25c04641 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:27.802181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2eb3bb04-68eb-486e-8202-b13e25c04641 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:27.940935 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2eb3bb04-68eb-486e-8202-b13e25c04641 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:27.950499 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2eb3bb04-68eb-486e-8202-b13e25c04641 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:27.952290 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2eb3bb04-68eb-486e-8202-b13e25c04641 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:27.953476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2eb3bb04-68eb-486e-8202-b13e25c04641 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.163824 Nov 02 23:16:27.954048 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 902/1477] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:27 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:27.958742 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ee590dd5-7e54-466f-9c34-4c2943693d0d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:27.959687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ee590dd5-7e54-466f-9c34-4c2943693d0d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:27.966168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ee590dd5-7e54-466f-9c34-4c2943693d0d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:27.966604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ee590dd5-7e54-466f-9c34-4c2943693d0d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:27.967408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ee590dd5-7e54-466f-9c34-4c2943693d0d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:27.967846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ee590dd5-7e54-466f-9c34-4c2943693d0d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:27.996861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ee590dd5-7e54-466f-9c34-4c2943693d0d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041777 Nov 02 23:16:27.997430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 903/1478] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:27 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:28.001809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-982ef979-2d2e-4590-b13d-0993356eeb7e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:28.002710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-982ef979-2d2e-4590-b13d-0993356eeb7e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:28.009373 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-982ef979-2d2e-4590-b13d-0993356eeb7e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:28.009820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-982ef979-2d2e-4590-b13d-0993356eeb7e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:28.010609 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-982ef979-2d2e-4590-b13d-0993356eeb7e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:28.011087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-982ef979-2d2e-4590-b13d-0993356eeb7e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:28.040867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-982ef979-2d2e-4590-b13d-0993356eeb7e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042386 Nov 02 23:16:28.041446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 904/1479] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:27 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:28.971748 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-227c4302-bb3e-473c-83b4-99a4c7338ea0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:28.972403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-227c4302-bb3e-473c-83b4-99a4c7338ea0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:28.978701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-227c4302-bb3e-473c-83b4-99a4c7338ea0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:28.979187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-227c4302-bb3e-473c-83b4-99a4c7338ea0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:28.979955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-227c4302-bb3e-473c-83b4-99a4c7338ea0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:28.980379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-227c4302-bb3e-473c-83b4-99a4c7338ea0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:29.110579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-227c4302-bb3e-473c-83b4-99a4c7338ea0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:29.119208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-227c4302-bb3e-473c-83b4-99a4c7338ea0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:29.120694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-227c4302-bb3e-473c-83b4-99a4c7338ea0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:29.121842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-227c4302-bb3e-473c-83b4-99a4c7338ea0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.153785 Nov 02 23:16:29.122400 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 905/1480] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:28 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:29.126688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ec75268e-0ec0-4264-a8de-b1426acf6ba9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:29.127604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ec75268e-0ec0-4264-a8de-b1426acf6ba9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:29.133036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec75268e-0ec0-4264-a8de-b1426acf6ba9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:29.133480 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec75268e-0ec0-4264-a8de-b1426acf6ba9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:29.134237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec75268e-0ec0-4264-a8de-b1426acf6ba9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:29.134671 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec75268e-0ec0-4264-a8de-b1426acf6ba9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:29.162280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ec75268e-0ec0-4264-a8de-b1426acf6ba9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038897 Nov 02 23:16:29.162828 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 906/1481] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:29 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:29.167577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6a26873c-e586-459e-87e5-7410700fff49 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:29.168447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6a26873c-e586-459e-87e5-7410700fff49 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:29.173792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a26873c-e586-459e-87e5-7410700fff49 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:29.174232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a26873c-e586-459e-87e5-7410700fff49 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:29.175020 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a26873c-e586-459e-87e5-7410700fff49 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:29.175449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a26873c-e586-459e-87e5-7410700fff49 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:29.203871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6a26873c-e586-459e-87e5-7410700fff49 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040002 Nov 02 23:16:29.204432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 907/1482] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:29 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:30.139715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d1cd2c51-bf72-4954-bf25-4bb65c2df3ae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:30.140449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d1cd2c51-bf72-4954-bf25-4bb65c2df3ae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:30.146304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d1cd2c51-bf72-4954-bf25-4bb65c2df3ae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:30.146754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d1cd2c51-bf72-4954-bf25-4bb65c2df3ae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:30.147575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d1cd2c51-bf72-4954-bf25-4bb65c2df3ae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:30.148012 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d1cd2c51-bf72-4954-bf25-4bb65c2df3ae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:30.295381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d1cd2c51-bf72-4954-bf25-4bb65c2df3ae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:30.303738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d1cd2c51-bf72-4954-bf25-4bb65c2df3ae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:30.305732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d1cd2c51-bf72-4954-bf25-4bb65c2df3ae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:30.306877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d1cd2c51-bf72-4954-bf25-4bb65c2df3ae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.170970 Nov 02 23:16:30.307459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 908/1483] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:30 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:30.311852 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7ac31faa-c208-4a6b-9a73-54dd3eef30e9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:30.312752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7ac31faa-c208-4a6b-9a73-54dd3eef30e9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:30.318481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ac31faa-c208-4a6b-9a73-54dd3eef30e9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:30.318941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ac31faa-c208-4a6b-9a73-54dd3eef30e9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:30.319710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ac31faa-c208-4a6b-9a73-54dd3eef30e9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:30.320133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ac31faa-c208-4a6b-9a73-54dd3eef30e9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:30.349602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7ac31faa-c208-4a6b-9a73-54dd3eef30e9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041158 Nov 02 23:16:30.350148 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 909/1484] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:30 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:30.354986 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ae373262-30fd-46ad-b121-8397b7f3d2a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:30.355855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ae373262-30fd-46ad-b121-8397b7f3d2a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:30.361327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ae373262-30fd-46ad-b121-8397b7f3d2a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:30.361763 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ae373262-30fd-46ad-b121-8397b7f3d2a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:30.362551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ae373262-30fd-46ad-b121-8397b7f3d2a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:30.363008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ae373262-30fd-46ad-b121-8397b7f3d2a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:30.391110 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ae373262-30fd-46ad-b121-8397b7f3d2a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039948 Nov 02 23:16:30.391654 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 910/1485] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:30 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:31.325134 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6bdacdd8-0f0c-447e-9cfa-38d29cb72ecd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:31.325784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6bdacdd8-0f0c-447e-9cfa-38d29cb72ecd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:31.332076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6bdacdd8-0f0c-447e-9cfa-38d29cb72ecd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:31.332515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6bdacdd8-0f0c-447e-9cfa-38d29cb72ecd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:31.333304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6bdacdd8-0f0c-447e-9cfa-38d29cb72ecd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:31.333736 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6bdacdd8-0f0c-447e-9cfa-38d29cb72ecd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:31.470657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6bdacdd8-0f0c-447e-9cfa-38d29cb72ecd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:31.480023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6bdacdd8-0f0c-447e-9cfa-38d29cb72ecd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:31.481601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6bdacdd8-0f0c-447e-9cfa-38d29cb72ecd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:31.482851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6bdacdd8-0f0c-447e-9cfa-38d29cb72ecd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.161475 Nov 02 23:16:31.483473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 911/1486] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:31 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:31.488482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-11121e5b-f87f-4c02-aae5-bee5f7a62881 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:31.489432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-11121e5b-f87f-4c02-aae5-bee5f7a62881 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:31.497499 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-11121e5b-f87f-4c02-aae5-bee5f7a62881 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:31.497951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-11121e5b-f87f-4c02-aae5-bee5f7a62881 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:31.498768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-11121e5b-f87f-4c02-aae5-bee5f7a62881 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:31.499275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-11121e5b-f87f-4c02-aae5-bee5f7a62881 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:31.545753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-11121e5b-f87f-4c02-aae5-bee5f7a62881 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061184 Nov 02 23:16:31.546350 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 912/1487] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:31 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:31.554737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-290e4a85-69b0-4cb7-b819-fca5d5050887 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:31.555773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-290e4a85-69b0-4cb7-b819-fca5d5050887 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:31.561742 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-290e4a85-69b0-4cb7-b819-fca5d5050887 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:31.562187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-290e4a85-69b0-4cb7-b819-fca5d5050887 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:31.562984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-290e4a85-69b0-4cb7-b819-fca5d5050887 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:31.563419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-290e4a85-69b0-4cb7-b819-fca5d5050887 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:31.594678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-290e4a85-69b0-4cb7-b819-fca5d5050887 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043577 Nov 02 23:16:31.595269 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 913/1488] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:31 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:32.501314 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0a5a4e49-58ec-448a-8827-8cf71b0d66a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:32.502065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0a5a4e49-58ec-448a-8827-8cf71b0d66a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:32.508809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0a5a4e49-58ec-448a-8827-8cf71b0d66a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:32.509258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0a5a4e49-58ec-448a-8827-8cf71b0d66a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:32.510025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0a5a4e49-58ec-448a-8827-8cf71b0d66a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:32.510447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0a5a4e49-58ec-448a-8827-8cf71b0d66a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:32.646312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0a5a4e49-58ec-448a-8827-8cf71b0d66a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:32.654818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0a5a4e49-58ec-448a-8827-8cf71b0d66a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:32.656329 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0a5a4e49-58ec-448a-8827-8cf71b0d66a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:32.657483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0a5a4e49-58ec-448a-8827-8cf71b0d66a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.159902 Nov 02 23:16:32.658046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 914/1489] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:32 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:32.662299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a788e4f2-6152-43a9-a896-e456638f9a7c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:32.663220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a788e4f2-6152-43a9-a896-e456638f9a7c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:32.668780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a788e4f2-6152-43a9-a896-e456638f9a7c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:32.669258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a788e4f2-6152-43a9-a896-e456638f9a7c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:32.670031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a788e4f2-6152-43a9-a896-e456638f9a7c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:32.670465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a788e4f2-6152-43a9-a896-e456638f9a7c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:32.700152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a788e4f2-6152-43a9-a896-e456638f9a7c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041088 Nov 02 23:16:32.700707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 915/1490] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:32 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:32.705295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e703fb5f-a7b7-42cf-a84f-ac8a7dc86114 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:32.706177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e703fb5f-a7b7-42cf-a84f-ac8a7dc86114 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:32.713064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e703fb5f-a7b7-42cf-a84f-ac8a7dc86114 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:32.713510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e703fb5f-a7b7-42cf-a84f-ac8a7dc86114 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:32.714283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e703fb5f-a7b7-42cf-a84f-ac8a7dc86114 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:32.714714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e703fb5f-a7b7-42cf-a84f-ac8a7dc86114 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:32.743533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e703fb5f-a7b7-42cf-a84f-ac8a7dc86114 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041537 Nov 02 23:16:32.744131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 916/1491] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:32 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:33.675801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bf6c0d54-71bc-4086-b2bc-524814d0e9be tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:33.676472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bf6c0d54-71bc-4086-b2bc-524814d0e9be tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:33.683195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf6c0d54-71bc-4086-b2bc-524814d0e9be tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:33.683671 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf6c0d54-71bc-4086-b2bc-524814d0e9be tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:33.684446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf6c0d54-71bc-4086-b2bc-524814d0e9be tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:33.684880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf6c0d54-71bc-4086-b2bc-524814d0e9be tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:33.813808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bf6c0d54-71bc-4086-b2bc-524814d0e9be tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:33.822493 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bf6c0d54-71bc-4086-b2bc-524814d0e9be tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:33.823991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bf6c0d54-71bc-4086-b2bc-524814d0e9be tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:33.825137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bf6c0d54-71bc-4086-b2bc-524814d0e9be tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.153108 Nov 02 23:16:33.825691 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 917/1492] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:33 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:33.830351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b69872fa-26ef-481b-87d9-02895f32e062 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:33.831359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b69872fa-26ef-481b-87d9-02895f32e062 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:33.837967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b69872fa-26ef-481b-87d9-02895f32e062 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:33.838409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b69872fa-26ef-481b-87d9-02895f32e062 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:33.839253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b69872fa-26ef-481b-87d9-02895f32e062 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:33.839683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b69872fa-26ef-481b-87d9-02895f32e062 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:33.868442 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b69872fa-26ef-481b-87d9-02895f32e062 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041482 Nov 02 23:16:33.868987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 918/1493] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:33 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:33.873195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-605ec0d1-105c-43bb-ab35-44427e6e20aa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:33.874076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-605ec0d1-105c-43bb-ab35-44427e6e20aa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:33.879502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-605ec0d1-105c-43bb-ab35-44427e6e20aa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:33.879885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-605ec0d1-105c-43bb-ab35-44427e6e20aa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:33.880639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-605ec0d1-105c-43bb-ab35-44427e6e20aa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:33.881060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-605ec0d1-105c-43bb-ab35-44427e6e20aa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:33.909274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-605ec0d1-105c-43bb-ab35-44427e6e20aa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039283 Nov 02 23:16:33.909837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 919/1494] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:33 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:34.845143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a683c5ea-ef74-4a19-9ae0-0e16dd3e77b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:34.845867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a683c5ea-ef74-4a19-9ae0-0e16dd3e77b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:34.852459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a683c5ea-ef74-4a19-9ae0-0e16dd3e77b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:34.852896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a683c5ea-ef74-4a19-9ae0-0e16dd3e77b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:34.853710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a683c5ea-ef74-4a19-9ae0-0e16dd3e77b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:34.854136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a683c5ea-ef74-4a19-9ae0-0e16dd3e77b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:34.983395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a683c5ea-ef74-4a19-9ae0-0e16dd3e77b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:34.991461 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a683c5ea-ef74-4a19-9ae0-0e16dd3e77b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:34.993461 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a683c5ea-ef74-4a19-9ae0-0e16dd3e77b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:34.994604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a683c5ea-ef74-4a19-9ae0-0e16dd3e77b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.153372 Nov 02 23:16:34.995178 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 920/1495] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:34 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:34.999421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b158d757-e359-4c41-b8c2-42a5d924b711 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:35.000303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b158d757-e359-4c41-b8c2-42a5d924b711 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:35.005967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b158d757-e359-4c41-b8c2-42a5d924b711 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:35.006406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b158d757-e359-4c41-b8c2-42a5d924b711 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:35.007189 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b158d757-e359-4c41-b8c2-42a5d924b711 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:35.007616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b158d757-e359-4c41-b8c2-42a5d924b711 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:35.036436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b158d757-e359-4c41-b8c2-42a5d924b711 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040242 Nov 02 23:16:35.036979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 921/1496] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:34 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:35.041243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-276cdee2-bf37-4754-822e-c1b38a4f9189 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:35.042120 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-276cdee2-bf37-4754-822e-c1b38a4f9189 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:35.048868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-276cdee2-bf37-4754-822e-c1b38a4f9189 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:35.049312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-276cdee2-bf37-4754-822e-c1b38a4f9189 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:35.050078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-276cdee2-bf37-4754-822e-c1b38a4f9189 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:35.050505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-276cdee2-bf37-4754-822e-c1b38a4f9189 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:35.083463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-276cdee2-bf37-4754-822e-c1b38a4f9189 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045434 Nov 02 23:16:35.084024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 922/1497] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:35 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:36.012716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-79273351-b547-4ae2-a9f1-da06d0398279 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:36.013342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-79273351-b547-4ae2-a9f1-da06d0398279 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:36.019538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79273351-b547-4ae2-a9f1-da06d0398279 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:36.019988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79273351-b547-4ae2-a9f1-da06d0398279 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:36.020762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79273351-b547-4ae2-a9f1-da06d0398279 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:36.021195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79273351-b547-4ae2-a9f1-da06d0398279 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:36.152139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-79273351-b547-4ae2-a9f1-da06d0398279 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:36.160430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-79273351-b547-4ae2-a9f1-da06d0398279 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:36.161924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-79273351-b547-4ae2-a9f1-da06d0398279 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:36.163122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-79273351-b547-4ae2-a9f1-da06d0398279 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.154188 Nov 02 23:16:36.163690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 923/1498] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:36 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:36.168634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-057d0e46-946e-4ff0-a662-d21359fc610e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:36.169537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-057d0e46-946e-4ff0-a662-d21359fc610e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:36.175440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-057d0e46-946e-4ff0-a662-d21359fc610e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:36.175891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-057d0e46-946e-4ff0-a662-d21359fc610e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:36.176668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-057d0e46-946e-4ff0-a662-d21359fc610e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:36.177099 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-057d0e46-946e-4ff0-a662-d21359fc610e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:36.207041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-057d0e46-946e-4ff0-a662-d21359fc610e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041772 Nov 02 23:16:36.207611 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 924/1499] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:36 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:36.212581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6bdcca9e-4ee3-4186-a0f8-50ac8682b0fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:36.213473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6bdcca9e-4ee3-4186-a0f8-50ac8682b0fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:36.219150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6bdcca9e-4ee3-4186-a0f8-50ac8682b0fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:36.219599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6bdcca9e-4ee3-4186-a0f8-50ac8682b0fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:36.220363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6bdcca9e-4ee3-4186-a0f8-50ac8682b0fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:36.220796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6bdcca9e-4ee3-4186-a0f8-50ac8682b0fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:36.249431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6bdcca9e-4ee3-4186-a0f8-50ac8682b0fe tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040803 Nov 02 23:16:36.249982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 925/1500] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:36 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:37.182506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-11c53876-486c-4e30-b623-997e32dbbfd5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:37.183171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-11c53876-486c-4e30-b623-997e32dbbfd5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:37.189411 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-11c53876-486c-4e30-b623-997e32dbbfd5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:37.189848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-11c53876-486c-4e30-b623-997e32dbbfd5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:37.190610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-11c53876-486c-4e30-b623-997e32dbbfd5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:37.191063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-11c53876-486c-4e30-b623-997e32dbbfd5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:37.321622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-11c53876-486c-4e30-b623-997e32dbbfd5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:37.329990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-11c53876-486c-4e30-b623-997e32dbbfd5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:37.331490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-11c53876-486c-4e30-b623-997e32dbbfd5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:37.332623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-11c53876-486c-4e30-b623-997e32dbbfd5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.154377 Nov 02 23:16:37.333173 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 926/1501] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:37 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:37.337559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2ececf24-79ca-4f00-a8ed-adab8c386e82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:37.338445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2ececf24-79ca-4f00-a8ed-adab8c386e82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:37.343891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ececf24-79ca-4f00-a8ed-adab8c386e82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:37.344330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ececf24-79ca-4f00-a8ed-adab8c386e82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:37.345085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ececf24-79ca-4f00-a8ed-adab8c386e82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:37.345510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ececf24-79ca-4f00-a8ed-adab8c386e82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:37.373964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2ececf24-79ca-4f00-a8ed-adab8c386e82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039754 Nov 02 23:16:37.374532 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 927/1502] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:37 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:37.379040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d9ac1dc8-b059-4d11-bc8f-10a682edfbd0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:37.379920 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d9ac1dc8-b059-4d11-bc8f-10a682edfbd0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:37.386391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9ac1dc8-b059-4d11-bc8f-10a682edfbd0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:37.386830 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9ac1dc8-b059-4d11-bc8f-10a682edfbd0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:37.387634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9ac1dc8-b059-4d11-bc8f-10a682edfbd0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:37.388064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9ac1dc8-b059-4d11-bc8f-10a682edfbd0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:37.417025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d9ac1dc8-b059-4d11-bc8f-10a682edfbd0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041381 Nov 02 23:16:37.417580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 928/1503] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:37 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:38.350473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-117a3b03-c7ed-4da5-ba07-9b539ee69fad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:38.351176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-117a3b03-c7ed-4da5-ba07-9b539ee69fad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:38.357433 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-117a3b03-c7ed-4da5-ba07-9b539ee69fad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:38.357886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-117a3b03-c7ed-4da5-ba07-9b539ee69fad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:38.358660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-117a3b03-c7ed-4da5-ba07-9b539ee69fad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:38.359128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-117a3b03-c7ed-4da5-ba07-9b539ee69fad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:38.489953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-117a3b03-c7ed-4da5-ba07-9b539ee69fad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:38.498571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-117a3b03-c7ed-4da5-ba07-9b539ee69fad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:38.500080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-117a3b03-c7ed-4da5-ba07-9b539ee69fad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:38.501228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-117a3b03-c7ed-4da5-ba07-9b539ee69fad tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.154456 Nov 02 23:16:38.501803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 929/1504] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:38 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:38.506438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-92d2b84c-8eab-4eeb-9803-7268b8f020bd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:38.507392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-92d2b84c-8eab-4eeb-9803-7268b8f020bd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:38.514277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92d2b84c-8eab-4eeb-9803-7268b8f020bd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:38.514726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92d2b84c-8eab-4eeb-9803-7268b8f020bd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:38.515561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92d2b84c-8eab-4eeb-9803-7268b8f020bd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:38.515994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92d2b84c-8eab-4eeb-9803-7268b8f020bd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:38.547526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-92d2b84c-8eab-4eeb-9803-7268b8f020bd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044541 Nov 02 23:16:38.548122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 930/1505] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:38 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:38.552960 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e17a0ee4-2e60-40d0-9355-048aca35b24b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:38.553868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e17a0ee4-2e60-40d0-9355-048aca35b24b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:38.560357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e17a0ee4-2e60-40d0-9355-048aca35b24b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:38.560845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e17a0ee4-2e60-40d0-9355-048aca35b24b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:38.561668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e17a0ee4-2e60-40d0-9355-048aca35b24b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:38.562234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e17a0ee4-2e60-40d0-9355-048aca35b24b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:38.593018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e17a0ee4-2e60-40d0-9355-048aca35b24b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043834 Nov 02 23:16:38.593594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 931/1506] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:38 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:39.519825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e6071060-45a3-45b0-b972-2fc511194400 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:39.520480 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e6071060-45a3-45b0-b972-2fc511194400 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:39.527563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e6071060-45a3-45b0-b972-2fc511194400 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:39.528004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e6071060-45a3-45b0-b972-2fc511194400 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:39.528780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e6071060-45a3-45b0-b972-2fc511194400 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:39.529201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e6071060-45a3-45b0-b972-2fc511194400 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:39.662387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e6071060-45a3-45b0-b972-2fc511194400 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:39.670962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e6071060-45a3-45b0-b972-2fc511194400 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:39.672441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e6071060-45a3-45b0-b972-2fc511194400 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:39.673598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e6071060-45a3-45b0-b972-2fc511194400 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.157571 Nov 02 23:16:39.674159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 932/1507] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:39 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:39.678574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1a552d71-22ca-4e6a-a7e4-3df7faf8f653 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:39.679509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1a552d71-22ca-4e6a-a7e4-3df7faf8f653 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:39.685819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a552d71-22ca-4e6a-a7e4-3df7faf8f653 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:39.686270 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a552d71-22ca-4e6a-a7e4-3df7faf8f653 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:39.687099 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a552d71-22ca-4e6a-a7e4-3df7faf8f653 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:39.687770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a552d71-22ca-4e6a-a7e4-3df7faf8f653 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:39.719469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1a552d71-22ca-4e6a-a7e4-3df7faf8f653 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044218 Nov 02 23:16:39.720070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 933/1508] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:39 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:39.724441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-85f82a6a-218c-49ae-b68f-e788f94324c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:39.725353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-85f82a6a-218c-49ae-b68f-e788f94324c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:39.731236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85f82a6a-218c-49ae-b68f-e788f94324c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:39.731682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85f82a6a-218c-49ae-b68f-e788f94324c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:39.732459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85f82a6a-218c-49ae-b68f-e788f94324c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:39.732893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85f82a6a-218c-49ae-b68f-e788f94324c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:39.761850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-85f82a6a-218c-49ae-b68f-e788f94324c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040777 Nov 02 23:16:39.762405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 934/1509] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:39 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:40.691768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-24630f35-fe77-4f53-8584-153c347ceebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:40.692424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-24630f35-fe77-4f53-8584-153c347ceebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:40.698618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24630f35-fe77-4f53-8584-153c347ceebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:40.699101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24630f35-fe77-4f53-8584-153c347ceebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:40.699885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24630f35-fe77-4f53-8584-153c347ceebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:40.700323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24630f35-fe77-4f53-8584-153c347ceebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:40.830471 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-24630f35-fe77-4f53-8584-153c347ceebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:40.839392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-24630f35-fe77-4f53-8584-153c347ceebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:40.840884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-24630f35-fe77-4f53-8584-153c347ceebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:40.842045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-24630f35-fe77-4f53-8584-153c347ceebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.154048 Nov 02 23:16:40.842601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 935/1510] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:40 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:40.847245 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-59b38cf6-34e5-451c-9087-9ebae20517d3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:40.848150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-59b38cf6-34e5-451c-9087-9ebae20517d3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:40.854596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59b38cf6-34e5-451c-9087-9ebae20517d3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:40.855059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59b38cf6-34e5-451c-9087-9ebae20517d3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:40.855825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59b38cf6-34e5-451c-9087-9ebae20517d3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:40.856248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59b38cf6-34e5-451c-9087-9ebae20517d3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:40.885587 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-59b38cf6-34e5-451c-9087-9ebae20517d3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041752 Nov 02 23:16:40.886142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 936/1511] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:40 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:40.890606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d597c11c-6746-4957-95ad-ee534ba51746 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:40.891539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d597c11c-6746-4957-95ad-ee534ba51746 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:40.897141 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d597c11c-6746-4957-95ad-ee534ba51746 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:40.897577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d597c11c-6746-4957-95ad-ee534ba51746 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:40.898334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d597c11c-6746-4957-95ad-ee534ba51746 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:40.899283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d597c11c-6746-4957-95ad-ee534ba51746 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:40.928366 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d597c11c-6746-4957-95ad-ee534ba51746 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041194 Nov 02 23:16:40.928923 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 937/1512] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:40 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:41.860604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1d6de9ee-c7f5-45c1-8d46-e9de59eadb89 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:41.861308 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1d6de9ee-c7f5-45c1-8d46-e9de59eadb89 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:41.868129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d6de9ee-c7f5-45c1-8d46-e9de59eadb89 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:41.868565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d6de9ee-c7f5-45c1-8d46-e9de59eadb89 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:41.869334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d6de9ee-c7f5-45c1-8d46-e9de59eadb89 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:41.869772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d6de9ee-c7f5-45c1-8d46-e9de59eadb89 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:42.000721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1d6de9ee-c7f5-45c1-8d46-e9de59eadb89 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:42.009109 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1d6de9ee-c7f5-45c1-8d46-e9de59eadb89 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:42.010604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1d6de9ee-c7f5-45c1-8d46-e9de59eadb89 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:42.011795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1d6de9ee-c7f5-45c1-8d46-e9de59eadb89 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.154941 Nov 02 23:16:42.012350 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 938/1513] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:41 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:42.018136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3c0445f9-8eb4-4ab0-85c9-4dc8a9c055c0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:42.019317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3c0445f9-8eb4-4ab0-85c9-4dc8a9c055c0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:42.025275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c0445f9-8eb4-4ab0-85c9-4dc8a9c055c0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:42.025732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c0445f9-8eb4-4ab0-85c9-4dc8a9c055c0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:42.026510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c0445f9-8eb4-4ab0-85c9-4dc8a9c055c0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:42.026962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c0445f9-8eb4-4ab0-85c9-4dc8a9c055c0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:42.057342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3c0445f9-8eb4-4ab0-85c9-4dc8a9c055c0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043967 Nov 02 23:16:42.057901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 939/1514] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:42 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:42.062202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-df50d4e2-5629-4b65-b33d-1b81d2084f2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:42.063254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-df50d4e2-5629-4b65-b33d-1b81d2084f2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:42.068826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-df50d4e2-5629-4b65-b33d-1b81d2084f2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:42.069269 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-df50d4e2-5629-4b65-b33d-1b81d2084f2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:42.070032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-df50d4e2-5629-4b65-b33d-1b81d2084f2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:42.070500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-df50d4e2-5629-4b65-b33d-1b81d2084f2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:42.098372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-df50d4e2-5629-4b65-b33d-1b81d2084f2a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039492 Nov 02 23:16:42.099117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 940/1515] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:42 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:43.029486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b72ff6f6-8f29-4be7-b47d-5a173d33e453 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:43.030162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b72ff6f6-8f29-4be7-b47d-5a173d33e453 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:43.036448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b72ff6f6-8f29-4be7-b47d-5a173d33e453 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:43.036892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b72ff6f6-8f29-4be7-b47d-5a173d33e453 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:43.037669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b72ff6f6-8f29-4be7-b47d-5a173d33e453 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:43.038096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b72ff6f6-8f29-4be7-b47d-5a173d33e453 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:43.174968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b72ff6f6-8f29-4be7-b47d-5a173d33e453 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:43.183651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b72ff6f6-8f29-4be7-b47d-5a173d33e453 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:43.185143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b72ff6f6-8f29-4be7-b47d-5a173d33e453 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:43.186284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b72ff6f6-8f29-4be7-b47d-5a173d33e453 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.160520 Nov 02 23:16:43.186856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 941/1516] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:43 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:43.191154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e5cc31ad-077e-482d-b428-973a0d0e3487 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:43.192080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e5cc31ad-077e-482d-b428-973a0d0e3487 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:43.198281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e5cc31ad-077e-482d-b428-973a0d0e3487 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:43.198718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e5cc31ad-077e-482d-b428-973a0d0e3487 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:43.199508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e5cc31ad-077e-482d-b428-973a0d0e3487 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:43.199940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e5cc31ad-077e-482d-b428-973a0d0e3487 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:43.230005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e5cc31ad-077e-482d-b428-973a0d0e3487 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042101 Nov 02 23:16:43.230564 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 942/1517] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:43 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:43.235032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-75824f5e-ef90-49fe-bf99-df3f8034bc36 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:43.235925 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-75824f5e-ef90-49fe-bf99-df3f8034bc36 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:43.241708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-75824f5e-ef90-49fe-bf99-df3f8034bc36 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:43.242649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-75824f5e-ef90-49fe-bf99-df3f8034bc36 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:43.243458 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-75824f5e-ef90-49fe-bf99-df3f8034bc36 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:43.243890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-75824f5e-ef90-49fe-bf99-df3f8034bc36 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:43.274635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-75824f5e-ef90-49fe-bf99-df3f8034bc36 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042939 Nov 02 23:16:43.275334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 943/1518] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:43 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:44.205158 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dade4ba1-38a5-41fa-86b2-d4bf5d151462 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:44.205856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dade4ba1-38a5-41fa-86b2-d4bf5d151462 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:44.212577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dade4ba1-38a5-41fa-86b2-d4bf5d151462 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:44.213018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dade4ba1-38a5-41fa-86b2-d4bf5d151462 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:44.213815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dade4ba1-38a5-41fa-86b2-d4bf5d151462 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:44.214266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dade4ba1-38a5-41fa-86b2-d4bf5d151462 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:44.349647 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dade4ba1-38a5-41fa-86b2-d4bf5d151462 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:44.358473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dade4ba1-38a5-41fa-86b2-d4bf5d151462 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:44.359998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dade4ba1-38a5-41fa-86b2-d4bf5d151462 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:44.361164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dade4ba1-38a5-41fa-86b2-d4bf5d151462 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.160041 Nov 02 23:16:44.361722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 944/1519] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:44 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:44.366054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4bfa38d2-496c-44dd-9ee2-dd052b8490af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:44.367067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4bfa38d2-496c-44dd-9ee2-dd052b8490af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:44.373467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4bfa38d2-496c-44dd-9ee2-dd052b8490af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:44.373951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4bfa38d2-496c-44dd-9ee2-dd052b8490af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:44.374717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4bfa38d2-496c-44dd-9ee2-dd052b8490af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:44.375198 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4bfa38d2-496c-44dd-9ee2-dd052b8490af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:44.404656 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4bfa38d2-496c-44dd-9ee2-dd052b8490af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041922 Nov 02 23:16:44.405213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 945/1520] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:44 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:44.409472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4ff66a42-0dfc-43ae-9509-88eda7cc79a4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:44.410362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4ff66a42-0dfc-43ae-9509-88eda7cc79a4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:44.416331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ff66a42-0dfc-43ae-9509-88eda7cc79a4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:44.416779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ff66a42-0dfc-43ae-9509-88eda7cc79a4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:44.417549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ff66a42-0dfc-43ae-9509-88eda7cc79a4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:44.417980 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ff66a42-0dfc-43ae-9509-88eda7cc79a4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:44.446528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4ff66a42-0dfc-43ae-9509-88eda7cc79a4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040320 Nov 02 23:16:44.447116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 946/1521] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:44 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:45.379570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-977e8eb9-f1a9-44f6-b3f8-45511cbc1836 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:45.380238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-977e8eb9-f1a9-44f6-b3f8-45511cbc1836 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:45.392449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-977e8eb9-f1a9-44f6-b3f8-45511cbc1836 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:45.392892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-977e8eb9-f1a9-44f6-b3f8-45511cbc1836 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:45.393678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-977e8eb9-f1a9-44f6-b3f8-45511cbc1836 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:45.394116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-977e8eb9-f1a9-44f6-b3f8-45511cbc1836 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:45.532649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-977e8eb9-f1a9-44f6-b3f8-45511cbc1836 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:45.540782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-977e8eb9-f1a9-44f6-b3f8-45511cbc1836 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:45.542252 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-977e8eb9-f1a9-44f6-b3f8-45511cbc1836 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:45.543428 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-977e8eb9-f1a9-44f6-b3f8-45511cbc1836 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.167554 Nov 02 23:16:45.543977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 947/1522] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:45 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:45.548422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-210a08d7-6615-4dce-91b9-f09bfc6b8ed9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:45.549361 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-210a08d7-6615-4dce-91b9-f09bfc6b8ed9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:45.555718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-210a08d7-6615-4dce-91b9-f09bfc6b8ed9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:45.556152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-210a08d7-6615-4dce-91b9-f09bfc6b8ed9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:45.556917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-210a08d7-6615-4dce-91b9-f09bfc6b8ed9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:45.557342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-210a08d7-6615-4dce-91b9-f09bfc6b8ed9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:45.586356 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-210a08d7-6615-4dce-91b9-f09bfc6b8ed9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041322 Nov 02 23:16:45.586943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 948/1523] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:45 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:45.591531 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bd98b8b4-583c-465e-9af8-21c013561336 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:45.592424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bd98b8b4-583c-465e-9af8-21c013561336 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:45.598495 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bd98b8b4-583c-465e-9af8-21c013561336 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:45.598961 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bd98b8b4-583c-465e-9af8-21c013561336 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:45.599750 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bd98b8b4-583c-465e-9af8-21c013561336 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:45.600176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bd98b8b4-583c-465e-9af8-21c013561336 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:45.632235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bd98b8b4-583c-465e-9af8-21c013561336 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044163 Nov 02 23:16:45.632814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 949/1524] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:45 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:46.561559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aa18bd4a-0789-4a7f-8a9d-2035f77175a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:46.562283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aa18bd4a-0789-4a7f-8a9d-2035f77175a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:46.568599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa18bd4a-0789-4a7f-8a9d-2035f77175a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:46.569045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa18bd4a-0789-4a7f-8a9d-2035f77175a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:46.569821 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa18bd4a-0789-4a7f-8a9d-2035f77175a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:46.570778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa18bd4a-0789-4a7f-8a9d-2035f77175a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:46.709315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aa18bd4a-0789-4a7f-8a9d-2035f77175a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:46.718808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aa18bd4a-0789-4a7f-8a9d-2035f77175a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:46.720437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aa18bd4a-0789-4a7f-8a9d-2035f77175a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:46.721622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aa18bd4a-0789-4a7f-8a9d-2035f77175a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.163806 Nov 02 23:16:46.722202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 950/1525] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:46 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:46.726728 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aea83c0c-05b7-4f6e-be05-c7f01e53a652 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:46.727665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aea83c0c-05b7-4f6e-be05-c7f01e53a652 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:46.734202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aea83c0c-05b7-4f6e-be05-c7f01e53a652 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:46.734650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aea83c0c-05b7-4f6e-be05-c7f01e53a652 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:46.735482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aea83c0c-05b7-4f6e-be05-c7f01e53a652 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:46.735919 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aea83c0c-05b7-4f6e-be05-c7f01e53a652 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:46.768703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aea83c0c-05b7-4f6e-be05-c7f01e53a652 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045440 Nov 02 23:16:46.769288 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 951/1526] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:46 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:46.773882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-86dfe9f6-1a38-4e71-bd32-0f2633b681e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:46.774798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-86dfe9f6-1a38-4e71-bd32-0f2633b681e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:46.780864 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86dfe9f6-1a38-4e71-bd32-0f2633b681e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:46.781306 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86dfe9f6-1a38-4e71-bd32-0f2633b681e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:46.782210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86dfe9f6-1a38-4e71-bd32-0f2633b681e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:46.782605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86dfe9f6-1a38-4e71-bd32-0f2633b681e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:46.813790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-86dfe9f6-1a38-4e71-bd32-0f2633b681e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043357 Nov 02 23:16:46.814268 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 952/1527] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:46 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:47.741249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f7986f9a-bcd4-4f3b-9ae4-f474afee3ecb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:47.742517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f7986f9a-bcd4-4f3b-9ae4-f474afee3ecb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:47.748886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f7986f9a-bcd4-4f3b-9ae4-f474afee3ecb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:47.749349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f7986f9a-bcd4-4f3b-9ae4-f474afee3ecb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:47.750132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f7986f9a-bcd4-4f3b-9ae4-f474afee3ecb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:47.750561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f7986f9a-bcd4-4f3b-9ae4-f474afee3ecb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:47.885873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f7986f9a-bcd4-4f3b-9ae4-f474afee3ecb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:47.894235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f7986f9a-bcd4-4f3b-9ae4-f474afee3ecb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:47.895757 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f7986f9a-bcd4-4f3b-9ae4-f474afee3ecb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:47.896927 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f7986f9a-bcd4-4f3b-9ae4-f474afee3ecb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.159463 Nov 02 23:16:47.897495 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 953/1528] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:47 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:47.905629 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6a149565-cfbc-418d-89ef-7bb4b7abcbaa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:47.907197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6a149565-cfbc-418d-89ef-7bb4b7abcbaa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:47.916914 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a149565-cfbc-418d-89ef-7bb4b7abcbaa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:47.917657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a149565-cfbc-418d-89ef-7bb4b7abcbaa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:47.919021 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a149565-cfbc-418d-89ef-7bb4b7abcbaa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:47.919763 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a149565-cfbc-418d-89ef-7bb4b7abcbaa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:47.953699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6a149565-cfbc-418d-89ef-7bb4b7abcbaa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055132 Nov 02 23:16:47.954346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 954/1529] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:47 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:47.959357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-16342026-2b03-4c6b-9343-779a0d28ff07 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:47.960321 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-16342026-2b03-4c6b-9343-779a0d28ff07 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:47.967134 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-16342026-2b03-4c6b-9343-779a0d28ff07 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:47.967630 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-16342026-2b03-4c6b-9343-779a0d28ff07 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:47.968448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-16342026-2b03-4c6b-9343-779a0d28ff07 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:47.968917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-16342026-2b03-4c6b-9343-779a0d28ff07 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:48.003026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-16342026-2b03-4c6b-9343-779a0d28ff07 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047424 Nov 02 23:16:48.003746 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 955/1530] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:47 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:48.916460 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-913dad1a-dea7-4a9a-8e18-c6eacd36c609 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:48.917552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-913dad1a-dea7-4a9a-8e18-c6eacd36c609 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:48.924112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-913dad1a-dea7-4a9a-8e18-c6eacd36c609 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:48.924629 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-913dad1a-dea7-4a9a-8e18-c6eacd36c609 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:48.925480 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-913dad1a-dea7-4a9a-8e18-c6eacd36c609 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:48.925955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-913dad1a-dea7-4a9a-8e18-c6eacd36c609 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:49.072705 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-913dad1a-dea7-4a9a-8e18-c6eacd36c609 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:49.081616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-913dad1a-dea7-4a9a-8e18-c6eacd36c609 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:49.083151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-913dad1a-dea7-4a9a-8e18-c6eacd36c609 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:49.084317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-913dad1a-dea7-4a9a-8e18-c6eacd36c609 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.172242 Nov 02 23:16:49.084884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 956/1531] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:48 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:49.089843 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1adaaa46-ea2b-415b-80b6-e412c1410b33 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:49.090746 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1adaaa46-ea2b-415b-80b6-e412c1410b33 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:49.096938 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1adaaa46-ea2b-415b-80b6-e412c1410b33 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:49.097390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1adaaa46-ea2b-415b-80b6-e412c1410b33 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:49.098182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1adaaa46-ea2b-415b-80b6-e412c1410b33 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:49.098638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1adaaa46-ea2b-415b-80b6-e412c1410b33 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:49.130414 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1adaaa46-ea2b-415b-80b6-e412c1410b33 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044437 Nov 02 23:16:49.131037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 957/1532] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:49 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:49.135641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0133dee5-dff9-4cdc-aa1d-678a1cfed605 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:49.136562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0133dee5-dff9-4cdc-aa1d-678a1cfed605 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:49.142512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0133dee5-dff9-4cdc-aa1d-678a1cfed605 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:49.142988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0133dee5-dff9-4cdc-aa1d-678a1cfed605 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:49.143780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0133dee5-dff9-4cdc-aa1d-678a1cfed605 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:49.144219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0133dee5-dff9-4cdc-aa1d-678a1cfed605 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:49.175815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0133dee5-dff9-4cdc-aa1d-678a1cfed605 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043713 Nov 02 23:16:49.176399 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 958/1533] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:49 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:50.104659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-47cc9588-52f8-46cd-848f-0d631225155d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:50.105367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-47cc9588-52f8-46cd-848f-0d631225155d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:50.112164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47cc9588-52f8-46cd-848f-0d631225155d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:50.112594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47cc9588-52f8-46cd-848f-0d631225155d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:50.113390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47cc9588-52f8-46cd-848f-0d631225155d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:50.113821 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47cc9588-52f8-46cd-848f-0d631225155d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:50.255236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-47cc9588-52f8-46cd-848f-0d631225155d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:50.264709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-47cc9588-52f8-46cd-848f-0d631225155d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:50.266204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-47cc9588-52f8-46cd-848f-0d631225155d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:50.267407 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-47cc9588-52f8-46cd-848f-0d631225155d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.166605 Nov 02 23:16:50.267967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 959/1534] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:50 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:50.272433 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dfc0bd94-28d9-4534-92ff-77f2b0a966fd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:50.273455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dfc0bd94-28d9-4534-92ff-77f2b0a966fd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:50.279654 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dfc0bd94-28d9-4534-92ff-77f2b0a966fd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:50.280107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dfc0bd94-28d9-4534-92ff-77f2b0a966fd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:50.280898 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dfc0bd94-28d9-4534-92ff-77f2b0a966fd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:50.281338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dfc0bd94-28d9-4534-92ff-77f2b0a966fd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:50.314539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dfc0bd94-28d9-4534-92ff-77f2b0a966fd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045490 Nov 02 23:16:50.315178 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 960/1535] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:50 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:50.320592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f619c715-ef08-49c9-aeac-b533bad16669 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:50.321681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f619c715-ef08-49c9-aeac-b533bad16669 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:50.328502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f619c715-ef08-49c9-aeac-b533bad16669 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:50.328952 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f619c715-ef08-49c9-aeac-b533bad16669 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:50.329732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f619c715-ef08-49c9-aeac-b533bad16669 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:50.330165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f619c715-ef08-49c9-aeac-b533bad16669 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:50.361442 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f619c715-ef08-49c9-aeac-b533bad16669 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044976 Nov 02 23:16:50.361974 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 961/1536] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:50 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:51.287037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ea4ba6ec-59f2-4eab-8cd2-872622ebd769 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:51.287705 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ea4ba6ec-59f2-4eab-8cd2-872622ebd769 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:51.295138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea4ba6ec-59f2-4eab-8cd2-872622ebd769 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:51.295586 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea4ba6ec-59f2-4eab-8cd2-872622ebd769 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:51.296380 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea4ba6ec-59f2-4eab-8cd2-872622ebd769 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:51.296822 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea4ba6ec-59f2-4eab-8cd2-872622ebd769 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:51.445591 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ea4ba6ec-59f2-4eab-8cd2-872622ebd769 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:51.457676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ea4ba6ec-59f2-4eab-8cd2-872622ebd769 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:51.461380 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ea4ba6ec-59f2-4eab-8cd2-872622ebd769 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:51.463503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ea4ba6ec-59f2-4eab-8cd2-872622ebd769 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.179828 Nov 02 23:16:51.464851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 962/1537] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:51 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:51.473458 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2ad0dcdd-6d3c-4646-a335-2f83f5fd625f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:51.475198 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2ad0dcdd-6d3c-4646-a335-2f83f5fd625f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:51.486605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ad0dcdd-6d3c-4646-a335-2f83f5fd625f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:51.487389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ad0dcdd-6d3c-4646-a335-2f83f5fd625f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:51.488752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ad0dcdd-6d3c-4646-a335-2f83f5fd625f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:51.489482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ad0dcdd-6d3c-4646-a335-2f83f5fd625f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:51.526118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2ad0dcdd-6d3c-4646-a335-2f83f5fd625f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059676 Nov 02 23:16:51.538647 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 963/1538] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:51 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:51.538647 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d64f82bc-c350-449b-b39e-4e2a1351baac tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:51.538647 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d64f82bc-c350-449b-b39e-4e2a1351baac tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:51.546133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d64f82bc-c350-449b-b39e-4e2a1351baac tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:51.546747 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d64f82bc-c350-449b-b39e-4e2a1351baac tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:51.547652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d64f82bc-c350-449b-b39e-4e2a1351baac tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:51.548163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d64f82bc-c350-449b-b39e-4e2a1351baac tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:51.583853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d64f82bc-c350-449b-b39e-4e2a1351baac tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055587 Nov 02 23:16:51.584683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 964/1539] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:51 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:52.491229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5febfed6-2f11-4413-8fd1-72c8b290fa95 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:52.492737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5febfed6-2f11-4413-8fd1-72c8b290fa95 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:52.498961 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5febfed6-2f11-4413-8fd1-72c8b290fa95 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:52.499420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5febfed6-2f11-4413-8fd1-72c8b290fa95 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:52.500210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5febfed6-2f11-4413-8fd1-72c8b290fa95 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:52.500640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5febfed6-2f11-4413-8fd1-72c8b290fa95 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:52.648056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5febfed6-2f11-4413-8fd1-72c8b290fa95 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:52.656400 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5febfed6-2f11-4413-8fd1-72c8b290fa95 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:52.657887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5febfed6-2f11-4413-8fd1-72c8b290fa95 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:52.659079 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5febfed6-2f11-4413-8fd1-72c8b290fa95 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.171572 Nov 02 23:16:52.659643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 965/1540] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:52 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:52.664522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d39e4b43-d7de-4711-abe5-7de147995a58 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:52.665455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d39e4b43-d7de-4711-abe5-7de147995a58 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:52.671362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d39e4b43-d7de-4711-abe5-7de147995a58 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:52.671803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d39e4b43-d7de-4711-abe5-7de147995a58 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:52.672576 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d39e4b43-d7de-4711-abe5-7de147995a58 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:52.673009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d39e4b43-d7de-4711-abe5-7de147995a58 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:52.708472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d39e4b43-d7de-4711-abe5-7de147995a58 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047786 Nov 02 23:16:52.709325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 966/1541] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:52 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:52.714118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a386bcff-378c-4be3-8e14-6381165352b0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:52.715047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a386bcff-378c-4be3-8e14-6381165352b0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:52.721239 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a386bcff-378c-4be3-8e14-6381165352b0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:52.721683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a386bcff-378c-4be3-8e14-6381165352b0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:52.722502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a386bcff-378c-4be3-8e14-6381165352b0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:52.722992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a386bcff-378c-4be3-8e14-6381165352b0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:52.754660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a386bcff-378c-4be3-8e14-6381165352b0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044380 Nov 02 23:16:52.755197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 967/1542] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:52 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:53.677747 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e48b7d77-cb01-45e2-b524-18591615a730 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:53.678397 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e48b7d77-cb01-45e2-b524-18591615a730 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:53.688209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e48b7d77-cb01-45e2-b524-18591615a730 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:53.688651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e48b7d77-cb01-45e2-b524-18591615a730 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:53.689421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e48b7d77-cb01-45e2-b524-18591615a730 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:53.689846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e48b7d77-cb01-45e2-b524-18591615a730 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:53.855757 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e48b7d77-cb01-45e2-b524-18591615a730 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:53.864450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e48b7d77-cb01-45e2-b524-18591615a730 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:53.865967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e48b7d77-cb01-45e2-b524-18591615a730 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:53.867740 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e48b7d77-cb01-45e2-b524-18591615a730 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.193210 Nov 02 23:16:53.868307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 968/1543] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:53 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:53.872895 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6804e2b8-c417-4680-b535-6e1ddbee7c12 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:53.873809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6804e2b8-c417-4680-b535-6e1ddbee7c12 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:53.880173 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6804e2b8-c417-4680-b535-6e1ddbee7c12 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:53.880633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6804e2b8-c417-4680-b535-6e1ddbee7c12 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:53.881403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6804e2b8-c417-4680-b535-6e1ddbee7c12 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:53.881832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6804e2b8-c417-4680-b535-6e1ddbee7c12 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:53.912502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6804e2b8-c417-4680-b535-6e1ddbee7c12 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043142 Nov 02 23:16:53.913076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 969/1544] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:53 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:53.918015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e0eae452-971f-4509-9dc1-1013a5f9d338 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:53.918906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e0eae452-971f-4509-9dc1-1013a5f9d338 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:53.924819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0eae452-971f-4509-9dc1-1013a5f9d338 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:53.925258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0eae452-971f-4509-9dc1-1013a5f9d338 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:53.926034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0eae452-971f-4509-9dc1-1013a5f9d338 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:53.926465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0eae452-971f-4509-9dc1-1013a5f9d338 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:53.956218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e0eae452-971f-4509-9dc1-1013a5f9d338 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042100 Nov 02 23:16:53.956780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 970/1545] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:53 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:54.888723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1c073c69-e25e-481f-b7e6-a53bea2bec37 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:54.889419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1c073c69-e25e-481f-b7e6-a53bea2bec37 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:54.895708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c073c69-e25e-481f-b7e6-a53bea2bec37 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:54.896147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c073c69-e25e-481f-b7e6-a53bea2bec37 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:54.896919 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c073c69-e25e-481f-b7e6-a53bea2bec37 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:54.897345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c073c69-e25e-481f-b7e6-a53bea2bec37 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:55.031372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1c073c69-e25e-481f-b7e6-a53bea2bec37 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:55.040596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1c073c69-e25e-481f-b7e6-a53bea2bec37 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:55.042140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1c073c69-e25e-481f-b7e6-a53bea2bec37 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:55.043454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1c073c69-e25e-481f-b7e6-a53bea2bec37 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.158516 Nov 02 23:16:55.044034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 971/1546] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:54 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:55.049253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6bf7377d-f94c-4a55-803e-a946c9c7ed4c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:55.050345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6bf7377d-f94c-4a55-803e-a946c9c7ed4c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:55.057385 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6bf7377d-f94c-4a55-803e-a946c9c7ed4c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:55.057885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6bf7377d-f94c-4a55-803e-a946c9c7ed4c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:55.058775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6bf7377d-f94c-4a55-803e-a946c9c7ed4c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:55.059343 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6bf7377d-f94c-4a55-803e-a946c9c7ed4c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:55.091253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6bf7377d-f94c-4a55-803e-a946c9c7ed4c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046113 Nov 02 23:16:55.091835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 972/1547] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:55 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:55.096389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-35617f81-84af-466f-83fd-34073343a6b1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:55.097293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-35617f81-84af-466f-83fd-34073343a6b1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:55.103739 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-35617f81-84af-466f-83fd-34073343a6b1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:55.104188 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-35617f81-84af-466f-83fd-34073343a6b1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:55.104982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-35617f81-84af-466f-83fd-34073343a6b1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:55.105413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-35617f81-84af-466f-83fd-34073343a6b1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:55.134839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-35617f81-84af-466f-83fd-34073343a6b1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041955 Nov 02 23:16:55.135444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 973/1548] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:55 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:56.061789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a965c7f2-89aa-411b-9347-71f2874e1458 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:56.062579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a965c7f2-89aa-411b-9347-71f2874e1458 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:56.069308 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a965c7f2-89aa-411b-9347-71f2874e1458 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:56.069758 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a965c7f2-89aa-411b-9347-71f2874e1458 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:56.070564 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a965c7f2-89aa-411b-9347-71f2874e1458 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:56.071032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a965c7f2-89aa-411b-9347-71f2874e1458 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:56.217965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a965c7f2-89aa-411b-9347-71f2874e1458 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:56.226309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a965c7f2-89aa-411b-9347-71f2874e1458 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:56.227836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a965c7f2-89aa-411b-9347-71f2874e1458 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:56.229171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a965c7f2-89aa-411b-9347-71f2874e1458 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.171112 Nov 02 23:16:56.229560 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 974/1549] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:56 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:56.234040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d2d404ae-ba39-4624-8f75-840a1d7a585a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:56.234958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d2d404ae-ba39-4624-8f75-840a1d7a585a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:56.241018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2d404ae-ba39-4624-8f75-840a1d7a585a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:56.241459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2d404ae-ba39-4624-8f75-840a1d7a585a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:56.242238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2d404ae-ba39-4624-8f75-840a1d7a585a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:56.242668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2d404ae-ba39-4624-8f75-840a1d7a585a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:56.274962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d2d404ae-ba39-4624-8f75-840a1d7a585a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044329 Nov 02 23:16:56.275538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 975/1550] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:56 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:56.279900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-83df9570-3e47-4e6e-845a-91b15530d40b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:56.280793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-83df9570-3e47-4e6e-845a-91b15530d40b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:56.286521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83df9570-3e47-4e6e-845a-91b15530d40b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:56.287065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83df9570-3e47-4e6e-845a-91b15530d40b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:56.287841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83df9570-3e47-4e6e-845a-91b15530d40b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:56.288270 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83df9570-3e47-4e6e-845a-91b15530d40b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:56.317642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-83df9570-3e47-4e6e-845a-91b15530d40b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040967 Nov 02 23:16:56.318138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 976/1551] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:56 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:57.248048 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-520f09d3-0464-4788-8e17-f11488499207 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:57.248759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-520f09d3-0464-4788-8e17-f11488499207 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:57.254975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-520f09d3-0464-4788-8e17-f11488499207 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:57.255416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-520f09d3-0464-4788-8e17-f11488499207 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:57.256187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-520f09d3-0464-4788-8e17-f11488499207 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:57.256617 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-520f09d3-0464-4788-8e17-f11488499207 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:57.395978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-520f09d3-0464-4788-8e17-f11488499207 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:57.404717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-520f09d3-0464-4788-8e17-f11488499207 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:57.406252 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-520f09d3-0464-4788-8e17-f11488499207 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:57.407500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-520f09d3-0464-4788-8e17-f11488499207 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.163314 Nov 02 23:16:57.408149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 977/1552] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:57 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:57.412817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-eb455b67-28d4-419c-8e46-0fa933579db2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:57.413759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-eb455b67-28d4-419c-8e46-0fa933579db2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:57.420039 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb455b67-28d4-419c-8e46-0fa933579db2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:57.420710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb455b67-28d4-419c-8e46-0fa933579db2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:57.421322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb455b67-28d4-419c-8e46-0fa933579db2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:57.421693 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb455b67-28d4-419c-8e46-0fa933579db2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:57.455517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-eb455b67-28d4-419c-8e46-0fa933579db2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046224 Nov 02 23:16:57.456127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 978/1553] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:57 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:57.461159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5ba31e7a-c296-466e-b773-c26c1c2b900a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:57.462006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5ba31e7a-c296-466e-b773-c26c1c2b900a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:57.468284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ba31e7a-c296-466e-b773-c26c1c2b900a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:57.468767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ba31e7a-c296-466e-b773-c26c1c2b900a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:57.469551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ba31e7a-c296-466e-b773-c26c1c2b900a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:57.469977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ba31e7a-c296-466e-b773-c26c1c2b900a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:57.503986 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5ba31e7a-c296-466e-b773-c26c1c2b900a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046738 Nov 02 23:16:57.504747 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 979/1554] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:57 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:58.426084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-75131860-9b69-4a53-9489-d7231516fdce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:58.426759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-75131860-9b69-4a53-9489-d7231516fdce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:58.433062 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-75131860-9b69-4a53-9489-d7231516fdce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:58.433508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-75131860-9b69-4a53-9489-d7231516fdce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:58.434284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-75131860-9b69-4a53-9489-d7231516fdce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:58.434714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-75131860-9b69-4a53-9489-d7231516fdce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:58.572980 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-75131860-9b69-4a53-9489-d7231516fdce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:58.582624 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-75131860-9b69-4a53-9489-d7231516fdce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:58.584313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-75131860-9b69-4a53-9489-d7231516fdce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:58.585584 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-75131860-9b69-4a53-9489-d7231516fdce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.163195 Nov 02 23:16:58.586674 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 980/1555] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:58 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:58.591467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9bf50743-51e8-485b-964b-51b711a742e3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:58.592391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9bf50743-51e8-485b-964b-51b711a742e3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:58.598820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9bf50743-51e8-485b-964b-51b711a742e3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:58.599324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9bf50743-51e8-485b-964b-51b711a742e3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:58.600110 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9bf50743-51e8-485b-964b-51b711a742e3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:58.600544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9bf50743-51e8-485b-964b-51b711a742e3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:58.629394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9bf50743-51e8-485b-964b-51b711a742e3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041637 Nov 02 23:16:58.629961 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 981/1556] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:58 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:58.634815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-03a7132a-afba-4339-9893-4ef1275bdc0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:58.635729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-03a7132a-afba-4339-9893-4ef1275bdc0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:58.641713 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03a7132a-afba-4339-9893-4ef1275bdc0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:58.642151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03a7132a-afba-4339-9893-4ef1275bdc0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:58.642981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03a7132a-afba-4339-9893-4ef1275bdc0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:58.643581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03a7132a-afba-4339-9893-4ef1275bdc0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:58.673598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-03a7132a-afba-4339-9893-4ef1275bdc0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042603 Nov 02 23:16:58.674158 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 982/1557] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:58 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:59.605159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-95815ac5-d377-4cc4-8e7d-9ea22fbaa2ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:59.605849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-95815ac5-d377-4cc4-8e7d-9ea22fbaa2ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:59.612093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-95815ac5-d377-4cc4-8e7d-9ea22fbaa2ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:59.612537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-95815ac5-d377-4cc4-8e7d-9ea22fbaa2ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:59.613309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-95815ac5-d377-4cc4-8e7d-9ea22fbaa2ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:59.613738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-95815ac5-d377-4cc4-8e7d-9ea22fbaa2ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:59.744065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-95815ac5-d377-4cc4-8e7d-9ea22fbaa2ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:59.752618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-95815ac5-d377-4cc4-8e7d-9ea22fbaa2ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:59.754113 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-95815ac5-d377-4cc4-8e7d-9ea22fbaa2ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:16:59.755306 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-95815ac5-d377-4cc4-8e7d-9ea22fbaa2ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.154486 Nov 02 23:16:59.755871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 983/1558] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:16:59 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:16:59.760223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4a1a719b-08d3-4f41-8a19-4ae8a66942f5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:59.761126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4a1a719b-08d3-4f41-8a19-4ae8a66942f5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:59.768560 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a1a719b-08d3-4f41-8a19-4ae8a66942f5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:59.768757 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a1a719b-08d3-4f41-8a19-4ae8a66942f5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:59.769449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a1a719b-08d3-4f41-8a19-4ae8a66942f5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:59.769874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a1a719b-08d3-4f41-8a19-4ae8a66942f5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:59.799566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4a1a719b-08d3-4f41-8a19-4ae8a66942f5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042590 Nov 02 23:16:59.800041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 984/1559] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:59 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:16:59.804370 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f3b0f46f-0443-4d02-b161-43517b41d3a1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:16:59.805244 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f3b0f46f-0443-4d02-b161-43517b41d3a1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:16:59.811033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3b0f46f-0443-4d02-b161-43517b41d3a1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:59.811479 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3b0f46f-0443-4d02-b161-43517b41d3a1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:59.812235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3b0f46f-0443-4d02-b161-43517b41d3a1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:16:59.812663 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3b0f46f-0443-4d02-b161-43517b41d3a1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:16:59.841475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f3b0f46f-0443-4d02-b161-43517b41d3a1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040434 Nov 02 23:16:59.842026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 985/1560] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:16:59 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:00.773532 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aa0b46eb-2c3c-4fba-84d8-c6e21cbc4a52 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:00.774217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aa0b46eb-2c3c-4fba-84d8-c6e21cbc4a52 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:00.780368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa0b46eb-2c3c-4fba-84d8-c6e21cbc4a52 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:00.780810 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa0b46eb-2c3c-4fba-84d8-c6e21cbc4a52 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:00.781572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa0b46eb-2c3c-4fba-84d8-c6e21cbc4a52 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:00.781997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa0b46eb-2c3c-4fba-84d8-c6e21cbc4a52 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:00.917165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aa0b46eb-2c3c-4fba-84d8-c6e21cbc4a52 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:00.925284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aa0b46eb-2c3c-4fba-84d8-c6e21cbc4a52 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:00.926751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aa0b46eb-2c3c-4fba-84d8-c6e21cbc4a52 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:00.927931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aa0b46eb-2c3c-4fba-84d8-c6e21cbc4a52 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.158241 Nov 02 23:17:00.928490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 986/1561] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:00 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:00.933347 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-47892dc3-dea1-4ea7-bd92-2899150d2f8a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:00.934236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-47892dc3-dea1-4ea7-bd92-2899150d2f8a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:00.939811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47892dc3-dea1-4ea7-bd92-2899150d2f8a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:00.940245 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47892dc3-dea1-4ea7-bd92-2899150d2f8a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:00.940996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47892dc3-dea1-4ea7-bd92-2899150d2f8a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:00.941418 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47892dc3-dea1-4ea7-bd92-2899150d2f8a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:00.970133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-47892dc3-dea1-4ea7-bd92-2899150d2f8a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040650 Nov 02 23:17:00.970690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 987/1562] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:00 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:00.974954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f7fecd1e-7eb8-4590-a676-2f099f32c00b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:00.975840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f7fecd1e-7eb8-4590-a676-2f099f32c00b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:00.982414 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f7fecd1e-7eb8-4590-a676-2f099f32c00b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:00.982855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f7fecd1e-7eb8-4590-a676-2f099f32c00b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:00.983651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f7fecd1e-7eb8-4590-a676-2f099f32c00b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:00.984072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f7fecd1e-7eb8-4590-a676-2f099f32c00b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:01.017708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f7fecd1e-7eb8-4590-a676-2f099f32c00b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045978 Nov 02 23:17:01.018285 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 988/1563] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:00 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:01.947458 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-34e8a2a0-f703-4e18-9648-055890b556af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:01.948133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-34e8a2a0-f703-4e18-9648-055890b556af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:01.954489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-34e8a2a0-f703-4e18-9648-055890b556af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:01.954956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-34e8a2a0-f703-4e18-9648-055890b556af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:01.955726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-34e8a2a0-f703-4e18-9648-055890b556af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:01.956156 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-34e8a2a0-f703-4e18-9648-055890b556af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:02.092073 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-34e8a2a0-f703-4e18-9648-055890b556af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:02.100117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-34e8a2a0-f703-4e18-9648-055890b556af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:02.102165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-34e8a2a0-f703-4e18-9648-055890b556af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:02.103323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-34e8a2a0-f703-4e18-9648-055890b556af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.160534 Nov 02 23:17:02.103876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 989/1564] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:01 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:02.108108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f2b47d7b-eea1-4e4a-80f8-4a2c732f85dd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:02.108989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f2b47d7b-eea1-4e4a-80f8-4a2c732f85dd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:02.114513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f2b47d7b-eea1-4e4a-80f8-4a2c732f85dd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:02.114980 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f2b47d7b-eea1-4e4a-80f8-4a2c732f85dd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:02.115775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f2b47d7b-eea1-4e4a-80f8-4a2c732f85dd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:02.116202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f2b47d7b-eea1-4e4a-80f8-4a2c732f85dd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:02.144999 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f2b47d7b-eea1-4e4a-80f8-4a2c732f85dd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040107 Nov 02 23:17:02.145560 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 990/1565] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:02 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:02.149997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e38bc6d3-e602-46d6-a53f-3e6ab8f51d08 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:02.150888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e38bc6d3-e602-46d6-a53f-3e6ab8f51d08 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:02.158068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e38bc6d3-e602-46d6-a53f-3e6ab8f51d08 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:02.158283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e38bc6d3-e602-46d6-a53f-3e6ab8f51d08 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:02.159049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e38bc6d3-e602-46d6-a53f-3e6ab8f51d08 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:02.159512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e38bc6d3-e602-46d6-a53f-3e6ab8f51d08 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:02.191804 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e38bc6d3-e602-46d6-a53f-3e6ab8f51d08 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045222 Nov 02 23:17:02.192364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 991/1566] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:02 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:03.121646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-53d209b0-add3-4582-a09d-82f4bc694055 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:03.122291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-53d209b0-add3-4582-a09d-82f4bc694055 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:03.128517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53d209b0-add3-4582-a09d-82f4bc694055 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:03.128983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53d209b0-add3-4582-a09d-82f4bc694055 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:03.129774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53d209b0-add3-4582-a09d-82f4bc694055 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:03.130201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53d209b0-add3-4582-a09d-82f4bc694055 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:03.263413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-53d209b0-add3-4582-a09d-82f4bc694055 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:03.271660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-53d209b0-add3-4582-a09d-82f4bc694055 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:03.273656 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-53d209b0-add3-4582-a09d-82f4bc694055 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:03.274806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-53d209b0-add3-4582-a09d-82f4bc694055 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.156971 Nov 02 23:17:03.275547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 992/1567] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:03 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:03.279796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d05642b1-d9d7-4e78-9d5a-307579e1fe9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:03.280683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d05642b1-d9d7-4e78-9d5a-307579e1fe9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:03.286832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d05642b1-d9d7-4e78-9d5a-307579e1fe9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:03.287310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d05642b1-d9d7-4e78-9d5a-307579e1fe9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:03.288117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d05642b1-d9d7-4e78-9d5a-307579e1fe9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:03.289334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d05642b1-d9d7-4e78-9d5a-307579e1fe9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:03.317868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d05642b1-d9d7-4e78-9d5a-307579e1fe9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041379 Nov 02 23:17:03.318354 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 993/1568] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:03 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:03.322699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8a0abf83-26aa-41d9-9391-fa4015f248cf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:03.323606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8a0abf83-26aa-41d9-9391-fa4015f248cf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:03.329485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a0abf83-26aa-41d9-9391-fa4015f248cf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:03.329921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a0abf83-26aa-41d9-9391-fa4015f248cf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:03.330689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a0abf83-26aa-41d9-9391-fa4015f248cf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:03.331146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a0abf83-26aa-41d9-9391-fa4015f248cf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:03.360691 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8a0abf83-26aa-41d9-9391-fa4015f248cf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041328 Nov 02 23:17:03.361253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 994/1569] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:03 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:04.292956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e3fc39fc-3563-4ceb-804e-8dd51e1f3e5c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:04.293595 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e3fc39fc-3563-4ceb-804e-8dd51e1f3e5c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:04.300197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3fc39fc-3563-4ceb-804e-8dd51e1f3e5c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:04.300659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3fc39fc-3563-4ceb-804e-8dd51e1f3e5c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:04.301409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3fc39fc-3563-4ceb-804e-8dd51e1f3e5c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:04.301841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3fc39fc-3563-4ceb-804e-8dd51e1f3e5c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:04.439002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e3fc39fc-3563-4ceb-804e-8dd51e1f3e5c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:04.447152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e3fc39fc-3563-4ceb-804e-8dd51e1f3e5c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:04.448648 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e3fc39fc-3563-4ceb-804e-8dd51e1f3e5c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:04.449798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e3fc39fc-3563-4ceb-804e-8dd51e1f3e5c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.160752 Nov 02 23:17:04.450367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 995/1570] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:04 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:04.454970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f166649e-b6dc-4cf8-8802-3befe4ae9f76 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:04.455873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f166649e-b6dc-4cf8-8802-3befe4ae9f76 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:04.461521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f166649e-b6dc-4cf8-8802-3befe4ae9f76 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:04.461970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f166649e-b6dc-4cf8-8802-3befe4ae9f76 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:04.462746 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f166649e-b6dc-4cf8-8802-3befe4ae9f76 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:04.463202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f166649e-b6dc-4cf8-8802-3befe4ae9f76 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:04.491462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f166649e-b6dc-4cf8-8802-3befe4ae9f76 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039819 Nov 02 23:17:04.492564 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 996/1571] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:04 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:04.496827 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-332869cb-4dec-494a-8c7e-d13880889d48 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:04.497707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-332869cb-4dec-494a-8c7e-d13880889d48 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:04.503301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-332869cb-4dec-494a-8c7e-d13880889d48 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:04.503793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-332869cb-4dec-494a-8c7e-d13880889d48 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:04.504525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-332869cb-4dec-494a-8c7e-d13880889d48 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:04.504995 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-332869cb-4dec-494a-8c7e-d13880889d48 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:04.533757 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-332869cb-4dec-494a-8c7e-d13880889d48 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040199 Nov 02 23:17:04.534306 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 997/1572] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:04 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:05.468496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1d575ba2-cf9b-45c7-8fce-116d7eb65d69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:05.469154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1d575ba2-cf9b-45c7-8fce-116d7eb65d69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:05.475443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d575ba2-cf9b-45c7-8fce-116d7eb65d69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:05.475877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d575ba2-cf9b-45c7-8fce-116d7eb65d69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:05.477211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d575ba2-cf9b-45c7-8fce-116d7eb65d69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:05.477636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d575ba2-cf9b-45c7-8fce-116d7eb65d69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:05.603970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1d575ba2-cf9b-45c7-8fce-116d7eb65d69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:05.612125 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1d575ba2-cf9b-45c7-8fce-116d7eb65d69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:05.613605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1d575ba2-cf9b-45c7-8fce-116d7eb65d69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:05.614739 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1d575ba2-cf9b-45c7-8fce-116d7eb65d69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.150122 Nov 02 23:17:05.615325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 998/1573] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:05 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:05.619681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3ca40b29-d556-448c-8ba7-ac4b3f616dd6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:05.620561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3ca40b29-d556-448c-8ba7-ac4b3f616dd6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:05.626107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3ca40b29-d556-448c-8ba7-ac4b3f616dd6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:05.626544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3ca40b29-d556-448c-8ba7-ac4b3f616dd6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:05.627327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3ca40b29-d556-448c-8ba7-ac4b3f616dd6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:05.627754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3ca40b29-d556-448c-8ba7-ac4b3f616dd6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:05.656035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3ca40b29-d556-448c-8ba7-ac4b3f616dd6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039483 Nov 02 23:17:05.656808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 999/1574] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:05 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:05.661831 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-561563e7-0bf9-4416-9a30-1fa423d7aa36 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:05.662834 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-561563e7-0bf9-4416-9a30-1fa423d7aa36 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:05.669505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-561563e7-0bf9-4416-9a30-1fa423d7aa36 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:05.669953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-561563e7-0bf9-4416-9a30-1fa423d7aa36 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:05.670713 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-561563e7-0bf9-4416-9a30-1fa423d7aa36 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:05.671165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-561563e7-0bf9-4416-9a30-1fa423d7aa36 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:05.699174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-561563e7-0bf9-4416-9a30-1fa423d7aa36 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041084 Nov 02 23:17:05.699734 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1000/1575] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:05 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:06.633383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aef9b9ff-027e-4fbe-aa14-54b21fc08f77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:06.634067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aef9b9ff-027e-4fbe-aa14-54b21fc08f77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:06.640280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aef9b9ff-027e-4fbe-aa14-54b21fc08f77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:06.640716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aef9b9ff-027e-4fbe-aa14-54b21fc08f77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:06.641481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aef9b9ff-027e-4fbe-aa14-54b21fc08f77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:06.641904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aef9b9ff-027e-4fbe-aa14-54b21fc08f77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:06.778810 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aef9b9ff-027e-4fbe-aa14-54b21fc08f77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:06.787370 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aef9b9ff-027e-4fbe-aa14-54b21fc08f77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:06.788857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aef9b9ff-027e-4fbe-aa14-54b21fc08f77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:06.790001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aef9b9ff-027e-4fbe-aa14-54b21fc08f77 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.160875 Nov 02 23:17:06.790554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1001/1576] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:06 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:06.794938 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0c7f0a96-16dd-49f7-a63a-2e026cac63c4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:06.795835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0c7f0a96-16dd-49f7-a63a-2e026cac63c4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:06.801698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0c7f0a96-16dd-49f7-a63a-2e026cac63c4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:06.802138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0c7f0a96-16dd-49f7-a63a-2e026cac63c4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:06.802904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0c7f0a96-16dd-49f7-a63a-2e026cac63c4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:06.803348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0c7f0a96-16dd-49f7-a63a-2e026cac63c4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:06.832128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0c7f0a96-16dd-49f7-a63a-2e026cac63c4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040529 Nov 02 23:17:06.832685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1002/1577] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:06 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:06.837571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-963189c2-ae11-418e-a8f1-e39c801d170a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:06.838461 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-963189c2-ae11-418e-a8f1-e39c801d170a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:06.844149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-963189c2-ae11-418e-a8f1-e39c801d170a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:06.844588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-963189c2-ae11-418e-a8f1-e39c801d170a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:06.845343 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-963189c2-ae11-418e-a8f1-e39c801d170a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:06.845764 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-963189c2-ae11-418e-a8f1-e39c801d170a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:06.876538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-963189c2-ae11-418e-a8f1-e39c801d170a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042819 Nov 02 23:17:06.877102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1003/1578] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:06 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:07.808968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0f6ceb7a-1d84-4eeb-ac91-2275ff9862bb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:07.809687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0f6ceb7a-1d84-4eeb-ac91-2275ff9862bb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:07.815803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0f6ceb7a-1d84-4eeb-ac91-2275ff9862bb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:07.816243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0f6ceb7a-1d84-4eeb-ac91-2275ff9862bb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:07.817018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0f6ceb7a-1d84-4eeb-ac91-2275ff9862bb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:07.817443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0f6ceb7a-1d84-4eeb-ac91-2275ff9862bb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:07.950095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0f6ceb7a-1d84-4eeb-ac91-2275ff9862bb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:07.959099 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0f6ceb7a-1d84-4eeb-ac91-2275ff9862bb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:07.960693 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0f6ceb7a-1d84-4eeb-ac91-2275ff9862bb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:07.961850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0f6ceb7a-1d84-4eeb-ac91-2275ff9862bb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.156600 Nov 02 23:17:07.962396 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1004/1579] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:07 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:07.966801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c3856726-3f04-4bb3-b406-aac4b77f6244 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:07.967717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c3856726-3f04-4bb3-b406-aac4b77f6244 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:07.973766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3856726-3f04-4bb3-b406-aac4b77f6244 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:07.974210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3856726-3f04-4bb3-b406-aac4b77f6244 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:07.975005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3856726-3f04-4bb3-b406-aac4b77f6244 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:07.975464 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3856726-3f04-4bb3-b406-aac4b77f6244 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:08.005304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c3856726-3f04-4bb3-b406-aac4b77f6244 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041870 Nov 02 23:17:08.005867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1005/1580] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:07 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:08.010841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b77345ec-e4d3-4a35-bd74-d77308e87bce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:08.011762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b77345ec-e4d3-4a35-bd74-d77308e87bce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:08.017516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b77345ec-e4d3-4a35-bd74-d77308e87bce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:08.017958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b77345ec-e4d3-4a35-bd74-d77308e87bce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:08.018717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b77345ec-e4d3-4a35-bd74-d77308e87bce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:08.019179 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b77345ec-e4d3-4a35-bd74-d77308e87bce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:08.049075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b77345ec-e4d3-4a35-bd74-d77308e87bce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042177 Nov 02 23:17:08.049635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1006/1581] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:08 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:08.980590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-78f86a2e-c8a1-4bcc-89f6-0b5e46e202da tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:08.981252 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-78f86a2e-c8a1-4bcc-89f6-0b5e46e202da tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:08.987836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78f86a2e-c8a1-4bcc-89f6-0b5e46e202da tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:08.988293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78f86a2e-c8a1-4bcc-89f6-0b5e46e202da tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:08.989057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78f86a2e-c8a1-4bcc-89f6-0b5e46e202da tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:08.989488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78f86a2e-c8a1-4bcc-89f6-0b5e46e202da tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:09.123694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-78f86a2e-c8a1-4bcc-89f6-0b5e46e202da tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:09.132200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-78f86a2e-c8a1-4bcc-89f6-0b5e46e202da tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:09.133684 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-78f86a2e-c8a1-4bcc-89f6-0b5e46e202da tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:09.134842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-78f86a2e-c8a1-4bcc-89f6-0b5e46e202da tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.157950 Nov 02 23:17:09.135437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1007/1582] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:08 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:09.139897 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9aa2dd49-a5c1-4d83-a06c-93cd7e0e61ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:09.140796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9aa2dd49-a5c1-4d83-a06c-93cd7e0e61ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:09.146697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9aa2dd49-a5c1-4d83-a06c-93cd7e0e61ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:09.147193 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9aa2dd49-a5c1-4d83-a06c-93cd7e0e61ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:09.147962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9aa2dd49-a5c1-4d83-a06c-93cd7e0e61ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:09.148389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9aa2dd49-a5c1-4d83-a06c-93cd7e0e61ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:09.180832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9aa2dd49-a5c1-4d83-a06c-93cd7e0e61ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044346 Nov 02 23:17:09.181405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1008/1583] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:09 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:09.185767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9a113a94-25f0-4523-97e6-e198cd7eb3f7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:09.186655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9a113a94-25f0-4523-97e6-e198cd7eb3f7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:09.192743 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a113a94-25f0-4523-97e6-e198cd7eb3f7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:09.193226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a113a94-25f0-4523-97e6-e198cd7eb3f7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:09.193994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a113a94-25f0-4523-97e6-e198cd7eb3f7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:09.194417 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a113a94-25f0-4523-97e6-e198cd7eb3f7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:09.225068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9a113a94-25f0-4523-97e6-e198cd7eb3f7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042605 Nov 02 23:17:09.225622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1009/1584] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:09 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:10.153051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d241f1a9-88e9-42f7-bba8-eb12bd749291 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:10.153731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d241f1a9-88e9-42f7-bba8-eb12bd749291 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:10.159984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d241f1a9-88e9-42f7-bba8-eb12bd749291 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:10.160424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d241f1a9-88e9-42f7-bba8-eb12bd749291 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:10.161187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d241f1a9-88e9-42f7-bba8-eb12bd749291 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:10.161610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d241f1a9-88e9-42f7-bba8-eb12bd749291 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:10.508025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d241f1a9-88e9-42f7-bba8-eb12bd749291 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:10.516398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d241f1a9-88e9-42f7-bba8-eb12bd749291 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:10.517980 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d241f1a9-88e9-42f7-bba8-eb12bd749291 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:10.519187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d241f1a9-88e9-42f7-bba8-eb12bd749291 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.369916 Nov 02 23:17:10.519750 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1010/1585] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:10 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:10.524791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8e95b488-e7f6-4ba2-908d-50da6eb0073b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:10.525702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8e95b488-e7f6-4ba2-908d-50da6eb0073b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:10.532019 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e95b488-e7f6-4ba2-908d-50da6eb0073b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:10.532502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e95b488-e7f6-4ba2-908d-50da6eb0073b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:10.533236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e95b488-e7f6-4ba2-908d-50da6eb0073b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:10.533662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e95b488-e7f6-4ba2-908d-50da6eb0073b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:10.565551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8e95b488-e7f6-4ba2-908d-50da6eb0073b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044728 Nov 02 23:17:10.566138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1011/1586] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:10 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:10.571349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1fb4f5f0-c537-408d-bfc5-6551c43854f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:10.572253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1fb4f5f0-c537-408d-bfc5-6551c43854f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:10.578438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fb4f5f0-c537-408d-bfc5-6551c43854f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:10.578877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fb4f5f0-c537-408d-bfc5-6551c43854f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:10.579676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fb4f5f0-c537-408d-bfc5-6551c43854f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:10.580106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fb4f5f0-c537-408d-bfc5-6551c43854f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:10.612792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1fb4f5f0-c537-408d-bfc5-6551c43854f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045569 Nov 02 23:17:10.613423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1012/1587] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:10 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:11.538301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-405eb9c6-cbed-432b-8777-c100fc599811 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:11.539017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-405eb9c6-cbed-432b-8777-c100fc599811 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:11.545186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-405eb9c6-cbed-432b-8777-c100fc599811 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:11.545633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-405eb9c6-cbed-432b-8777-c100fc599811 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:11.546415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-405eb9c6-cbed-432b-8777-c100fc599811 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:11.546849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-405eb9c6-cbed-432b-8777-c100fc599811 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:11.720923 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-405eb9c6-cbed-432b-8777-c100fc599811 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:11.729058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-405eb9c6-cbed-432b-8777-c100fc599811 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:11.730550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-405eb9c6-cbed-432b-8777-c100fc599811 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:11.731732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-405eb9c6-cbed-432b-8777-c100fc599811 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.197196 Nov 02 23:17:11.732291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1013/1588] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:11 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:11.736692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e3381caf-351c-4348-939d-c37f873c8665 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:11.737592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e3381caf-351c-4348-939d-c37f873c8665 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:11.744591 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3381caf-351c-4348-939d-c37f873c8665 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:11.745166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3381caf-351c-4348-939d-c37f873c8665 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:11.745905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3381caf-351c-4348-939d-c37f873c8665 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:11.746390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3381caf-351c-4348-939d-c37f873c8665 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:11.775333 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e3381caf-351c-4348-939d-c37f873c8665 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041976 Nov 02 23:17:11.775892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1014/1589] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:11 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:11.780294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4222924f-fa4d-4a5f-ad07-b43bc61addaf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:11.781178 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4222924f-fa4d-4a5f-ad07-b43bc61addaf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:11.786655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4222924f-fa4d-4a5f-ad07-b43bc61addaf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:11.787167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4222924f-fa4d-4a5f-ad07-b43bc61addaf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:11.787923 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4222924f-fa4d-4a5f-ad07-b43bc61addaf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:11.788360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4222924f-fa4d-4a5f-ad07-b43bc61addaf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:11.817737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4222924f-fa4d-4a5f-ad07-b43bc61addaf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040837 Nov 02 23:17:11.818290 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1015/1590] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:11 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:12.750864 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-745b86b1-b021-4d65-8354-cfd509a7d7ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:12.751530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-745b86b1-b021-4d65-8354-cfd509a7d7ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:12.757736 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-745b86b1-b021-4d65-8354-cfd509a7d7ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:12.758177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-745b86b1-b021-4d65-8354-cfd509a7d7ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:12.758969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-745b86b1-b021-4d65-8354-cfd509a7d7ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:12.759405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-745b86b1-b021-4d65-8354-cfd509a7d7ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:12.891017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-745b86b1-b021-4d65-8354-cfd509a7d7ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:12.900389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-745b86b1-b021-4d65-8354-cfd509a7d7ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:12.901518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-745b86b1-b021-4d65-8354-cfd509a7d7ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:12.902697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-745b86b1-b021-4d65-8354-cfd509a7d7ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.155679 Nov 02 23:17:12.903330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1016/1591] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:12 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:12.907698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cbff2a60-72c8-4af3-af01-10f4494576e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:12.908590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cbff2a60-72c8-4af3-af01-10f4494576e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:12.914870 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cbff2a60-72c8-4af3-af01-10f4494576e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:12.915352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cbff2a60-72c8-4af3-af01-10f4494576e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:12.916129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cbff2a60-72c8-4af3-af01-10f4494576e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:12.916567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cbff2a60-72c8-4af3-af01-10f4494576e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:12.945698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cbff2a60-72c8-4af3-af01-10f4494576e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041335 Nov 02 23:17:12.946260 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1017/1592] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:12 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:12.951047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9d8e44e5-b975-4180-b338-f75ed2b1b994 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:12.951957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9d8e44e5-b975-4180-b338-f75ed2b1b994 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:12.957682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d8e44e5-b975-4180-b338-f75ed2b1b994 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:12.958129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d8e44e5-b975-4180-b338-f75ed2b1b994 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:12.958966 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d8e44e5-b975-4180-b338-f75ed2b1b994 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:12.959406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d8e44e5-b975-4180-b338-f75ed2b1b994 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:12.988357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9d8e44e5-b975-4180-b338-f75ed2b1b994 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041060 Nov 02 23:17:12.988923 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1018/1593] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:12 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:13.920984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5a8eb28c-494c-4f00-841c-355fd96d04f2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:13.921627 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5a8eb28c-494c-4f00-841c-355fd96d04f2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:13.927979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a8eb28c-494c-4f00-841c-355fd96d04f2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:13.928423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a8eb28c-494c-4f00-841c-355fd96d04f2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:13.929717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a8eb28c-494c-4f00-841c-355fd96d04f2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:13.930146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a8eb28c-494c-4f00-841c-355fd96d04f2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:14.065770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5a8eb28c-494c-4f00-841c-355fd96d04f2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:14.074737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5a8eb28c-494c-4f00-841c-355fd96d04f2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:14.076498 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5a8eb28c-494c-4f00-841c-355fd96d04f2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:14.077634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5a8eb28c-494c-4f00-841c-355fd96d04f2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.160546 Nov 02 23:17:14.078183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1019/1594] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:13 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:14.082555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4b7f870a-f29e-4322-83ec-5e25a0384cb6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:14.083470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4b7f870a-f29e-4322-83ec-5e25a0384cb6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:14.089162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b7f870a-f29e-4322-83ec-5e25a0384cb6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:14.089600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b7f870a-f29e-4322-83ec-5e25a0384cb6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:14.090365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b7f870a-f29e-4322-83ec-5e25a0384cb6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:14.090789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b7f870a-f29e-4322-83ec-5e25a0384cb6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:14.123869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4b7f870a-f29e-4322-83ec-5e25a0384cb6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044591 Nov 02 23:17:14.124470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1020/1595] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:14 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:14.198629 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-15c3581c-8a88-4617-b88f-e7bdb589d6d9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:14.199592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-15c3581c-8a88-4617-b88f-e7bdb589d6d9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:14.206152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15c3581c-8a88-4617-b88f-e7bdb589d6d9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:14.206600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15c3581c-8a88-4617-b88f-e7bdb589d6d9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:14.207518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15c3581c-8a88-4617-b88f-e7bdb589d6d9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:14.207956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15c3581c-8a88-4617-b88f-e7bdb589d6d9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:14.240793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-15c3581c-8a88-4617-b88f-e7bdb589d6d9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115225 Nov 02 23:17:14.241387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1021/1596] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:14 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:15.096801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3b790dad-c647-44e7-a144-567538c3eae1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:15.097445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3b790dad-c647-44e7-a144-567538c3eae1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:15.104431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b790dad-c647-44e7-a144-567538c3eae1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:15.104873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b790dad-c647-44e7-a144-567538c3eae1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:15.105657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b790dad-c647-44e7-a144-567538c3eae1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:15.106094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b790dad-c647-44e7-a144-567538c3eae1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:15.241357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3b790dad-c647-44e7-a144-567538c3eae1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:15.249697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3b790dad-c647-44e7-a144-567538c3eae1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:15.251210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3b790dad-c647-44e7-a144-567538c3eae1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:15.252371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3b790dad-c647-44e7-a144-567538c3eae1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.159370 Nov 02 23:17:15.252924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1022/1597] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:15 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:15.257293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c4c89c19-4d52-438d-a7d3-76b3b14c318a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:15.258192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c4c89c19-4d52-438d-a7d3-76b3b14c318a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:15.264040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4c89c19-4d52-438d-a7d3-76b3b14c318a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:15.264490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4c89c19-4d52-438d-a7d3-76b3b14c318a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:15.265261 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4c89c19-4d52-438d-a7d3-76b3b14c318a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:15.265693 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4c89c19-4d52-438d-a7d3-76b3b14c318a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:15.296538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c4c89c19-4d52-438d-a7d3-76b3b14c318a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042536 Nov 02 23:17:15.297131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1023/1598] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:15 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:15.301868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-01659833-2caf-4f2f-916e-fd868ce1c1f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:15.302791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-01659833-2caf-4f2f-916e-fd868ce1c1f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:15.308982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-01659833-2caf-4f2f-916e-fd868ce1c1f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:15.309425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-01659833-2caf-4f2f-916e-fd868ce1c1f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:15.310209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-01659833-2caf-4f2f-916e-fd868ce1c1f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:15.310636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-01659833-2caf-4f2f-916e-fd868ce1c1f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:15.339780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-01659833-2caf-4f2f-916e-fd868ce1c1f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041609 Nov 02 23:17:15.340342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1024/1599] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:15 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:16.270304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2faff006-49ba-4437-9121-2624c875dcf5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:16.270966 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2faff006-49ba-4437-9121-2624c875dcf5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:16.277721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2faff006-49ba-4437-9121-2624c875dcf5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:16.278166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2faff006-49ba-4437-9121-2624c875dcf5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:16.278958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2faff006-49ba-4437-9121-2624c875dcf5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:16.279404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2faff006-49ba-4437-9121-2624c875dcf5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:16.417057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2faff006-49ba-4437-9121-2624c875dcf5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:16.426251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2faff006-49ba-4437-9121-2624c875dcf5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:16.427824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2faff006-49ba-4437-9121-2624c875dcf5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:16.429005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2faff006-49ba-4437-9121-2624c875dcf5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.162348 Nov 02 23:17:16.429552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1025/1600] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:16 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:16.433906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-681b3836-06b4-4cc5-b8f8-7159f8ef0d35 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:16.434802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-681b3836-06b4-4cc5-b8f8-7159f8ef0d35 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:16.441023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-681b3836-06b4-4cc5-b8f8-7159f8ef0d35 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:16.441513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-681b3836-06b4-4cc5-b8f8-7159f8ef0d35 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:16.442301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-681b3836-06b4-4cc5-b8f8-7159f8ef0d35 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:16.442763 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-681b3836-06b4-4cc5-b8f8-7159f8ef0d35 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:16.476641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-681b3836-06b4-4cc5-b8f8-7159f8ef0d35 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045880 Nov 02 23:17:16.477255 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1026/1601] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:16 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:16.482049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4cbdc22d-8c9f-40ce-a9e6-d8a785c539a4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:16.483084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4cbdc22d-8c9f-40ce-a9e6-d8a785c539a4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:16.489403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4cbdc22d-8c9f-40ce-a9e6-d8a785c539a4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:16.489848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4cbdc22d-8c9f-40ce-a9e6-d8a785c539a4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:16.490642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4cbdc22d-8c9f-40ce-a9e6-d8a785c539a4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:16.491124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4cbdc22d-8c9f-40ce-a9e6-d8a785c539a4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:16.520867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4cbdc22d-8c9f-40ce-a9e6-d8a785c539a4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042521 Nov 02 23:17:16.521436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1027/1602] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:16 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:16.724621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:17:16.724621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:17:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 23:17:17.447677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-05b35c63-19a6-4e28-82da-32876eae05d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:17.448728 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-05b35c63-19a6-4e28-82da-32876eae05d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:17.455832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05b35c63-19a6-4e28-82da-32876eae05d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:17.456278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05b35c63-19a6-4e28-82da-32876eae05d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:17.457078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05b35c63-19a6-4e28-82da-32876eae05d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:17.457510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05b35c63-19a6-4e28-82da-32876eae05d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:17.596215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-05b35c63-19a6-4e28-82da-32876eae05d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:17.598552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:17:17.598776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:17:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e (ip 10.222.0.41) !!! Nov 02 23:17:17.619549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-05b35c63-19a6-4e28-82da-32876eae05d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:17.621463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-05b35c63-19a6-4e28-82da-32876eae05d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:17.623063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-05b35c63-19a6-4e28-82da-32876eae05d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.179736 Nov 02 23:17:17.624166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1028/1603] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:17 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:17.628902 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2b7f25f7-c3c7-415a-81e7-0297d828ef32 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:17.629802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2b7f25f7-c3c7-415a-81e7-0297d828ef32 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:17.636511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b7f25f7-c3c7-415a-81e7-0297d828ef32 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:17.636951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b7f25f7-c3c7-415a-81e7-0297d828ef32 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:17.637739 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b7f25f7-c3c7-415a-81e7-0297d828ef32 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:17.638147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b7f25f7-c3c7-415a-81e7-0297d828ef32 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:17.668516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2b7f25f7-c3c7-415a-81e7-0297d828ef32 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043225 Nov 02 23:17:17.669154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1029/1604] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:17 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:17.673529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-59a9578e-1621-4de5-a0b2-38c2b91a37b0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:17.674419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-59a9578e-1621-4de5-a0b2-38c2b91a37b0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:17.680852 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59a9578e-1621-4de5-a0b2-38c2b91a37b0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:17.681295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59a9578e-1621-4de5-a0b2-38c2b91a37b0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:17.682068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59a9578e-1621-4de5-a0b2-38c2b91a37b0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:17.682494 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59a9578e-1621-4de5-a0b2-38c2b91a37b0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:17.711968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-59a9578e-1621-4de5-a0b2-38c2b91a37b0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041770 Nov 02 23:17:17.712514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1030/1605] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:17 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:18.642011 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f5cb94ef-d86a-4c39-a346-975f18e11a1e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:18.642690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f5cb94ef-d86a-4c39-a346-975f18e11a1e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:18.648970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f5cb94ef-d86a-4c39-a346-975f18e11a1e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:18.649423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f5cb94ef-d86a-4c39-a346-975f18e11a1e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:18.650209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f5cb94ef-d86a-4c39-a346-975f18e11a1e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:18.650673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f5cb94ef-d86a-4c39-a346-975f18e11a1e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:18.792256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f5cb94ef-d86a-4c39-a346-975f18e11a1e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:18.800928 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f5cb94ef-d86a-4c39-a346-975f18e11a1e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:18.802422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f5cb94ef-d86a-4c39-a346-975f18e11a1e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:18.803622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f5cb94ef-d86a-4c39-a346-975f18e11a1e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.165393 Nov 02 23:17:18.804891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1031/1606] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:18 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:18.809523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6f127c87-3b30-41d4-b7bb-51804b8d5ef3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:18.810431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6f127c87-3b30-41d4-b7bb-51804b8d5ef3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:18.816712 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f127c87-3b30-41d4-b7bb-51804b8d5ef3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:18.817267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f127c87-3b30-41d4-b7bb-51804b8d5ef3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:18.817928 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f127c87-3b30-41d4-b7bb-51804b8d5ef3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:18.821497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f127c87-3b30-41d4-b7bb-51804b8d5ef3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:18.852340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6f127c87-3b30-41d4-b7bb-51804b8d5ef3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046515 Nov 02 23:17:18.852917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1032/1607] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:18 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:18.857268 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-17c8e7ea-b69e-435f-8326-6dfcb3e2b8b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:18.858164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-17c8e7ea-b69e-435f-8326-6dfcb3e2b8b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:18.863836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17c8e7ea-b69e-435f-8326-6dfcb3e2b8b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:18.864281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17c8e7ea-b69e-435f-8326-6dfcb3e2b8b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:18.865076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17c8e7ea-b69e-435f-8326-6dfcb3e2b8b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:18.865510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17c8e7ea-b69e-435f-8326-6dfcb3e2b8b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:18.895163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-17c8e7ea-b69e-435f-8326-6dfcb3e2b8b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041102 Nov 02 23:17:18.895642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1033/1608] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:18 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:19.821983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-447af9b9-100a-4a11-9944-5cec9f680e44 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:19.822663 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-447af9b9-100a-4a11-9944-5cec9f680e44 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:19.829447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-447af9b9-100a-4a11-9944-5cec9f680e44 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:19.829897 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-447af9b9-100a-4a11-9944-5cec9f680e44 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:19.830676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-447af9b9-100a-4a11-9944-5cec9f680e44 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:19.831139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-447af9b9-100a-4a11-9944-5cec9f680e44 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:19.962275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-447af9b9-100a-4a11-9944-5cec9f680e44 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:19.970447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-447af9b9-100a-4a11-9944-5cec9f680e44 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:19.972209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-447af9b9-100a-4a11-9944-5cec9f680e44 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:19.973132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-447af9b9-100a-4a11-9944-5cec9f680e44 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.155442 Nov 02 23:17:19.973763 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1034/1609] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:19 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:19.978001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-eea8d2f7-ac2d-4154-be9b-3fb56b7fdee5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:19.979145 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-eea8d2f7-ac2d-4154-be9b-3fb56b7fdee5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:19.984688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eea8d2f7-ac2d-4154-be9b-3fb56b7fdee5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:19.985135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eea8d2f7-ac2d-4154-be9b-3fb56b7fdee5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:19.985909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eea8d2f7-ac2d-4154-be9b-3fb56b7fdee5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:19.986344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eea8d2f7-ac2d-4154-be9b-3fb56b7fdee5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:20.016766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-eea8d2f7-ac2d-4154-be9b-3fb56b7fdee5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042054 Nov 02 23:17:20.020724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1035/1610] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:19 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:20.021705 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2df86863-34aa-48b3-a553-595fe8f8ea0f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:20.022622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2df86863-34aa-48b3-a553-595fe8f8ea0f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:20.028560 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2df86863-34aa-48b3-a553-595fe8f8ea0f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:20.029018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2df86863-34aa-48b3-a553-595fe8f8ea0f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:20.029824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2df86863-34aa-48b3-a553-595fe8f8ea0f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:20.030284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2df86863-34aa-48b3-a553-595fe8f8ea0f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:20.060286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2df86863-34aa-48b3-a553-595fe8f8ea0f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041915 Nov 02 23:17:20.060856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1036/1611] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:20 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:20.990968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4239ee94-e570-4b0c-8d98-3d33fc1f03fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:20.991628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4239ee94-e570-4b0c-8d98-3d33fc1f03fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:20.997811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4239ee94-e570-4b0c-8d98-3d33fc1f03fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:20.998270 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4239ee94-e570-4b0c-8d98-3d33fc1f03fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:20.999061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4239ee94-e570-4b0c-8d98-3d33fc1f03fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:20.999528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4239ee94-e570-4b0c-8d98-3d33fc1f03fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:21.133857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4239ee94-e570-4b0c-8d98-3d33fc1f03fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:21.142077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4239ee94-e570-4b0c-8d98-3d33fc1f03fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:21.143591 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4239ee94-e570-4b0c-8d98-3d33fc1f03fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:21.144743 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4239ee94-e570-4b0c-8d98-3d33fc1f03fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.157540 Nov 02 23:17:21.145301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1037/1612] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:20 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:21.150312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b37550db-e1d6-4ac0-9c18-df20c79b7fa2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:21.151232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b37550db-e1d6-4ac0-9c18-df20c79b7fa2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:21.157069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b37550db-e1d6-4ac0-9c18-df20c79b7fa2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:21.157513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b37550db-e1d6-4ac0-9c18-df20c79b7fa2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:21.158280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b37550db-e1d6-4ac0-9c18-df20c79b7fa2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:21.158709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b37550db-e1d6-4ac0-9c18-df20c79b7fa2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:21.188129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b37550db-e1d6-4ac0-9c18-df20c79b7fa2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041799 Nov 02 23:17:21.191827 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1038/1613] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:21 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:21.193844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fbb77430-1b0f-4399-bf9c-c450d1de7bed tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:21.195344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fbb77430-1b0f-4399-bf9c-c450d1de7bed tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:21.202021 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbb77430-1b0f-4399-bf9c-c450d1de7bed tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:21.202469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbb77430-1b0f-4399-bf9c-c450d1de7bed tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:21.203278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbb77430-1b0f-4399-bf9c-c450d1de7bed tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:21.203730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbb77430-1b0f-4399-bf9c-c450d1de7bed tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:21.233043 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fbb77430-1b0f-4399-bf9c-c450d1de7bed tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042835 Nov 02 23:17:21.233606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1039/1614] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:21 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:22.163456 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3386043b-24ef-472a-96fa-8292ca108e2d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:22.164097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3386043b-24ef-472a-96fa-8292ca108e2d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:22.170393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3386043b-24ef-472a-96fa-8292ca108e2d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:22.170829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3386043b-24ef-472a-96fa-8292ca108e2d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:22.171693 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3386043b-24ef-472a-96fa-8292ca108e2d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:22.172076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3386043b-24ef-472a-96fa-8292ca108e2d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:22.302943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3386043b-24ef-472a-96fa-8292ca108e2d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:22.311698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3386043b-24ef-472a-96fa-8292ca108e2d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:22.313190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3386043b-24ef-472a-96fa-8292ca108e2d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:22.314346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3386043b-24ef-472a-96fa-8292ca108e2d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.154607 Nov 02 23:17:22.314932 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1040/1615] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:22 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:22.319264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f8141dd6-d90a-4d5d-a7ac-7108b190d884 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:22.320788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f8141dd6-d90a-4d5d-a7ac-7108b190d884 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:22.326947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8141dd6-d90a-4d5d-a7ac-7108b190d884 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:22.327434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8141dd6-d90a-4d5d-a7ac-7108b190d884 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:22.328294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8141dd6-d90a-4d5d-a7ac-7108b190d884 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:22.328773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8141dd6-d90a-4d5d-a7ac-7108b190d884 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:22.358115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f8141dd6-d90a-4d5d-a7ac-7108b190d884 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042173 Nov 02 23:17:22.358673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1041/1616] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:22 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:22.362978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a3d6fed7-f7e7-4c3b-8f40-b5c1ec490435 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:22.363867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a3d6fed7-f7e7-4c3b-8f40-b5c1ec490435 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:22.370104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3d6fed7-f7e7-4c3b-8f40-b5c1ec490435 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:22.370582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3d6fed7-f7e7-4c3b-8f40-b5c1ec490435 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:22.371391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3d6fed7-f7e7-4c3b-8f40-b5c1ec490435 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:22.371830 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3d6fed7-f7e7-4c3b-8f40-b5c1ec490435 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:22.403447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a3d6fed7-f7e7-4c3b-8f40-b5c1ec490435 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043630 Nov 02 23:17:22.404040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1042/1617] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:22 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:23.384915 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-770b6d38-2a27-4947-8fe4-a427a50b1f59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:23.385599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-770b6d38-2a27-4947-8fe4-a427a50b1f59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:23.392001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-770b6d38-2a27-4947-8fe4-a427a50b1f59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:23.392452 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-770b6d38-2a27-4947-8fe4-a427a50b1f59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:23.393284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-770b6d38-2a27-4947-8fe4-a427a50b1f59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:23.393718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-770b6d38-2a27-4947-8fe4-a427a50b1f59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:23.539187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-770b6d38-2a27-4947-8fe4-a427a50b1f59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:23.548980 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-770b6d38-2a27-4947-8fe4-a427a50b1f59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:23.550466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-770b6d38-2a27-4947-8fe4-a427a50b1f59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:23.551735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-770b6d38-2a27-4947-8fe4-a427a50b1f59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.221928 Nov 02 23:17:23.552405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1043/1618] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:23 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:23.556972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2be7eda3-7f24-4345-96f1-1bf473c6c43e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:23.557877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2be7eda3-7f24-4345-96f1-1bf473c6c43e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:23.563930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2be7eda3-7f24-4345-96f1-1bf473c6c43e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:23.564367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2be7eda3-7f24-4345-96f1-1bf473c6c43e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:23.565134 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2be7eda3-7f24-4345-96f1-1bf473c6c43e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:23.565559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2be7eda3-7f24-4345-96f1-1bf473c6c43e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:23.595234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2be7eda3-7f24-4345-96f1-1bf473c6c43e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041685 Nov 02 23:17:23.595703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1044/1619] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:23 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:23.599956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9f708b09-b5c9-450e-9c4a-df2af1754b2f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:23.601404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9f708b09-b5c9-450e-9c4a-df2af1754b2f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:23.607051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f708b09-b5c9-450e-9c4a-df2af1754b2f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:23.607491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f708b09-b5c9-450e-9c4a-df2af1754b2f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:23.608247 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f708b09-b5c9-450e-9c4a-df2af1754b2f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:23.608670 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f708b09-b5c9-450e-9c4a-df2af1754b2f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:23.638058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9f708b09-b5c9-450e-9c4a-df2af1754b2f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041340 Nov 02 23:17:23.638617 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1045/1620] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:23 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:24.570034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3cc09a32-f763-49a2-b961-4c5a8a02a762 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:24.570718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3cc09a32-f763-49a2-b961-4c5a8a02a762 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:24.577176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3cc09a32-f763-49a2-b961-4c5a8a02a762 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:24.577617 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3cc09a32-f763-49a2-b961-4c5a8a02a762 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:24.578377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3cc09a32-f763-49a2-b961-4c5a8a02a762 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:24.578814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3cc09a32-f763-49a2-b961-4c5a8a02a762 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:24.709674 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3cc09a32-f763-49a2-b961-4c5a8a02a762 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:24.718683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3cc09a32-f763-49a2-b961-4c5a8a02a762 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:24.720018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3cc09a32-f763-49a2-b961-4c5a8a02a762 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:24.721279 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3cc09a32-f763-49a2-b961-4c5a8a02a762 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.154884 Nov 02 23:17:24.721734 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1046/1621] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:24 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:24.726040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-79d5afee-030d-4450-bc64-ea17f8c7acf8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:24.726943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-79d5afee-030d-4450-bc64-ea17f8c7acf8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:24.732619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79d5afee-030d-4450-bc64-ea17f8c7acf8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:24.733061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79d5afee-030d-4450-bc64-ea17f8c7acf8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:24.736706 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79d5afee-030d-4450-bc64-ea17f8c7acf8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:24.736706 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79d5afee-030d-4450-bc64-ea17f8c7acf8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:24.763422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-79d5afee-030d-4450-bc64-ea17f8c7acf8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040644 Nov 02 23:17:24.763977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1047/1622] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:24 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:24.768160 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-470c49fc-e9aa-42c2-9873-cb17860e79fb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:24.769026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-470c49fc-e9aa-42c2-9873-cb17860e79fb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:24.775020 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-470c49fc-e9aa-42c2-9873-cb17860e79fb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:24.775455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-470c49fc-e9aa-42c2-9873-cb17860e79fb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:24.776204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-470c49fc-e9aa-42c2-9873-cb17860e79fb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:24.776626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-470c49fc-e9aa-42c2-9873-cb17860e79fb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:24.804060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-470c49fc-e9aa-42c2-9873-cb17860e79fb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039115 Nov 02 23:17:24.804599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1048/1623] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:24 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:25.739141 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-424b8186-3e09-4070-9e96-3f94f1ed88d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:25.739796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-424b8186-3e09-4070-9e96-3f94f1ed88d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:25.746023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-424b8186-3e09-4070-9e96-3f94f1ed88d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:25.746464 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-424b8186-3e09-4070-9e96-3f94f1ed88d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:25.747280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-424b8186-3e09-4070-9e96-3f94f1ed88d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:25.747707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-424b8186-3e09-4070-9e96-3f94f1ed88d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:25.881410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-424b8186-3e09-4070-9e96-3f94f1ed88d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:25.894349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-424b8186-3e09-4070-9e96-3f94f1ed88d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:25.896671 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-424b8186-3e09-4070-9e96-3f94f1ed88d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:25.898958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-424b8186-3e09-4070-9e96-3f94f1ed88d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.163410 Nov 02 23:17:25.899663 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1049/1624] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:25 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:25.905988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-94a03899-6f47-4bca-be9f-d41d2d0cfa1d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:25.907324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-94a03899-6f47-4bca-be9f-d41d2d0cfa1d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:25.915516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94a03899-6f47-4bca-be9f-d41d2d0cfa1d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:25.915960 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94a03899-6f47-4bca-be9f-d41d2d0cfa1d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:25.916736 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94a03899-6f47-4bca-be9f-d41d2d0cfa1d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:25.917163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94a03899-6f47-4bca-be9f-d41d2d0cfa1d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:25.946195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-94a03899-6f47-4bca-be9f-d41d2d0cfa1d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045405 Nov 02 23:17:25.947423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1050/1625] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:25 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:25.952230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2f4d9cb1-c18a-4b8d-a271-f77bd46e2fc3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:25.953117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2f4d9cb1-c18a-4b8d-a271-f77bd46e2fc3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:25.958772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2f4d9cb1-c18a-4b8d-a271-f77bd46e2fc3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:25.959240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2f4d9cb1-c18a-4b8d-a271-f77bd46e2fc3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:25.960637 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2f4d9cb1-c18a-4b8d-a271-f77bd46e2fc3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:25.961059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2f4d9cb1-c18a-4b8d-a271-f77bd46e2fc3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:25.999114 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2f4d9cb1-c18a-4b8d-a271-f77bd46e2fc3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050530 Nov 02 23:17:25.999623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1051/1626] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:25 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:26.919246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-506d80fa-8d03-48cc-90e3-4f3671dc4c1f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:26.920183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-506d80fa-8d03-48cc-90e3-4f3671dc4c1f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:26.926053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-506d80fa-8d03-48cc-90e3-4f3671dc4c1f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:26.926487 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-506d80fa-8d03-48cc-90e3-4f3671dc4c1f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:26.927274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-506d80fa-8d03-48cc-90e3-4f3671dc4c1f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:26.927701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-506d80fa-8d03-48cc-90e3-4f3671dc4c1f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:27.063857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-506d80fa-8d03-48cc-90e3-4f3671dc4c1f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:27.072112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-506d80fa-8d03-48cc-90e3-4f3671dc4c1f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:27.073586 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-506d80fa-8d03-48cc-90e3-4f3671dc4c1f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:27.074718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-506d80fa-8d03-48cc-90e3-4f3671dc4c1f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.159230 Nov 02 23:17:27.075318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1052/1627] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:26 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:27.079965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6654ff55-b041-4afc-a49c-148ee4f84737 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:27.080874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6654ff55-b041-4afc-a49c-148ee4f84737 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:27.087118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6654ff55-b041-4afc-a49c-148ee4f84737 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:27.087562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6654ff55-b041-4afc-a49c-148ee4f84737 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:27.088376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6654ff55-b041-4afc-a49c-148ee4f84737 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:27.088836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6654ff55-b041-4afc-a49c-148ee4f84737 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:27.119221 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6654ff55-b041-4afc-a49c-148ee4f84737 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042578 Nov 02 23:17:27.122848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1053/1628] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:27 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:27.124480 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ec19c80e-20a9-4c50-b869-338eda01cc1f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:27.125403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ec19c80e-20a9-4c50-b869-338eda01cc1f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:27.131786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec19c80e-20a9-4c50-b869-338eda01cc1f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:27.132235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec19c80e-20a9-4c50-b869-338eda01cc1f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:27.133016 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec19c80e-20a9-4c50-b869-338eda01cc1f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:27.133453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec19c80e-20a9-4c50-b869-338eda01cc1f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:27.169431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ec19c80e-20a9-4c50-b869-338eda01cc1f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048176 Nov 02 23:17:27.170705 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1054/1629] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:27 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:28.093046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-837f7f3f-37cb-4140-a169-e32d1cae2584 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:28.093759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-837f7f3f-37cb-4140-a169-e32d1cae2584 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:28.100739 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-837f7f3f-37cb-4140-a169-e32d1cae2584 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:28.101181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-837f7f3f-37cb-4140-a169-e32d1cae2584 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:28.101980 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-837f7f3f-37cb-4140-a169-e32d1cae2584 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:28.102410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-837f7f3f-37cb-4140-a169-e32d1cae2584 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:28.247045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-837f7f3f-37cb-4140-a169-e32d1cae2584 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:28.258325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-837f7f3f-37cb-4140-a169-e32d1cae2584 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:28.261231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-837f7f3f-37cb-4140-a169-e32d1cae2584 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:28.263258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-837f7f3f-37cb-4140-a169-e32d1cae2584 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.173830 Nov 02 23:17:28.264237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1055/1630] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:28 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:28.272079 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-73a39e9e-8936-4591-b18d-657ec843101f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:28.275280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-73a39e9e-8936-4591-b18d-657ec843101f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:28.281416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73a39e9e-8936-4591-b18d-657ec843101f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:28.282438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73a39e9e-8936-4591-b18d-657ec843101f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:28.282702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73a39e9e-8936-4591-b18d-657ec843101f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:28.283164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73a39e9e-8936-4591-b18d-657ec843101f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:28.313074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-73a39e9e-8936-4591-b18d-657ec843101f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047461 Nov 02 23:17:28.313639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1056/1631] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:28 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:28.318040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-70181798-fb2a-4ab6-8b7f-6420a1e9da95 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:28.318965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-70181798-fb2a-4ab6-8b7f-6420a1e9da95 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:28.325923 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-70181798-fb2a-4ab6-8b7f-6420a1e9da95 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:28.326378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-70181798-fb2a-4ab6-8b7f-6420a1e9da95 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:28.327232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-70181798-fb2a-4ab6-8b7f-6420a1e9da95 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:28.327661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-70181798-fb2a-4ab6-8b7f-6420a1e9da95 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:28.357311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-70181798-fb2a-4ab6-8b7f-6420a1e9da95 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042616 Nov 02 23:17:28.357924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1057/1632] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:28 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:29.282190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fd6fe9d2-2770-4585-b08e-65528d7717eb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:29.282963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fd6fe9d2-2770-4585-b08e-65528d7717eb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:29.289805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd6fe9d2-2770-4585-b08e-65528d7717eb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:29.290394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd6fe9d2-2770-4585-b08e-65528d7717eb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:29.291291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd6fe9d2-2770-4585-b08e-65528d7717eb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:29.291790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd6fe9d2-2770-4585-b08e-65528d7717eb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:29.439240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fd6fe9d2-2770-4585-b08e-65528d7717eb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:29.448811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fd6fe9d2-2770-4585-b08e-65528d7717eb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:29.450312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fd6fe9d2-2770-4585-b08e-65528d7717eb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:29.451848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fd6fe9d2-2770-4585-b08e-65528d7717eb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.174360 Nov 02 23:17:29.452475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1058/1633] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:29 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:29.457256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-88da6e02-5f77-4a9e-bbb2-3f26d31cd8b7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:29.457904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-88da6e02-5f77-4a9e-bbb2-3f26d31cd8b7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:29.466084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88da6e02-5f77-4a9e-bbb2-3f26d31cd8b7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:29.466516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88da6e02-5f77-4a9e-bbb2-3f26d31cd8b7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:29.467371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88da6e02-5f77-4a9e-bbb2-3f26d31cd8b7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:29.467808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88da6e02-5f77-4a9e-bbb2-3f26d31cd8b7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:29.499766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-88da6e02-5f77-4a9e-bbb2-3f26d31cd8b7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046305 Nov 02 23:17:29.500341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1059/1634] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:29 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:29.504759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c0d8cd30-8e45-4fc3-9241-0a6bd9cda84a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:29.505659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c0d8cd30-8e45-4fc3-9241-0a6bd9cda84a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:29.511965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0d8cd30-8e45-4fc3-9241-0a6bd9cda84a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:29.512401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0d8cd30-8e45-4fc3-9241-0a6bd9cda84a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:29.513204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0d8cd30-8e45-4fc3-9241-0a6bd9cda84a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:29.513592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0d8cd30-8e45-4fc3-9241-0a6bd9cda84a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:29.544562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c0d8cd30-8e45-4fc3-9241-0a6bd9cda84a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043171 Nov 02 23:17:29.545150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1060/1635] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:29 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:30.472995 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ebb71f53-8e15-4b94-8944-207cad0559d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:30.473659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ebb71f53-8e15-4b94-8944-207cad0559d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:30.479903 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ebb71f53-8e15-4b94-8944-207cad0559d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:30.480352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ebb71f53-8e15-4b94-8944-207cad0559d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:30.481132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ebb71f53-8e15-4b94-8944-207cad0559d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:30.481588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ebb71f53-8e15-4b94-8944-207cad0559d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:30.618108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ebb71f53-8e15-4b94-8944-207cad0559d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:30.627112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ebb71f53-8e15-4b94-8944-207cad0559d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:30.628605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ebb71f53-8e15-4b94-8944-207cad0559d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:30.629775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ebb71f53-8e15-4b94-8944-207cad0559d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.160526 Nov 02 23:17:30.630348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1061/1636] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:30 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:30.634964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-77ffd721-6ac1-4c81-bfae-d00b0c5143f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:30.635886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-77ffd721-6ac1-4c81-bfae-d00b0c5143f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:30.642435 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-77ffd721-6ac1-4c81-bfae-d00b0c5143f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:30.642879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-77ffd721-6ac1-4c81-bfae-d00b0c5143f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:30.643701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-77ffd721-6ac1-4c81-bfae-d00b0c5143f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:30.644138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-77ffd721-6ac1-4c81-bfae-d00b0c5143f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:30.675245 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-77ffd721-6ac1-4c81-bfae-d00b0c5143f3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043738 Nov 02 23:17:30.675885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1062/1637] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:30 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:30.680978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-50cd3cca-7ba0-4f47-9764-ec629476e741 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:30.681891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-50cd3cca-7ba0-4f47-9764-ec629476e741 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:30.687842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50cd3cca-7ba0-4f47-9764-ec629476e741 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:30.688287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50cd3cca-7ba0-4f47-9764-ec629476e741 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:30.689059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50cd3cca-7ba0-4f47-9764-ec629476e741 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:30.689492 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50cd3cca-7ba0-4f47-9764-ec629476e741 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:30.726648 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-50cd3cca-7ba0-4f47-9764-ec629476e741 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049668 Nov 02 23:17:30.727254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1063/1638] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:30 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:31.648124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c99d298a-73d8-4281-b09c-a0f65be0e972 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:31.648771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c99d298a-73d8-4281-b09c-a0f65be0e972 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:31.655051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c99d298a-73d8-4281-b09c-a0f65be0e972 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:31.655503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c99d298a-73d8-4281-b09c-a0f65be0e972 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:31.656277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c99d298a-73d8-4281-b09c-a0f65be0e972 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:31.656710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c99d298a-73d8-4281-b09c-a0f65be0e972 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:31.785825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c99d298a-73d8-4281-b09c-a0f65be0e972 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:31.794656 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c99d298a-73d8-4281-b09c-a0f65be0e972 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:31.796172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c99d298a-73d8-4281-b09c-a0f65be0e972 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:31.797325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c99d298a-73d8-4281-b09c-a0f65be0e972 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.153062 Nov 02 23:17:31.797883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1064/1639] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:31 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:31.802267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5b93f1ca-f8ed-45d8-a04e-5a58c0a64843 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:31.803211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5b93f1ca-f8ed-45d8-a04e-5a58c0a64843 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:31.808979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b93f1ca-f8ed-45d8-a04e-5a58c0a64843 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:31.809423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b93f1ca-f8ed-45d8-a04e-5a58c0a64843 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:31.810190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b93f1ca-f8ed-45d8-a04e-5a58c0a64843 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:31.810618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b93f1ca-f8ed-45d8-a04e-5a58c0a64843 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:31.840402 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5b93f1ca-f8ed-45d8-a04e-5a58c0a64843 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041480 Nov 02 23:17:31.840966 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1065/1640] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:31 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:31.845316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8ff4d926-5bda-467f-86f0-0273b499b607 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:31.846198 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8ff4d926-5bda-467f-86f0-0273b499b607 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:31.852549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8ff4d926-5bda-467f-86f0-0273b499b607 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:31.852993 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8ff4d926-5bda-467f-86f0-0273b499b607 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:31.853759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8ff4d926-5bda-467f-86f0-0273b499b607 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:31.854188 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8ff4d926-5bda-467f-86f0-0273b499b607 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:31.883070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8ff4d926-5bda-467f-86f0-0273b499b607 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041044 Nov 02 23:17:31.883639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1066/1641] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:31 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:32.815659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2aa9804b-262d-4022-86b3-d24869d1256c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:32.816330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2aa9804b-262d-4022-86b3-d24869d1256c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:32.822584 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2aa9804b-262d-4022-86b3-d24869d1256c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:32.823065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2aa9804b-262d-4022-86b3-d24869d1256c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:32.823853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2aa9804b-262d-4022-86b3-d24869d1256c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:32.824295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2aa9804b-262d-4022-86b3-d24869d1256c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:32.961372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2aa9804b-262d-4022-86b3-d24869d1256c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:32.969933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2aa9804b-262d-4022-86b3-d24869d1256c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:32.971438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2aa9804b-262d-4022-86b3-d24869d1256c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:32.972649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2aa9804b-262d-4022-86b3-d24869d1256c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.161058 Nov 02 23:17:32.973214 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1067/1642] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:32 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:32.978190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8b5c58b4-8a4d-4332-b470-20a475a55637 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:32.979163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8b5c58b4-8a4d-4332-b470-20a475a55637 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:32.989486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8b5c58b4-8a4d-4332-b470-20a475a55637 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:32.989967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8b5c58b4-8a4d-4332-b470-20a475a55637 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:32.990767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8b5c58b4-8a4d-4332-b470-20a475a55637 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:32.991216 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8b5c58b4-8a4d-4332-b470-20a475a55637 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:33.021566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8b5c58b4-8a4d-4332-b470-20a475a55637 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047307 Nov 02 23:17:33.022180 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1068/1643] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:32 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:33.026569 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-75fc1997-4330-47af-a4e5-36a82a1c9ed1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:33.027502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-75fc1997-4330-47af-a4e5-36a82a1c9ed1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:33.033186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-75fc1997-4330-47af-a4e5-36a82a1c9ed1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:33.033631 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-75fc1997-4330-47af-a4e5-36a82a1c9ed1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:33.034397 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-75fc1997-4330-47af-a4e5-36a82a1c9ed1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:33.034841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-75fc1997-4330-47af-a4e5-36a82a1c9ed1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:33.064759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-75fc1997-4330-47af-a4e5-36a82a1c9ed1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041527 Nov 02 23:17:33.065336 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1069/1644] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:33 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:33.990746 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7456dab8-030b-463e-8a81-4b22110281bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:33.991970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7456dab8-030b-463e-8a81-4b22110281bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:33.998191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7456dab8-030b-463e-8a81-4b22110281bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:33.998629 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7456dab8-030b-463e-8a81-4b22110281bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:33.999430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7456dab8-030b-463e-8a81-4b22110281bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:33.999856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7456dab8-030b-463e-8a81-4b22110281bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:34.174174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7456dab8-030b-463e-8a81-4b22110281bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:34.183378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7456dab8-030b-463e-8a81-4b22110281bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:34.184852 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7456dab8-030b-463e-8a81-4b22110281bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:34.186001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7456dab8-030b-463e-8a81-4b22110281bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.198985 Nov 02 23:17:34.186559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1070/1645] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:33 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:34.191273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-59fdd318-32c9-4e09-b3cb-7ad9fa7e76fb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:34.192189 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-59fdd318-32c9-4e09-b3cb-7ad9fa7e76fb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:34.198849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59fdd318-32c9-4e09-b3cb-7ad9fa7e76fb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:34.199323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59fdd318-32c9-4e09-b3cb-7ad9fa7e76fb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:34.200100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59fdd318-32c9-4e09-b3cb-7ad9fa7e76fb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:34.200531 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59fdd318-32c9-4e09-b3cb-7ad9fa7e76fb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:34.230909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-59fdd318-32c9-4e09-b3cb-7ad9fa7e76fb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043213 Nov 02 23:17:34.231497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1071/1646] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:34 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:34.235902 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-340b8619-286a-498e-80ad-907b959e2c86 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:34.236796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-340b8619-286a-498e-80ad-907b959e2c86 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:34.243633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-340b8619-286a-498e-80ad-907b959e2c86 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:34.244004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-340b8619-286a-498e-80ad-907b959e2c86 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:34.245043 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-340b8619-286a-498e-80ad-907b959e2c86 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:34.245400 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-340b8619-286a-498e-80ad-907b959e2c86 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:34.275779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-340b8619-286a-498e-80ad-907b959e2c86 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043240 Nov 02 23:17:34.276795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1072/1647] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:34 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:35.204395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1d927d18-085a-4d12-a7eb-43b4890c936d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:35.205106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1d927d18-085a-4d12-a7eb-43b4890c936d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:35.211721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d927d18-085a-4d12-a7eb-43b4890c936d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:35.212169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d927d18-085a-4d12-a7eb-43b4890c936d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:35.213003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d927d18-085a-4d12-a7eb-43b4890c936d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:35.213383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d927d18-085a-4d12-a7eb-43b4890c936d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:35.353565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1d927d18-085a-4d12-a7eb-43b4890c936d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:35.361756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1d927d18-085a-4d12-a7eb-43b4890c936d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:35.363265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1d927d18-085a-4d12-a7eb-43b4890c936d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:35.364429 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1d927d18-085a-4d12-a7eb-43b4890c936d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.164059 Nov 02 23:17:35.365000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1073/1648] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:35 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:35.371268 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ddce0b97-dc5e-4d87-bdc5-e471cbc0004f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:35.372187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ddce0b97-dc5e-4d87-bdc5-e471cbc0004f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:35.379256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddce0b97-dc5e-4d87-bdc5-e471cbc0004f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:35.379708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddce0b97-dc5e-4d87-bdc5-e471cbc0004f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:35.380486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddce0b97-dc5e-4d87-bdc5-e471cbc0004f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:35.380922 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddce0b97-dc5e-4d87-bdc5-e471cbc0004f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:35.410301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ddce0b97-dc5e-4d87-bdc5-e471cbc0004f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042954 Nov 02 23:17:35.410883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1074/1649] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:35 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:35.415825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-23e566a6-48e7-4f3b-8d29-6f9355e18299 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:35.416724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-23e566a6-48e7-4f3b-8d29-6f9355e18299 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:35.422540 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-23e566a6-48e7-4f3b-8d29-6f9355e18299 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:35.423024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-23e566a6-48e7-4f3b-8d29-6f9355e18299 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:35.423807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-23e566a6-48e7-4f3b-8d29-6f9355e18299 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:35.424242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-23e566a6-48e7-4f3b-8d29-6f9355e18299 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:35.455413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-23e566a6-48e7-4f3b-8d29-6f9355e18299 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043378 Nov 02 23:17:35.456018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1075/1650] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:35 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:36.383678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f602d85b-da4d-4caa-aa80-faaa44c19736 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:36.384326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f602d85b-da4d-4caa-aa80-faaa44c19736 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:36.390756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f602d85b-da4d-4caa-aa80-faaa44c19736 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:36.391236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f602d85b-da4d-4caa-aa80-faaa44c19736 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:36.392016 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f602d85b-da4d-4caa-aa80-faaa44c19736 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:36.392470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f602d85b-da4d-4caa-aa80-faaa44c19736 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:36.533855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f602d85b-da4d-4caa-aa80-faaa44c19736 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:36.542276 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f602d85b-da4d-4caa-aa80-faaa44c19736 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:36.543802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f602d85b-da4d-4caa-aa80-faaa44c19736 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:36.544953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f602d85b-da4d-4caa-aa80-faaa44c19736 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.165658 Nov 02 23:17:36.545516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1076/1651] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:36 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:36.549992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-41809029-c71b-4438-8e81-36cd56a39016 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:36.550908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-41809029-c71b-4438-8e81-36cd56a39016 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:36.557979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-41809029-c71b-4438-8e81-36cd56a39016 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:36.558431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-41809029-c71b-4438-8e81-36cd56a39016 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:36.559246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-41809029-c71b-4438-8e81-36cd56a39016 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:36.559680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-41809029-c71b-4438-8e81-36cd56a39016 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:36.590665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-41809029-c71b-4438-8e81-36cd56a39016 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044083 Nov 02 23:17:36.591267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1077/1652] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:36 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:36.595644 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a13980a6-8d77-4b98-af84-0c6bcfbd3c62 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:36.596740 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a13980a6-8d77-4b98-af84-0c6bcfbd3c62 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:36.603392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a13980a6-8d77-4b98-af84-0c6bcfbd3c62 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:36.603848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a13980a6-8d77-4b98-af84-0c6bcfbd3c62 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:36.604627 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a13980a6-8d77-4b98-af84-0c6bcfbd3c62 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:36.605061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a13980a6-8d77-4b98-af84-0c6bcfbd3c62 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:36.644370 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a13980a6-8d77-4b98-af84-0c6bcfbd3c62 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052055 Nov 02 23:17:36.644950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1078/1653] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:36 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:37.564249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-771010f2-8f32-4ffe-a244-24a0999e0f1b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:37.564922 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-771010f2-8f32-4ffe-a244-24a0999e0f1b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:37.571678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-771010f2-8f32-4ffe-a244-24a0999e0f1b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:37.572119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-771010f2-8f32-4ffe-a244-24a0999e0f1b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:37.572893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-771010f2-8f32-4ffe-a244-24a0999e0f1b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:37.573312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-771010f2-8f32-4ffe-a244-24a0999e0f1b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:37.707833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-771010f2-8f32-4ffe-a244-24a0999e0f1b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:37.717201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-771010f2-8f32-4ffe-a244-24a0999e0f1b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:37.718791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-771010f2-8f32-4ffe-a244-24a0999e0f1b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:37.720027 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-771010f2-8f32-4ffe-a244-24a0999e0f1b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.159511 Nov 02 23:17:37.720602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1079/1654] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:37 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:37.725138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fa6333ac-1e12-47fd-836c-737bdd4de193 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:37.726063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fa6333ac-1e12-47fd-836c-737bdd4de193 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:37.732366 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fa6333ac-1e12-47fd-836c-737bdd4de193 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:37.732801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fa6333ac-1e12-47fd-836c-737bdd4de193 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:37.733573 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fa6333ac-1e12-47fd-836c-737bdd4de193 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:37.734001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fa6333ac-1e12-47fd-836c-737bdd4de193 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:37.766643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fa6333ac-1e12-47fd-836c-737bdd4de193 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044977 Nov 02 23:17:37.767449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1080/1655] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:37 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:37.771842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e6ec4257-bf66-4f3c-8383-fb5e1cde061f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:37.772768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e6ec4257-bf66-4f3c-8383-fb5e1cde061f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:37.779202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e6ec4257-bf66-4f3c-8383-fb5e1cde061f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:37.779648 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e6ec4257-bf66-4f3c-8383-fb5e1cde061f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:37.780445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e6ec4257-bf66-4f3c-8383-fb5e1cde061f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:37.780879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e6ec4257-bf66-4f3c-8383-fb5e1cde061f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:37.816975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e6ec4257-bf66-4f3c-8383-fb5e1cde061f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048542 Nov 02 23:17:37.817446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1081/1656] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:37 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:38.739933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5ee84ec8-8f93-4fbd-9b34-69540567794f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:38.741547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5ee84ec8-8f93-4fbd-9b34-69540567794f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:38.749406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ee84ec8-8f93-4fbd-9b34-69540567794f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:38.749659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ee84ec8-8f93-4fbd-9b34-69540567794f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:38.750648 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ee84ec8-8f93-4fbd-9b34-69540567794f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:38.751223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ee84ec8-8f93-4fbd-9b34-69540567794f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:38.912487 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5ee84ec8-8f93-4fbd-9b34-69540567794f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:38.925907 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5ee84ec8-8f93-4fbd-9b34-69540567794f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:38.927053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5ee84ec8-8f93-4fbd-9b34-69540567794f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:38.928254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5ee84ec8-8f93-4fbd-9b34-69540567794f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.192054 Nov 02 23:17:38.929392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1082/1657] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:38 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:38.933904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b6204c98-7510-4791-820a-8ba460402b9c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:38.934905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b6204c98-7510-4791-820a-8ba460402b9c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:38.941271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6204c98-7510-4791-820a-8ba460402b9c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:38.941711 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6204c98-7510-4791-820a-8ba460402b9c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:38.942516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6204c98-7510-4791-820a-8ba460402b9c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:38.942933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6204c98-7510-4791-820a-8ba460402b9c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:38.974598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b6204c98-7510-4791-820a-8ba460402b9c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044130 Nov 02 23:17:38.975769 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1083/1658] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:38 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:38.980378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b8be54de-329b-4581-b0b9-436c3c37d557 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:38.981314 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b8be54de-329b-4581-b0b9-436c3c37d557 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:38.987501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b8be54de-329b-4581-b0b9-436c3c37d557 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:38.987944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b8be54de-329b-4581-b0b9-436c3c37d557 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:38.988724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b8be54de-329b-4581-b0b9-436c3c37d557 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:38.989147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b8be54de-329b-4581-b0b9-436c3c37d557 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:39.020476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b8be54de-329b-4581-b0b9-436c3c37d557 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043625 Nov 02 23:17:39.021060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1084/1659] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:38 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:39.947191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b7a2eefe-4fd4-4e05-a9d2-e592abdef9ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:39.947805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b7a2eefe-4fd4-4e05-a9d2-e592abdef9ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:39.954426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b7a2eefe-4fd4-4e05-a9d2-e592abdef9ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:39.954872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b7a2eefe-4fd4-4e05-a9d2-e592abdef9ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:39.955692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b7a2eefe-4fd4-4e05-a9d2-e592abdef9ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:39.956119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b7a2eefe-4fd4-4e05-a9d2-e592abdef9ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:40.100036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b7a2eefe-4fd4-4e05-a9d2-e592abdef9ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:40.109398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b7a2eefe-4fd4-4e05-a9d2-e592abdef9ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:40.111047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b7a2eefe-4fd4-4e05-a9d2-e592abdef9ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:40.112219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b7a2eefe-4fd4-4e05-a9d2-e592abdef9ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.168737 Nov 02 23:17:40.112783 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1085/1660] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:39 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:40.117284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-920af0ac-6bbb-4ab1-af09-24a353c0acce tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:40.118191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-920af0ac-6bbb-4ab1-af09-24a353c0acce tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:40.124886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-920af0ac-6bbb-4ab1-af09-24a353c0acce tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:40.125341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-920af0ac-6bbb-4ab1-af09-24a353c0acce tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:40.126152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-920af0ac-6bbb-4ab1-af09-24a353c0acce tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:40.126602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-920af0ac-6bbb-4ab1-af09-24a353c0acce tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:40.158556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-920af0ac-6bbb-4ab1-af09-24a353c0acce tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Nov 02 23:17:40.159162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1086/1661] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:40 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:40.164161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d5595da6-f932-4df1-967b-b70addb3a52a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:40.165056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d5595da6-f932-4df1-967b-b70addb3a52a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:40.171017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d5595da6-f932-4df1-967b-b70addb3a52a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:40.171470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d5595da6-f932-4df1-967b-b70addb3a52a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:40.172398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d5595da6-f932-4df1-967b-b70addb3a52a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:40.172686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d5595da6-f932-4df1-967b-b70addb3a52a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:40.202518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d5595da6-f932-4df1-967b-b70addb3a52a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042299 Nov 02 23:17:40.203146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1087/1662] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:40 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:41.130035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2a60be10-426a-4e99-a900-a1429a4ebd8e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:41.131134 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2a60be10-426a-4e99-a900-a1429a4ebd8e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:41.137027 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a60be10-426a-4e99-a900-a1429a4ebd8e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:41.137478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a60be10-426a-4e99-a900-a1429a4ebd8e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:41.138245 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a60be10-426a-4e99-a900-a1429a4ebd8e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:41.138678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a60be10-426a-4e99-a900-a1429a4ebd8e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:41.300098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2a60be10-426a-4e99-a900-a1429a4ebd8e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:41.309254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2a60be10-426a-4e99-a900-a1429a4ebd8e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:41.310805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2a60be10-426a-4e99-a900-a1429a4ebd8e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:41.312050 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2a60be10-426a-4e99-a900-a1429a4ebd8e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.185775 Nov 02 23:17:41.312675 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1088/1663] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:41 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:41.321030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fc5b5f3c-8442-433a-a3d9-68b4fc6be9ea tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:41.323014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fc5b5f3c-8442-433a-a3d9-68b4fc6be9ea tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:41.332289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc5b5f3c-8442-433a-a3d9-68b4fc6be9ea tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:41.332857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc5b5f3c-8442-433a-a3d9-68b4fc6be9ea tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:41.333715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc5b5f3c-8442-433a-a3d9-68b4fc6be9ea tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:41.334254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc5b5f3c-8442-433a-a3d9-68b4fc6be9ea tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:41.368929 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fc5b5f3c-8442-433a-a3d9-68b4fc6be9ea tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054905 Nov 02 23:17:41.369511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1089/1664] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:41 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:41.373964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7bd5a3aa-3caf-4237-af5a-c3bb9b7be386 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:41.374856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7bd5a3aa-3caf-4237-af5a-c3bb9b7be386 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:41.380745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7bd5a3aa-3caf-4237-af5a-c3bb9b7be386 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:41.381190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7bd5a3aa-3caf-4237-af5a-c3bb9b7be386 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:41.382528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7bd5a3aa-3caf-4237-af5a-c3bb9b7be386 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:41.382964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7bd5a3aa-3caf-4237-af5a-c3bb9b7be386 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:41.412443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7bd5a3aa-3caf-4237-af5a-c3bb9b7be386 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041851 Nov 02 23:17:41.413087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1090/1665] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:41 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:42.338625 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8c5d0049-7e3f-42b7-ac32-1b1f9c959176 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:42.339463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8c5d0049-7e3f-42b7-ac32-1b1f9c959176 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:42.345957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c5d0049-7e3f-42b7-ac32-1b1f9c959176 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:42.346607 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c5d0049-7e3f-42b7-ac32-1b1f9c959176 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:42.347514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c5d0049-7e3f-42b7-ac32-1b1f9c959176 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:42.348039 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c5d0049-7e3f-42b7-ac32-1b1f9c959176 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:42.499472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8c5d0049-7e3f-42b7-ac32-1b1f9c959176 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:42.509310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8c5d0049-7e3f-42b7-ac32-1b1f9c959176 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:42.511066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8c5d0049-7e3f-42b7-ac32-1b1f9c959176 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:42.512385 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8c5d0049-7e3f-42b7-ac32-1b1f9c959176 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.177980 Nov 02 23:17:42.513038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1091/1666] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:42 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:42.518070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d851b771-dc28-43b3-a398-de4e01075d72 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:42.519139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d851b771-dc28-43b3-a398-de4e01075d72 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:42.526284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d851b771-dc28-43b3-a398-de4e01075d72 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:42.526900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d851b771-dc28-43b3-a398-de4e01075d72 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:42.527862 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d851b771-dc28-43b3-a398-de4e01075d72 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:42.528345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d851b771-dc28-43b3-a398-de4e01075d72 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:42.561748 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d851b771-dc28-43b3-a398-de4e01075d72 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047585 Nov 02 23:17:42.562326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1092/1667] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:42 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:42.566796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7e60f38c-5b69-4316-a19b-727aa9672d49 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:42.567745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7e60f38c-5b69-4316-a19b-727aa9672d49 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:42.574417 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7e60f38c-5b69-4316-a19b-727aa9672d49 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:42.574909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7e60f38c-5b69-4316-a19b-727aa9672d49 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:42.576047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7e60f38c-5b69-4316-a19b-727aa9672d49 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:42.576524 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7e60f38c-5b69-4316-a19b-727aa9672d49 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:42.607521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7e60f38c-5b69-4316-a19b-727aa9672d49 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044141 Nov 02 23:17:42.608102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1093/1668] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:42 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:43.532078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1e483680-98a1-4576-a498-eb51ae821320 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:43.532819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1e483680-98a1-4576-a498-eb51ae821320 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:43.539893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e483680-98a1-4576-a498-eb51ae821320 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:43.540339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e483680-98a1-4576-a498-eb51ae821320 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:43.541124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e483680-98a1-4576-a498-eb51ae821320 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:43.541554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e483680-98a1-4576-a498-eb51ae821320 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:43.688784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1e483680-98a1-4576-a498-eb51ae821320 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:43.698044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1e483680-98a1-4576-a498-eb51ae821320 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:43.699622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1e483680-98a1-4576-a498-eb51ae821320 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:43.701121 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1e483680-98a1-4576-a498-eb51ae821320 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.172486 Nov 02 23:17:43.701713 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1094/1669] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:43 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:43.706419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f62b5553-4a82-44e7-8585-8ec2def3ed87 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:43.707398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f62b5553-4a82-44e7-8585-8ec2def3ed87 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:43.714546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f62b5553-4a82-44e7-8585-8ec2def3ed87 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:43.715046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f62b5553-4a82-44e7-8585-8ec2def3ed87 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:43.715854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f62b5553-4a82-44e7-8585-8ec2def3ed87 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:43.716290 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f62b5553-4a82-44e7-8585-8ec2def3ed87 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:43.749640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f62b5553-4a82-44e7-8585-8ec2def3ed87 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046844 Nov 02 23:17:43.750236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1095/1670] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:43 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:43.754808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2c268b73-8fcf-4506-9b52-d433eec5e3b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:43.755754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2c268b73-8fcf-4506-9b52-d433eec5e3b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:43.762069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2c268b73-8fcf-4506-9b52-d433eec5e3b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:43.762555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2c268b73-8fcf-4506-9b52-d433eec5e3b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:43.763422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2c268b73-8fcf-4506-9b52-d433eec5e3b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:43.763893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2c268b73-8fcf-4506-9b52-d433eec5e3b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:43.795802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2c268b73-8fcf-4506-9b52-d433eec5e3b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044373 Nov 02 23:17:43.796390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1096/1671] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:43 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:44.721610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a8120170-6e59-45f5-83e4-b9f664cb81d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:44.722433 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a8120170-6e59-45f5-83e4-b9f664cb81d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:44.729085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a8120170-6e59-45f5-83e4-b9f664cb81d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:44.730010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a8120170-6e59-45f5-83e4-b9f664cb81d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:44.730324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a8120170-6e59-45f5-83e4-b9f664cb81d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:44.730765 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a8120170-6e59-45f5-83e4-b9f664cb81d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:44.871830 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a8120170-6e59-45f5-83e4-b9f664cb81d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:44.881595 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a8120170-6e59-45f5-83e4-b9f664cb81d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:44.883214 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a8120170-6e59-45f5-83e4-b9f664cb81d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:44.884491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a8120170-6e59-45f5-83e4-b9f664cb81d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.166640 Nov 02 23:17:44.885140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1097/1672] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:44 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:44.889886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-231c2c53-b76a-4308-9616-b3c100f2f401 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:44.890803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-231c2c53-b76a-4308-9616-b3c100f2f401 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:44.897204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-231c2c53-b76a-4308-9616-b3c100f2f401 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:44.897651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-231c2c53-b76a-4308-9616-b3c100f2f401 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:44.898442 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-231c2c53-b76a-4308-9616-b3c100f2f401 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:44.898880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-231c2c53-b76a-4308-9616-b3c100f2f401 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:44.930493 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-231c2c53-b76a-4308-9616-b3c100f2f401 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044276 Nov 02 23:17:44.931109 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1098/1673] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:44 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:44.935596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2ec9736c-f33a-4943-89d5-a829fa614292 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:17:44.936542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2ec9736c-f33a-4943-89d5-a829fa614292 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:44.942735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ec9736c-f33a-4943-89d5-a829fa614292 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:44.943219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ec9736c-f33a-4943-89d5-a829fa614292 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:44.944036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ec9736c-f33a-4943-89d5-a829fa614292 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:44.944473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ec9736c-f33a-4943-89d5-a829fa614292 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:44.971773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2ec9736c-f33a-4943-89d5-a829fa614292 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [92d77ebe-2bd0-494f-9195-488220280c14] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 23:17:45.989624 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [None req-2ec9736c-f33a-4943-89d5-a829fa614292 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [92d77ebe-2bd0-494f-9195-488220280c14] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 44190. Nov 02 23:17:46.070235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2ec9736c-f33a-4943-89d5-a829fa614292 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "POST /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/action" status: 200 len: 41158 microversion: 2.1 time: 1.137662 Nov 02 23:17:46.071431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1099/1674] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:17:44 2021] POST /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6/action => generated 41158 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:17:46.081409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-72783150-29b7-4b0c-9e54-a21963804899 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:46.082716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-72783150-29b7-4b0c-9e54-a21963804899 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:46.094668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72783150-29b7-4b0c-9e54-a21963804899 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:46.095423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72783150-29b7-4b0c-9e54-a21963804899 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:46.096785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72783150-29b7-4b0c-9e54-a21963804899 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:46.101827 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72783150-29b7-4b0c-9e54-a21963804899 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:46.277905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-72783150-29b7-4b0c-9e54-a21963804899 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:46.287101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-72783150-29b7-4b0c-9e54-a21963804899 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:46.288774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-72783150-29b7-4b0c-9e54-a21963804899 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:46.289952 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-72783150-29b7-4b0c-9e54-a21963804899 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.216635 Nov 02 23:17:46.290520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1100/1675] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:46 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:17:46.294994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d46a869a-c3f7-4ccc-9e6b-dfa2bdf510be tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:46.296128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d46a869a-c3f7-4ccc-9e6b-dfa2bdf510be tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:46.302326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d46a869a-c3f7-4ccc-9e6b-dfa2bdf510be tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:46.302769 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d46a869a-c3f7-4ccc-9e6b-dfa2bdf510be tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:46.304248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d46a869a-c3f7-4ccc-9e6b-dfa2bdf510be tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:46.304863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d46a869a-c3f7-4ccc-9e6b-dfa2bdf510be tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:46.338021 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d46a869a-c3f7-4ccc-9e6b-dfa2bdf510be tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046395 Nov 02 23:17:46.338679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1101/1676] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:46 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:47.317128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bf5bfd7a-5ed5-431c-ae2b-b1830eea18f3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:47.317128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bf5bfd7a-5ed5-431c-ae2b-b1830eea18f3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:47.323956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf5bfd7a-5ed5-431c-ae2b-b1830eea18f3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:47.324441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf5bfd7a-5ed5-431c-ae2b-b1830eea18f3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:47.325228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf5bfd7a-5ed5-431c-ae2b-b1830eea18f3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:47.325925 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf5bfd7a-5ed5-431c-ae2b-b1830eea18f3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:47.463289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bf5bfd7a-5ed5-431c-ae2b-b1830eea18f3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:47.471846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bf5bfd7a-5ed5-431c-ae2b-b1830eea18f3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:47.473344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bf5bfd7a-5ed5-431c-ae2b-b1830eea18f3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:47.474506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bf5bfd7a-5ed5-431c-ae2b-b1830eea18f3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.162515 Nov 02 23:17:47.475130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1102/1677] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:47 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:47.479609 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6263f6a5-a1ff-4944-86df-d507468c8d4d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:47.480516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6263f6a5-a1ff-4944-86df-d507468c8d4d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:47.487037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6263f6a5-a1ff-4944-86df-d507468c8d4d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:47.487420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6263f6a5-a1ff-4944-86df-d507468c8d4d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:47.488205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6263f6a5-a1ff-4944-86df-d507468c8d4d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:47.488636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6263f6a5-a1ff-4944-86df-d507468c8d4d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:47.519346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6263f6a5-a1ff-4944-86df-d507468c8d4d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043123 Nov 02 23:17:47.519924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1103/1678] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:47 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:48.493449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-99de038f-32d4-4616-bd69-6bc1961bc2ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:48.494156 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-99de038f-32d4-4616-bd69-6bc1961bc2ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:48.500463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-99de038f-32d4-4616-bd69-6bc1961bc2ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:48.500904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-99de038f-32d4-4616-bd69-6bc1961bc2ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:48.501679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-99de038f-32d4-4616-bd69-6bc1961bc2ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:48.502114 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-99de038f-32d4-4616-bd69-6bc1961bc2ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:48.646085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-99de038f-32d4-4616-bd69-6bc1961bc2ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:48.655622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-99de038f-32d4-4616-bd69-6bc1961bc2ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:48.657061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-99de038f-32d4-4616-bd69-6bc1961bc2ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:48.658234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-99de038f-32d4-4616-bd69-6bc1961bc2ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.168614 Nov 02 23:17:48.658805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1104/1679] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:48 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:48.663389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5f38db89-f2d8-4967-a781-4d824bc978d4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:48.664326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5f38db89-f2d8-4967-a781-4d824bc978d4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:48.672228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f38db89-f2d8-4967-a781-4d824bc978d4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:48.673047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f38db89-f2d8-4967-a781-4d824bc978d4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:48.674372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f38db89-f2d8-4967-a781-4d824bc978d4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:48.675255 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f38db89-f2d8-4967-a781-4d824bc978d4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:48.727738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5f38db89-f2d8-4967-a781-4d824bc978d4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067829 Nov 02 23:17:48.728330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1105/1680] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:48 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:49.677615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-198c7530-7627-4351-912e-8656e0a0479b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:49.678982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-198c7530-7627-4351-912e-8656e0a0479b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:49.685419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-198c7530-7627-4351-912e-8656e0a0479b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:49.685871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-198c7530-7627-4351-912e-8656e0a0479b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:49.686654 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-198c7530-7627-4351-912e-8656e0a0479b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:49.687132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-198c7530-7627-4351-912e-8656e0a0479b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:49.830598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-198c7530-7627-4351-912e-8656e0a0479b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:49.839786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-198c7530-7627-4351-912e-8656e0a0479b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:49.841273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-198c7530-7627-4351-912e-8656e0a0479b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:49.842479 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-198c7530-7627-4351-912e-8656e0a0479b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.168523 Nov 02 23:17:49.843120 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1106/1681] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:49 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:49.847872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-70057ede-059d-4575-9398-2a9400eb066f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:49.848778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-70057ede-059d-4575-9398-2a9400eb066f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:49.855157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-70057ede-059d-4575-9398-2a9400eb066f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:49.855588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-70057ede-059d-4575-9398-2a9400eb066f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:49.856402 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-70057ede-059d-4575-9398-2a9400eb066f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:49.856834 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-70057ede-059d-4575-9398-2a9400eb066f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:49.886987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-70057ede-059d-4575-9398-2a9400eb066f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042787 Nov 02 23:17:49.887555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1107/1682] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:49 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:50.861780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bf0c5941-8f1f-4a82-a96a-1093adda3a82 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:50.862438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bf0c5941-8f1f-4a82-a96a-1093adda3a82 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:50.868799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf0c5941-8f1f-4a82-a96a-1093adda3a82 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:50.869238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf0c5941-8f1f-4a82-a96a-1093adda3a82 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:50.870009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf0c5941-8f1f-4a82-a96a-1093adda3a82 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:50.870436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf0c5941-8f1f-4a82-a96a-1093adda3a82 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:51.005709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bf0c5941-8f1f-4a82-a96a-1093adda3a82 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:51.014464 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bf0c5941-8f1f-4a82-a96a-1093adda3a82 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:51.015994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bf0c5941-8f1f-4a82-a96a-1093adda3a82 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:51.017147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bf0c5941-8f1f-4a82-a96a-1093adda3a82 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.159120 Nov 02 23:17:51.017711 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1108/1683] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:50 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:51.022711 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-958f494d-7a17-46cf-b77b-5e8518132b02 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:51.023659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-958f494d-7a17-46cf-b77b-5e8518132b02 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:51.029742 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-958f494d-7a17-46cf-b77b-5e8518132b02 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:51.030190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-958f494d-7a17-46cf-b77b-5e8518132b02 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:51.030998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-958f494d-7a17-46cf-b77b-5e8518132b02 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:51.031435 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-958f494d-7a17-46cf-b77b-5e8518132b02 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:51.060252 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-958f494d-7a17-46cf-b77b-5e8518132b02 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041517 Nov 02 23:17:51.060809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1109/1684] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:51 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:52.035251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-65ff2df8-35aa-452e-a04e-0b23c63b1a2c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:52.035916 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-65ff2df8-35aa-452e-a04e-0b23c63b1a2c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:52.042211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-65ff2df8-35aa-452e-a04e-0b23c63b1a2c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:52.042652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-65ff2df8-35aa-452e-a04e-0b23c63b1a2c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:52.043449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-65ff2df8-35aa-452e-a04e-0b23c63b1a2c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:52.043877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-65ff2df8-35aa-452e-a04e-0b23c63b1a2c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:52.175642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-65ff2df8-35aa-452e-a04e-0b23c63b1a2c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:52.184555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-65ff2df8-35aa-452e-a04e-0b23c63b1a2c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:52.186039 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-65ff2df8-35aa-452e-a04e-0b23c63b1a2c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:52.187215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-65ff2df8-35aa-452e-a04e-0b23c63b1a2c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.155624 Nov 02 23:17:52.187783 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1110/1685] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:52 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:52.192362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e8d063f4-3807-45b7-8bae-31d23551447b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:52.193287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e8d063f4-3807-45b7-8bae-31d23551447b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:52.199861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e8d063f4-3807-45b7-8bae-31d23551447b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:52.200314 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e8d063f4-3807-45b7-8bae-31d23551447b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:52.201339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e8d063f4-3807-45b7-8bae-31d23551447b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:52.201766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e8d063f4-3807-45b7-8bae-31d23551447b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:52.234689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e8d063f4-3807-45b7-8bae-31d23551447b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045859 Nov 02 23:17:52.235303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1111/1686] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:52 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:53.205778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7f7389b2-f18c-4cb6-92fa-eab8464b7c69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:53.206485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7f7389b2-f18c-4cb6-92fa-eab8464b7c69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:53.213384 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f7389b2-f18c-4cb6-92fa-eab8464b7c69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:53.213823 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f7389b2-f18c-4cb6-92fa-eab8464b7c69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:53.214589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f7389b2-f18c-4cb6-92fa-eab8464b7c69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:53.215046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f7389b2-f18c-4cb6-92fa-eab8464b7c69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:53.349116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7f7389b2-f18c-4cb6-92fa-eab8464b7c69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:53.357546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7f7389b2-f18c-4cb6-92fa-eab8464b7c69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:53.359061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7f7389b2-f18c-4cb6-92fa-eab8464b7c69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:53.360227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7f7389b2-f18c-4cb6-92fa-eab8464b7c69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.158253 Nov 02 23:17:53.360785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1112/1687] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:53 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:53.365361 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-44741cc0-6679-4dad-b3a1-6e893e78ef0a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:53.366265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-44741cc0-6679-4dad-b3a1-6e893e78ef0a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:53.372996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-44741cc0-6679-4dad-b3a1-6e893e78ef0a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:53.373492 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-44741cc0-6679-4dad-b3a1-6e893e78ef0a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:53.374325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-44741cc0-6679-4dad-b3a1-6e893e78ef0a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:53.374799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-44741cc0-6679-4dad-b3a1-6e893e78ef0a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:53.417049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-44741cc0-6679-4dad-b3a1-6e893e78ef0a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055123 Nov 02 23:17:53.417681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1113/1688] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:53 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:54.379975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a94f5f8b-9a23-4034-97c2-35aaac607765 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:54.380728 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a94f5f8b-9a23-4034-97c2-35aaac607765 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:54.387895 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a94f5f8b-9a23-4034-97c2-35aaac607765 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:54.388339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a94f5f8b-9a23-4034-97c2-35aaac607765 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:54.389128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a94f5f8b-9a23-4034-97c2-35aaac607765 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:54.389556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a94f5f8b-9a23-4034-97c2-35aaac607765 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:54.556073 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a94f5f8b-9a23-4034-97c2-35aaac607765 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:54.565614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a94f5f8b-9a23-4034-97c2-35aaac607765 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:54.567185 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a94f5f8b-9a23-4034-97c2-35aaac607765 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:54.568439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a94f5f8b-9a23-4034-97c2-35aaac607765 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.192214 Nov 02 23:17:54.569543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1114/1689] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:54 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:54.574075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d56a9be6-77f9-4c60-bf5c-75169985fd80 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:54.575135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d56a9be6-77f9-4c60-bf5c-75169985fd80 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:54.581692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d56a9be6-77f9-4c60-bf5c-75169985fd80 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:54.582338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d56a9be6-77f9-4c60-bf5c-75169985fd80 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:54.583307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d56a9be6-77f9-4c60-bf5c-75169985fd80 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:54.583905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d56a9be6-77f9-4c60-bf5c-75169985fd80 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:54.614176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d56a9be6-77f9-4c60-bf5c-75169985fd80 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043574 Nov 02 23:17:54.614736 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1115/1690] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:54 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:55.596912 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d7b1668c-83b5-47eb-8b8f-90fd2159450c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:55.597613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d7b1668c-83b5-47eb-8b8f-90fd2159450c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:55.605139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d7b1668c-83b5-47eb-8b8f-90fd2159450c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:55.605603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d7b1668c-83b5-47eb-8b8f-90fd2159450c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:55.606589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d7b1668c-83b5-47eb-8b8f-90fd2159450c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:55.606785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d7b1668c-83b5-47eb-8b8f-90fd2159450c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:55.758404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d7b1668c-83b5-47eb-8b8f-90fd2159450c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:55.767231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d7b1668c-83b5-47eb-8b8f-90fd2159450c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:55.768737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d7b1668c-83b5-47eb-8b8f-90fd2159450c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:55.769909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d7b1668c-83b5-47eb-8b8f-90fd2159450c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.176905 Nov 02 23:17:55.770470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1116/1691] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:55 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:55.775476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6e9d8729-14c8-4e4d-b853-f137f3a354bb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:55.776384 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6e9d8729-14c8-4e4d-b853-f137f3a354bb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:55.782383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e9d8729-14c8-4e4d-b853-f137f3a354bb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:55.782834 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e9d8729-14c8-4e4d-b853-f137f3a354bb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:55.783639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e9d8729-14c8-4e4d-b853-f137f3a354bb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:55.784064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e9d8729-14c8-4e4d-b853-f137f3a354bb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:55.814643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6e9d8729-14c8-4e4d-b853-f137f3a354bb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043055 Nov 02 23:17:55.815248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1117/1692] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:55 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:56.617146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-08bc0e6f-3417-4ac6-9df6-41bbb866fb19 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:56.617796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-08bc0e6f-3417-4ac6-9df6-41bbb866fb19 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:56.623948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08bc0e6f-3417-4ac6-9df6-41bbb866fb19 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:56.624391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08bc0e6f-3417-4ac6-9df6-41bbb866fb19 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:56.625171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08bc0e6f-3417-4ac6-9df6-41bbb866fb19 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:56.625602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08bc0e6f-3417-4ac6-9df6-41bbb866fb19 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:56.706878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.objects.instance [None req-08bc0e6f-3417-4ac6-9df6-41bbb866fb19 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lazy-loading 'services' on Instance uuid 21eb9b39-67de-489a-aa38-4f0b94947a68 {{(pid=115800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 23:17:56.820056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-08bc0e6f-3417-4ac6-9df6-41bbb866fb19 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "DELETE /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68/os-volume_attachments/d2fb37f5-345f-4638-aa9d-a3907f81cec4" status: 202 len: 0 microversion: 2.1 time: 0.206156 Nov 02 23:17:56.821005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1118/1693] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 2 23:17:56 2021] DELETE /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68/os-volume_attachments/d2fb37f5-345f-4638-aa9d-a3907f81cec4 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:17:56.830624 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fbe23acb-bfe3-4ca9-9cd4-f196f20d4efc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:56.832053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fbe23acb-bfe3-4ca9-9cd4-f196f20d4efc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:56.843163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbe23acb-bfe3-4ca9-9cd4-f196f20d4efc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:56.843896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbe23acb-bfe3-4ca9-9cd4-f196f20d4efc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:56.845185 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbe23acb-bfe3-4ca9-9cd4-f196f20d4efc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:56.845901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbe23acb-bfe3-4ca9-9cd4-f196f20d4efc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:57.013524 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fbe23acb-bfe3-4ca9-9cd4-f196f20d4efc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:57.023131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fbe23acb-bfe3-4ca9-9cd4-f196f20d4efc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:57.024664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fbe23acb-bfe3-4ca9-9cd4-f196f20d4efc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:57.025880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fbe23acb-bfe3-4ca9-9cd4-f196f20d4efc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.203173 Nov 02 23:17:57.026459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1119/1694] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:56 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:17:57.031066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2ed4fff1-76f4-4006-a291-4b477c049a27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:57.032045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2ed4fff1-76f4-4006-a291-4b477c049a27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:57.038392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ed4fff1-76f4-4006-a291-4b477c049a27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:57.038847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ed4fff1-76f4-4006-a291-4b477c049a27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:57.039679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ed4fff1-76f4-4006-a291-4b477c049a27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:57.040116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ed4fff1-76f4-4006-a291-4b477c049a27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:57.072660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2ed4fff1-76f4-4006-a291-4b477c049a27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044995 Nov 02 23:17:57.073163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1120/1695] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:57 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:57.077937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ea179447-5d00-4e75-a119-da316af4ff14 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:57.078470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ea179447-5d00-4e75-a119-da316af4ff14 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:57.085063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea179447-5d00-4e75-a119-da316af4ff14 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:57.085515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea179447-5d00-4e75-a119-da316af4ff14 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:57.086316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea179447-5d00-4e75-a119-da316af4ff14 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:57.086755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea179447-5d00-4e75-a119-da316af4ff14 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:57.113642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ea179447-5d00-4e75-a119-da316af4ff14 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Going to try to terminate instance {{(pid=115800) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 23:17:57.204833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ea179447-5d00-4e75-a119-da316af4ff14 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "DELETE /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 204 len: 0 microversion: 2.1 time: 0.129885 Nov 02 23:17:57.206159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1121/1696] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:17:57 2021] DELETE /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 23:17:57.215672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2324f4b2-2860-478c-8f16-540fb993aac0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:57.216379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2324f4b2-2860-478c-8f16-540fb993aac0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:57.222569 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2324f4b2-2860-478c-8f16-540fb993aac0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:57.223085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2324f4b2-2860-478c-8f16-540fb993aac0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:57.223877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2324f4b2-2860-478c-8f16-540fb993aac0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:57.224305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2324f4b2-2860-478c-8f16-540fb993aac0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:57.377002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2324f4b2-2860-478c-8f16-540fb993aac0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:57.384451 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2324f4b2-2860-478c-8f16-540fb993aac0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1675 microversion: 2.1 time: 0.172885 Nov 02 23:17:57.385030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1122/1697] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:17:57 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:17:58.044622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aa808fb7-eaff-4794-af5b-ca43ab53e342 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:58.045316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aa808fb7-eaff-4794-af5b-ca43ab53e342 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:58.052257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa808fb7-eaff-4794-af5b-ca43ab53e342 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:58.052741 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa808fb7-eaff-4794-af5b-ca43ab53e342 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:58.053644 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa808fb7-eaff-4794-af5b-ca43ab53e342 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:58.054117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa808fb7-eaff-4794-af5b-ca43ab53e342 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:58.200326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aa808fb7-eaff-4794-af5b-ca43ab53e342 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:58.212367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aa808fb7-eaff-4794-af5b-ca43ab53e342 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:58.214779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aa808fb7-eaff-4794-af5b-ca43ab53e342 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:58.216549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aa808fb7-eaff-4794-af5b-ca43ab53e342 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.175468 Nov 02 23:17:58.217468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1123/1698] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:58 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:58.222497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ad47b6cb-aeb9-4c33-be7c-836a06e1bd77 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:58.223497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ad47b6cb-aeb9-4c33-be7c-836a06e1bd77 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:58.230679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad47b6cb-aeb9-4c33-be7c-836a06e1bd77 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:58.231196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad47b6cb-aeb9-4c33-be7c-836a06e1bd77 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:58.232135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad47b6cb-aeb9-4c33-be7c-836a06e1bd77 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:58.234426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad47b6cb-aeb9-4c33-be7c-836a06e1bd77 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:58.263735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ad47b6cb-aeb9-4c33-be7c-836a06e1bd77 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044813 Nov 02 23:17:58.264315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1124/1699] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:58 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:58.403364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f34bbf08-b21a-4942-8edb-7b086aac3dc3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:58.403968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f34bbf08-b21a-4942-8edb-7b086aac3dc3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:58.410459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f34bbf08-b21a-4942-8edb-7b086aac3dc3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:58.410909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f34bbf08-b21a-4942-8edb-7b086aac3dc3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:58.411709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f34bbf08-b21a-4942-8edb-7b086aac3dc3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:58.412142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f34bbf08-b21a-4942-8edb-7b086aac3dc3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:58.547954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f34bbf08-b21a-4942-8edb-7b086aac3dc3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:58.559772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f34bbf08-b21a-4942-8edb-7b086aac3dc3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1675 microversion: 2.1 time: 0.159812 Nov 02 23:17:58.560818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1125/1700] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:17:58 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:17:59.235681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bf33e280-68db-444d-abd0-8dc8b3bbf3de tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:59.236315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bf33e280-68db-444d-abd0-8dc8b3bbf3de tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:59.243344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf33e280-68db-444d-abd0-8dc8b3bbf3de tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:59.243719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf33e280-68db-444d-abd0-8dc8b3bbf3de tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:59.244502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf33e280-68db-444d-abd0-8dc8b3bbf3de tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:59.244932 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf33e280-68db-444d-abd0-8dc8b3bbf3de tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:59.400134 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bf33e280-68db-444d-abd0-8dc8b3bbf3de tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:59.409144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bf33e280-68db-444d-abd0-8dc8b3bbf3de tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:59.411107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bf33e280-68db-444d-abd0-8dc8b3bbf3de tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:59.413095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bf33e280-68db-444d-abd0-8dc8b3bbf3de tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.180617 Nov 02 23:17:59.413779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1126/1701] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:17:59 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:17:59.422200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-37171015-7e76-431b-995b-0c387bedfaca tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:59.423869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-37171015-7e76-431b-995b-0c387bedfaca tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:59.435829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-37171015-7e76-431b-995b-0c387bedfaca tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:59.436479 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-37171015-7e76-431b-995b-0c387bedfaca tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:59.437390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-37171015-7e76-431b-995b-0c387bedfaca tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:59.437941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-37171015-7e76-431b-995b-0c387bedfaca tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:59.484142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-37171015-7e76-431b-995b-0c387bedfaca tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068623 Nov 02 23:17:59.485140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1127/1702] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:17:59 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:17:59.579905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e35bd711-5ca0-4719-a61e-4b91775a924a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:17:59.580987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e35bd711-5ca0-4719-a61e-4b91775a924a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:17:59.590768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e35bd711-5ca0-4719-a61e-4b91775a924a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:59.591726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e35bd711-5ca0-4719-a61e-4b91775a924a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:59.593125 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e35bd711-5ca0-4719-a61e-4b91775a924a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:59.593981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e35bd711-5ca0-4719-a61e-4b91775a924a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:59.678682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e35bd711-5ca0-4719-a61e-4b91775a924a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:17:59.692341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e35bd711-5ca0-4719-a61e-4b91775a924a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 200 len: 1607 microversion: 2.1 time: 0.117345 Nov 02 23:17:59.694661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1128/1703] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:17:59 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 1607 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:17:59.855870 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-d5de877c-8c74-424f-aa80-fa94bcfe9b69 req-99e5e6c0-ab41-41ec-8427-53d4d77c1ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8f293cf-a963-45dd-aaed-9149bfcfca7e", "name": "network-vif-deleted", "tag": "4d11da3d-8afb-463d-8fa2-77489cf1ff97"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:17:59.857549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:17:59.857549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:17:59.885573 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-d5de877c-8c74-424f-aa80-fa94bcfe9b69 req-99e5e6c0-ab41-41ec-8427-53d4d77c1ec4 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:17:59.886816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-d5de877c-8c74-424f-aa80-fa94bcfe9b69 req-99e5e6c0-ab41-41ec-8427-53d4d77c1ec4 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:17:59.919335 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-d5de877c-8c74-424f-aa80-fa94bcfe9b69 req-99e5e6c0-ab41-41ec-8427-53d4d77c1ec4 service nova] Creating event network-vif-deleted:4d11da3d-8afb-463d-8fa2-77489cf1ff97 for instance b8f293cf-a963-45dd-aaed-9149bfcfca7e on hv-cinder-81584 Nov 02 23:17:59.928359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-d5de877c-8c74-424f-aa80-fa94bcfe9b69 req-99e5e6c0-ab41-41ec-8427-53d4d77c1ec4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166722 Nov 02 23:17:59.933550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1129/1704] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:17:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:18:00.448508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2af0a32d-ff57-4fd4-bcd4-90498243c1bd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:00.450954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2af0a32d-ff57-4fd4-bcd4-90498243c1bd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:00.465734 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2af0a32d-ff57-4fd4-bcd4-90498243c1bd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:00.470060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2af0a32d-ff57-4fd4-bcd4-90498243c1bd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:00.471379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2af0a32d-ff57-4fd4-bcd4-90498243c1bd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:00.474868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2af0a32d-ff57-4fd4-bcd4-90498243c1bd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:00.706941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2af0a32d-ff57-4fd4-bcd4-90498243c1bd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:00.722009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2af0a32d-ff57-4fd4-bcd4-90498243c1bd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:00.724133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2af0a32d-ff57-4fd4-bcd4-90498243c1bd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:00.726263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2af0a32d-ff57-4fd4-bcd4-90498243c1bd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.284507 Nov 02 23:18:00.727233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1130/1705] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:00 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:00.738855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bea03bfd-454b-4b1f-83c3-05e2d79f30d5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:00.748638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bea03bfd-454b-4b1f-83c3-05e2d79f30d5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:00.760440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bea03bfd-454b-4b1f-83c3-05e2d79f30d5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:00.761164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bea03bfd-454b-4b1f-83c3-05e2d79f30d5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:00.762804 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bea03bfd-454b-4b1f-83c3-05e2d79f30d5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:00.763629 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bea03bfd-454b-4b1f-83c3-05e2d79f30d5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:00.796965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bea03bfd-454b-4b1f-83c3-05e2d79f30d5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067689 Nov 02 23:18:00.797834 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1131/1706] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:18:00 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:18:00.802685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aff1b563-e30a-4051-8efc-7028e48fc24c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:00.803863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aff1b563-e30a-4051-8efc-7028e48fc24c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:00.810771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aff1b563-e30a-4051-8efc-7028e48fc24c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:00.811251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aff1b563-e30a-4051-8efc-7028e48fc24c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:00.812178 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aff1b563-e30a-4051-8efc-7028e48fc24c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:00.812610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aff1b563-e30a-4051-8efc-7028e48fc24c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:00.829810 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-aff1b563-e30a-4051-8efc-7028e48fc24c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] HTTP exception thrown: Instance b8f293cf-a963-45dd-aaed-9149bfcfca7e could not be found. Nov 02 23:18:00.830415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aff1b563-e30a-4051-8efc-7028e48fc24c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Returning 404 to user: Instance b8f293cf-a963-45dd-aaed-9149bfcfca7e could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:18:00.831315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aff1b563-e30a-4051-8efc-7028e48fc24c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 404 len: 111 microversion: 2.1 time: 0.032234 Nov 02 23:18:00.835237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1132/1707] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:18:00 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 23:18:00.840294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fe013c2c-7a51-479c-b594-7ff8cbe10ebb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '.version_select at 0x7fd85c7c4b80>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:00.876426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fe013c2c-7a51-479c-b594-7ff8cbe10ebb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819848099" status: 202 len: 0 microversion: 2.1 time: 0.039429 Nov 02 23:18:00.877623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1133/1708] 10.222.0.41 () {58 vars in 1220 bytes} [Tue Nov 2 23:18:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819848099 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:18:01.755015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-34564bfb-f044-4dc7-863a-1591abe7a25e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:01.755675 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-34564bfb-f044-4dc7-863a-1591abe7a25e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:01.762585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-34564bfb-f044-4dc7-863a-1591abe7a25e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:01.763078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-34564bfb-f044-4dc7-863a-1591abe7a25e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:01.763860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-34564bfb-f044-4dc7-863a-1591abe7a25e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:01.764621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-34564bfb-f044-4dc7-863a-1591abe7a25e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:01.915710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-34564bfb-f044-4dc7-863a-1591abe7a25e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:01.924168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-34564bfb-f044-4dc7-863a-1591abe7a25e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:01.925675 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-34564bfb-f044-4dc7-863a-1591abe7a25e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:01.926875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-34564bfb-f044-4dc7-863a-1591abe7a25e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.176172 Nov 02 23:18:01.927470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1134/1709] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:01 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:01.931910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fbd58b3c-f465-4f58-8067-7d87e95beb03 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:01.932847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fbd58b3c-f465-4f58-8067-7d87e95beb03 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:01.939032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbd58b3c-f465-4f58-8067-7d87e95beb03 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:01.939483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbd58b3c-f465-4f58-8067-7d87e95beb03 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:01.940263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbd58b3c-f465-4f58-8067-7d87e95beb03 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:01.940706 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbd58b3c-f465-4f58-8067-7d87e95beb03 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:01.970890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fbd58b3c-f465-4f58-8067-7d87e95beb03 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042347 Nov 02 23:18:01.971514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1135/1710] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:18:01 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:18:01.976678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4f95b647-7d25-4435-a245-503c9fe75fde tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'create', calling method: .version_select at 0x7fd85c806a60>, body: {"keypair": {"name": "tempest-keypair-870691422"}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:01.997022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-4f95b647-7d25-4435-a245-503c9fe75fde tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Getting quotas for project 77f208bd920d437bb32e5caebf9eb2f9. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:18:02.001878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-4f95b647-7d25-4435-a245-503c9fe75fde tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Getting quotas for user c4b6bd01b54d492f9d37414393e9aec9 and project 77f208bd920d437bb32e5caebf9eb2f9. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:18:02.212848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-4f95b647-7d25-4435-a245-503c9fe75fde tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Getting quotas for project 77f208bd920d437bb32e5caebf9eb2f9. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:18:02.216962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-4f95b647-7d25-4435-a245-503c9fe75fde tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Getting quotas for user c4b6bd01b54d492f9d37414393e9aec9 and project 77f208bd920d437bb32e5caebf9eb2f9. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:18:02.231730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4f95b647-7d25-4435-a245-503c9fe75fde tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.259139 Nov 02 23:18:02.232678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1136/1711] 10.222.0.41 () {60 vars in 1157 bytes} [Tue Nov 2 23:18:01 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:18:02.949835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-06b51ec1-3a4e-4630-9524-4fb1977195e1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:02.951294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-06b51ec1-3a4e-4630-9524-4fb1977195e1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:02.962058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06b51ec1-3a4e-4630-9524-4fb1977195e1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:02.962576 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06b51ec1-3a4e-4630-9524-4fb1977195e1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:02.963624 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06b51ec1-3a4e-4630-9524-4fb1977195e1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:02.964191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06b51ec1-3a4e-4630-9524-4fb1977195e1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:03.181416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-06b51ec1-3a4e-4630-9524-4fb1977195e1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:03.199556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-06b51ec1-3a4e-4630-9524-4fb1977195e1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:03.215925 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-06b51ec1-3a4e-4630-9524-4fb1977195e1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:03.218376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-06b51ec1-3a4e-4630-9524-4fb1977195e1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.275434 Nov 02 23:18:03.219730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1137/1712] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:02 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:03.239918 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d602e589-e12e-4ab2-a099-1e4746f50775 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:03.243067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d602e589-e12e-4ab2-a099-1e4746f50775 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:03.253708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d602e589-e12e-4ab2-a099-1e4746f50775 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:03.254829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d602e589-e12e-4ab2-a099-1e4746f50775 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:03.256947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d602e589-e12e-4ab2-a099-1e4746f50775 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:03.257734 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d602e589-e12e-4ab2-a099-1e4746f50775 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:03.330760 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d602e589-e12e-4ab2-a099-1e4746f50775 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109125 Nov 02 23:18:03.331795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1138/1713] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:18:03 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:18:03.758774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a5d2814a-aa71-4cfa-85c5-57040fa784a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1356698399", "imageRef": "4159c567-fd66-4bbb-9bf4-6ce0afd65d88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "abf5285d-6abf-4483-8a42-c57127452e47"}], "security_groups": [{"name": "tempest-securitygroup--1981834285"}], "key_name": "tempest-keypair-870691422", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:03.867889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.network.neutron [None req-a5d2814a-aa71-4cfa-85c5-57040fa784a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] validate_networks() for [('abf5285d-6abf-4483-8a42-c57127452e47', None, None, None, None, None)] {{(pid=115800) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 23:18:04.314177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-a5d2814a-aa71-4cfa-85c5-57040fa784a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Flavor limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 23:18:04.315116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-a5d2814a-aa71-4cfa-85c5-57040fa784a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Image limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 23:18:04.315334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-a5d2814a-aa71-4cfa-85c5-57040fa784a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Flavor pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 23:18:04.315818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-a5d2814a-aa71-4cfa-85c5-57040fa784a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Image pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 23:18:04.316293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-a5d2814a-aa71-4cfa-85c5-57040fa784a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 23:18:04.326264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5d2814a-aa71-4cfa-85c5-57040fa784a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:04.326707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5d2814a-aa71-4cfa-85c5-57040fa784a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:04.327616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5d2814a-aa71-4cfa-85c5-57040fa784a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:04.328052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5d2814a-aa71-4cfa-85c5-57040fa784a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:04.353774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-a5d2814a-aa71-4cfa-85c5-57040fa784a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Getting quotas for project 77f208bd920d437bb32e5caebf9eb2f9. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:18:04.358441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-a5d2814a-aa71-4cfa-85c5-57040fa784a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Getting quotas for user c4b6bd01b54d492f9d37414393e9aec9 and project 77f208bd920d437bb32e5caebf9eb2f9. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:18:04.371120 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a5d2814a-aa71-4cfa-85c5-57040fa784a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Going to run 1 instances... {{(pid=115800) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 23:18:04.373839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a5d2814a-aa71-4cfa-85c5-57040fa784a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4159c567-fd66-4bbb-9bf4-6ce0afd65d88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 23:18:04.440384 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a5d2814a-aa71-4cfa-85c5-57040fa784a6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.685784 Nov 02 23:18:04.441567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1139/1714] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 2 23:18:03 2021] POST /compute/v2.1/servers => generated 402 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 23:18:04.446217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3e0c66b4-49af-49c8-8828-194b717585c3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:04.446985 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3e0c66b4-49af-49c8-8828-194b717585c3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:04.453971 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e0c66b4-49af-49c8-8828-194b717585c3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:04.454726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e0c66b4-49af-49c8-8828-194b717585c3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:04.456093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e0c66b4-49af-49c8-8828-194b717585c3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:04.456636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e0c66b4-49af-49c8-8828-194b717585c3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:04.614909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3e0c66b4-49af-49c8-8828-194b717585c3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:04.624800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3e0c66b4-49af-49c8-8828-194b717585c3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:04.626886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3e0c66b4-49af-49c8-8828-194b717585c3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:04.628253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3e0c66b4-49af-49c8-8828-194b717585c3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.185639 Nov 02 23:18:04.639449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1140/1715] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:04 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:18:04.651179 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-92a3472f-eb86-4333-8df9-a27547bfa431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:04.652995 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-92a3472f-eb86-4333-8df9-a27547bfa431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:04.663951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92a3472f-eb86-4333-8df9-a27547bfa431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:04.664690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92a3472f-eb86-4333-8df9-a27547bfa431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:04.666080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92a3472f-eb86-4333-8df9-a27547bfa431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:04.666739 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92a3472f-eb86-4333-8df9-a27547bfa431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:04.710068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-92a3472f-eb86-4333-8df9-a27547bfa431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069392 Nov 02 23:18:04.710641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1141/1716] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:18:04 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:18:04.714900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-050e4e95-59e3-4b79-bf46-87efc8b7d14f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:04.715554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-050e4e95-59e3-4b79-bf46-87efc8b7d14f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:04.773681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-050e4e95-59e3-4b79-bf46-87efc8b7d14f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:04.783843 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-050e4e95-59e3-4b79-bf46-87efc8b7d14f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651" status: 200 len: 1237 microversion: 2.1 time: 0.071738 Nov 02 23:18:04.784834 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1142/1717] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:18:04 2021] GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651 => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:18:05.650415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e296c117-8c27-4e2a-92f4-9837df024bf9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:05.651483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e296c117-8c27-4e2a-92f4-9837df024bf9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:05.659003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e296c117-8c27-4e2a-92f4-9837df024bf9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:05.659586 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e296c117-8c27-4e2a-92f4-9837df024bf9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:05.660457 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e296c117-8c27-4e2a-92f4-9837df024bf9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:05.660996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e296c117-8c27-4e2a-92f4-9837df024bf9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:05.868375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e296c117-8c27-4e2a-92f4-9837df024bf9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:05.885834 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e296c117-8c27-4e2a-92f4-9837df024bf9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:05.887441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e296c117-8c27-4e2a-92f4-9837df024bf9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:05.888674 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e296c117-8c27-4e2a-92f4-9837df024bf9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.242960 Nov 02 23:18:05.889233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1143/1718] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:05 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:05.893636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ec7d8640-6e96-41a9-a2e9-fe5905b80c02 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:05.894543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ec7d8640-6e96-41a9-a2e9-fe5905b80c02 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:05.900772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec7d8640-6e96-41a9-a2e9-fe5905b80c02 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:05.901220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec7d8640-6e96-41a9-a2e9-fe5905b80c02 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:05.901985 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec7d8640-6e96-41a9-a2e9-fe5905b80c02 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:05.902410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec7d8640-6e96-41a9-a2e9-fe5905b80c02 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:05.934979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ec7d8640-6e96-41a9-a2e9-fe5905b80c02 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 Nov 02 23:18:05.935558 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1144/1719] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:18:05 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:18:05.939826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3b4e53ab-05b3-45db-9f8f-d06c6dc3108e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:05.940428 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3b4e53ab-05b3-45db-9f8f-d06c6dc3108e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:05.946596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b4e53ab-05b3-45db-9f8f-d06c6dc3108e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:05.947090 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b4e53ab-05b3-45db-9f8f-d06c6dc3108e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:05.947869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b4e53ab-05b3-45db-9f8f-d06c6dc3108e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:05.948295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b4e53ab-05b3-45db-9f8f-d06c6dc3108e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:06.014486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3b4e53ab-05b3-45db-9f8f-d06c6dc3108e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:06.022570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3b4e53ab-05b3-45db-9f8f-d06c6dc3108e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651" status: 200 len: 1295 microversion: 2.1 time: 0.085667 Nov 02 23:18:06.023564 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1145/1720] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:18:05 2021] GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651 => generated 1295 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:18:06.908620 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c477bede-efcd-47e0-a724-b2b6641f8849 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:06.909489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c477bede-efcd-47e0-a724-b2b6641f8849 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:06.915777 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c477bede-efcd-47e0-a724-b2b6641f8849 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:06.916220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c477bede-efcd-47e0-a724-b2b6641f8849 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:06.916992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c477bede-efcd-47e0-a724-b2b6641f8849 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:06.917421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c477bede-efcd-47e0-a724-b2b6641f8849 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:07.098009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c477bede-efcd-47e0-a724-b2b6641f8849 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:07.107062 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c477bede-efcd-47e0-a724-b2b6641f8849 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:07.109042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c477bede-efcd-47e0-a724-b2b6641f8849 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:07.110305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c477bede-efcd-47e0-a724-b2b6641f8849 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.205561 Nov 02 23:18:07.111103 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1146/1721] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:06 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:07.116412 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f4e9424f-c6b7-4976-84a3-46a130c8982a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:07.117324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f4e9424f-c6b7-4976-84a3-46a130c8982a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:07.129147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f4e9424f-c6b7-4976-84a3-46a130c8982a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:07.129582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f4e9424f-c6b7-4976-84a3-46a130c8982a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:07.130366 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f4e9424f-c6b7-4976-84a3-46a130c8982a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:07.131434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f4e9424f-c6b7-4976-84a3-46a130c8982a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:07.172500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f4e9424f-c6b7-4976-84a3-46a130c8982a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059897 Nov 02 23:18:07.173097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1147/1722] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:18:07 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:18:07.179020 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4621644d-99e8-46c3-b5b9-2ab23477cd90 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:07.179686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4621644d-99e8-46c3-b5b9-2ab23477cd90 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:07.186495 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4621644d-99e8-46c3-b5b9-2ab23477cd90 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:07.186981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4621644d-99e8-46c3-b5b9-2ab23477cd90 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:07.187805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4621644d-99e8-46c3-b5b9-2ab23477cd90 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:07.188278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4621644d-99e8-46c3-b5b9-2ab23477cd90 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:07.384949 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4621644d-99e8-46c3-b5b9-2ab23477cd90 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:07.392963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4621644d-99e8-46c3-b5b9-2ab23477cd90 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651" status: 200 len: 1363 microversion: 2.1 time: 0.218369 Nov 02 23:18:07.393619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1148/1723] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:18:07 2021] GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:18:07.398086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-b0e0d5e4-f06d-437f-8baa-e29bdc1104b4 req-14806d6e-4b50-43c1-b809-a912e1e69568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91317c10-28a4-413c-ae6d-2021c9ed1651", "tag": "fff599b7-42ec-4525-81ff-f6549fc87633"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:07.399963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:18:07.399963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:18:07.409260 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-b0e0d5e4-f06d-437f-8baa-e29bdc1104b4 req-14806d6e-4b50-43c1-b809-a912e1e69568 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:07.409788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-b0e0d5e4-f06d-437f-8baa-e29bdc1104b4 req-14806d6e-4b50-43c1-b809-a912e1e69568 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:07.435844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-b0e0d5e4-f06d-437f-8baa-e29bdc1104b4 req-14806d6e-4b50-43c1-b809-a912e1e69568 service nova] Creating event network-changed:fff599b7-42ec-4525-81ff-f6549fc87633 for instance 91317c10-28a4-413c-ae6d-2021c9ed1651 on hv-cinder-81584 Nov 02 23:18:07.445650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-b0e0d5e4-f06d-437f-8baa-e29bdc1104b4 req-14806d6e-4b50-43c1-b809-a912e1e69568 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049397 Nov 02 23:18:07.446761 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1149/1724] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:18:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:18:08.132123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ab8f0e37-4b2c-4928-89e3-383dc101a3dd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:08.132959 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ab8f0e37-4b2c-4928-89e3-383dc101a3dd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:08.139338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ab8f0e37-4b2c-4928-89e3-383dc101a3dd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:08.139790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ab8f0e37-4b2c-4928-89e3-383dc101a3dd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:08.140569 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ab8f0e37-4b2c-4928-89e3-383dc101a3dd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:08.141002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ab8f0e37-4b2c-4928-89e3-383dc101a3dd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:08.293019 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ab8f0e37-4b2c-4928-89e3-383dc101a3dd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:08.302529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ab8f0e37-4b2c-4928-89e3-383dc101a3dd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:08.304553 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ab8f0e37-4b2c-4928-89e3-383dc101a3dd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:08.305846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ab8f0e37-4b2c-4928-89e3-383dc101a3dd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.178317 Nov 02 23:18:08.306423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1150/1725] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:08 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:08.310952 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4759b06d-759a-44f8-80f9-8184d295009d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:08.311883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4759b06d-759a-44f8-80f9-8184d295009d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:08.320957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4759b06d-759a-44f8-80f9-8184d295009d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:08.321782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4759b06d-759a-44f8-80f9-8184d295009d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:08.322725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4759b06d-759a-44f8-80f9-8184d295009d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:08.323338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4759b06d-759a-44f8-80f9-8184d295009d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:08.357279 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4759b06d-759a-44f8-80f9-8184d295009d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049768 Nov 02 23:18:08.357856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1151/1726] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:18:08 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:18:08.410815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6854c2ba-d8b3-4b58-8a0a-f1a0f4799061 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:08.411709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6854c2ba-d8b3-4b58-8a0a-f1a0f4799061 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:08.418534 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6854c2ba-d8b3-4b58-8a0a-f1a0f4799061 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:08.419155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6854c2ba-d8b3-4b58-8a0a-f1a0f4799061 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:08.419990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6854c2ba-d8b3-4b58-8a0a-f1a0f4799061 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:08.420476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6854c2ba-d8b3-4b58-8a0a-f1a0f4799061 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:08.572417 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6854c2ba-d8b3-4b58-8a0a-f1a0f4799061 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:08.580332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6854c2ba-d8b3-4b58-8a0a-f1a0f4799061 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651" status: 200 len: 1363 microversion: 2.1 time: 0.173280 Nov 02 23:18:08.581335 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1152/1727] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:18:08 2021] GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:18:09.329679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-11ae0dc4-b059-43b1-a729-728a0eef585e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:09.330571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-11ae0dc4-b059-43b1-a729-728a0eef585e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:09.336945 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-11ae0dc4-b059-43b1-a729-728a0eef585e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:09.337392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-11ae0dc4-b059-43b1-a729-728a0eef585e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:09.338162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-11ae0dc4-b059-43b1-a729-728a0eef585e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:09.338588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-11ae0dc4-b059-43b1-a729-728a0eef585e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:09.469918 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-11ae0dc4-b059-43b1-a729-728a0eef585e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:09.478306 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-11ae0dc4-b059-43b1-a729-728a0eef585e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:09.479829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-11ae0dc4-b059-43b1-a729-728a0eef585e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:09.480986 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-11ae0dc4-b059-43b1-a729-728a0eef585e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.155712 Nov 02 23:18:09.481549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1153/1728] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:09 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:09.485893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-edb157b4-d5df-42ac-a6f4-d9a384583612 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:09.486790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-edb157b4-d5df-42ac-a6f4-d9a384583612 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:09.493281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-edb157b4-d5df-42ac-a6f4-d9a384583612 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:09.493726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-edb157b4-d5df-42ac-a6f4-d9a384583612 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:09.494527 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-edb157b4-d5df-42ac-a6f4-d9a384583612 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:09.494989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-edb157b4-d5df-42ac-a6f4-d9a384583612 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:09.525731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-edb157b4-d5df-42ac-a6f4-d9a384583612 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043137 Nov 02 23:18:09.526303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1154/1729] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:18:09 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:18:09.600010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e55009dc-37ec-4647-a9d7-21ae75282bc8 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:09.601027 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e55009dc-37ec-4647-a9d7-21ae75282bc8 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:09.607262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e55009dc-37ec-4647-a9d7-21ae75282bc8 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:09.607713 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e55009dc-37ec-4647-a9d7-21ae75282bc8 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:09.608493 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e55009dc-37ec-4647-a9d7-21ae75282bc8 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:09.608925 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e55009dc-37ec-4647-a9d7-21ae75282bc8 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:09.766131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e55009dc-37ec-4647-a9d7-21ae75282bc8 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:09.774859 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e55009dc-37ec-4647-a9d7-21ae75282bc8 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651" status: 200 len: 1363 microversion: 2.1 time: 0.181514 Nov 02 23:18:09.775552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1155/1730] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:18:09 2021] GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:18:10.501453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-39445729-7f43-4c5c-9bea-45666509124e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:10.502257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-39445729-7f43-4c5c-9bea-45666509124e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:10.510758 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39445729-7f43-4c5c-9bea-45666509124e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:10.511351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39445729-7f43-4c5c-9bea-45666509124e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:10.512327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39445729-7f43-4c5c-9bea-45666509124e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:10.512955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39445729-7f43-4c5c-9bea-45666509124e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:10.656845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-39445729-7f43-4c5c-9bea-45666509124e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:10.665342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-39445729-7f43-4c5c-9bea-45666509124e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:10.666831 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-39445729-7f43-4c5c-9bea-45666509124e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:10.668085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-39445729-7f43-4c5c-9bea-45666509124e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.171593 Nov 02 23:18:10.678940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1156/1731] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:10 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:10.678940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0191b89f-802c-41a8-8976-ef8c77bd1ec9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:10.678940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0191b89f-802c-41a8-8976-ef8c77bd1ec9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:10.680415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0191b89f-802c-41a8-8976-ef8c77bd1ec9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:10.680863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0191b89f-802c-41a8-8976-ef8c77bd1ec9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:10.681620 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0191b89f-802c-41a8-8976-ef8c77bd1ec9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:10.682261 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0191b89f-802c-41a8-8976-ef8c77bd1ec9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:10.714435 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0191b89f-802c-41a8-8976-ef8c77bd1ec9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044750 Nov 02 23:18:10.715057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1157/1732] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:18:10 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:18:10.794469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-21718de5-a362-47d3-9026-584f0a1ee61c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:10.795460 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-21718de5-a362-47d3-9026-584f0a1ee61c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:10.803373 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21718de5-a362-47d3-9026-584f0a1ee61c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:10.803821 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21718de5-a362-47d3-9026-584f0a1ee61c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:10.804603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21718de5-a362-47d3-9026-584f0a1ee61c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:10.805036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21718de5-a362-47d3-9026-584f0a1ee61c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:10.936028 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-21718de5-a362-47d3-9026-584f0a1ee61c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:10.944413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-21718de5-a362-47d3-9026-584f0a1ee61c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651" status: 200 len: 1363 microversion: 2.1 time: 0.155760 Nov 02 23:18:10.944990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1158/1733] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:18:10 2021] GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:18:11.686289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-41b0740e-3d49-4f7c-86d7-621df4320381 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:11.686972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-41b0740e-3d49-4f7c-86d7-621df4320381 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:11.693560 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-41b0740e-3d49-4f7c-86d7-621df4320381 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:11.694008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-41b0740e-3d49-4f7c-86d7-621df4320381 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:11.694785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-41b0740e-3d49-4f7c-86d7-621df4320381 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:11.695254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-41b0740e-3d49-4f7c-86d7-621df4320381 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:11.841478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-41b0740e-3d49-4f7c-86d7-621df4320381 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:11.850698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-41b0740e-3d49-4f7c-86d7-621df4320381 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:11.852225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-41b0740e-3d49-4f7c-86d7-621df4320381 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:11.853378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-41b0740e-3d49-4f7c-86d7-621df4320381 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.170889 Nov 02 23:18:11.853943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1159/1734] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:11 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:11.858425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9a47051b-f368-4f50-b84b-119dcdbc3fae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:11.859350 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9a47051b-f368-4f50-b84b-119dcdbc3fae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:11.865325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a47051b-f368-4f50-b84b-119dcdbc3fae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:11.865773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a47051b-f368-4f50-b84b-119dcdbc3fae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:11.866546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a47051b-f368-4f50-b84b-119dcdbc3fae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:11.867008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a47051b-f368-4f50-b84b-119dcdbc3fae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:11.897404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9a47051b-f368-4f50-b84b-119dcdbc3fae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041920 Nov 02 23:18:11.897972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1160/1735] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:18:11 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:18:11.962232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bb0a7cd8-8308-4e96-9142-1325f1937365 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:11.962739 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bb0a7cd8-8308-4e96-9142-1325f1937365 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:11.968659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bb0a7cd8-8308-4e96-9142-1325f1937365 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:11.969103 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bb0a7cd8-8308-4e96-9142-1325f1937365 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:11.969864 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bb0a7cd8-8308-4e96-9142-1325f1937365 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:11.970290 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bb0a7cd8-8308-4e96-9142-1325f1937365 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:12.103907 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bb0a7cd8-8308-4e96-9142-1325f1937365 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:12.111211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bb0a7cd8-8308-4e96-9142-1325f1937365 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651" status: 200 len: 1363 microversion: 2.1 time: 0.153266 Nov 02 23:18:12.111975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1161/1736] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:18:11 2021] GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:18:12.873569 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-00a60c9f-0adf-4146-9d0a-d06fbccbbdc2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:12.874411 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-00a60c9f-0adf-4146-9d0a-d06fbccbbdc2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:12.882852 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-00a60c9f-0adf-4146-9d0a-d06fbccbbdc2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:12.883583 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-00a60c9f-0adf-4146-9d0a-d06fbccbbdc2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:12.884623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-00a60c9f-0adf-4146-9d0a-d06fbccbbdc2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:12.885230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-00a60c9f-0adf-4146-9d0a-d06fbccbbdc2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:13.037625 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-00a60c9f-0adf-4146-9d0a-d06fbccbbdc2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:13.046047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-00a60c9f-0adf-4146-9d0a-d06fbccbbdc2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:13.047572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-00a60c9f-0adf-4146-9d0a-d06fbccbbdc2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:13.048726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-00a60c9f-0adf-4146-9d0a-d06fbccbbdc2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.179164 Nov 02 23:18:13.049283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1162/1737] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:12 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:13.056459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-35fc1065-ffce-4969-982a-c37967d25e5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:13.057657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-35fc1065-ffce-4969-982a-c37967d25e5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:13.064944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-35fc1065-ffce-4969-982a-c37967d25e5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:13.065489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-35fc1065-ffce-4969-982a-c37967d25e5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:13.066482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-35fc1065-ffce-4969-982a-c37967d25e5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:13.067114 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-35fc1065-ffce-4969-982a-c37967d25e5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:13.105744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-35fc1065-ffce-4969-982a-c37967d25e5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053905 Nov 02 23:18:13.106439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1163/1738] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 2 23:18:13 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:18:13.129064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f9a90d11-2d03-420a-80f6-3e8758ebc1f2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:13.129818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f9a90d11-2d03-420a-80f6-3e8758ebc1f2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:13.137439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f9a90d11-2d03-420a-80f6-3e8758ebc1f2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:13.137975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f9a90d11-2d03-420a-80f6-3e8758ebc1f2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:13.139087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f9a90d11-2d03-420a-80f6-3e8758ebc1f2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:13.139751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f9a90d11-2d03-420a-80f6-3e8758ebc1f2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:13.298309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f9a90d11-2d03-420a-80f6-3e8758ebc1f2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:13.305726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f9a90d11-2d03-420a-80f6-3e8758ebc1f2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651" status: 200 len: 1363 microversion: 2.1 time: 0.181471 Nov 02 23:18:13.306293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1164/1739] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:18:13 2021] GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:18:14.066518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c462dbcf-b89a-4b30-afdc-c1041aae1d14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:14.067192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c462dbcf-b89a-4b30-afdc-c1041aae1d14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:14.074041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c462dbcf-b89a-4b30-afdc-c1041aae1d14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:14.074491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c462dbcf-b89a-4b30-afdc-c1041aae1d14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:14.075561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c462dbcf-b89a-4b30-afdc-c1041aae1d14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:14.075998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c462dbcf-b89a-4b30-afdc-c1041aae1d14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:14.211817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c462dbcf-b89a-4b30-afdc-c1041aae1d14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:14.225479 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c462dbcf-b89a-4b30-afdc-c1041aae1d14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:14.228159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c462dbcf-b89a-4b30-afdc-c1041aae1d14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:14.230153 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c462dbcf-b89a-4b30-afdc-c1041aae1d14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.167157 Nov 02 23:18:14.231333 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1165/1740] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:14 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:18:14.238266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4a5e4c16-20ca-4b68-b061-32c92ef4c913 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:14.240378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4a5e4c16-20ca-4b68-b061-32c92ef4c913 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:14.247750 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a5e4c16-20ca-4b68-b061-32c92ef4c913 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:14.248195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a5e4c16-20ca-4b68-b061-32c92ef4c913 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:14.248970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a5e4c16-20ca-4b68-b061-32c92ef4c913 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:14.249397 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a5e4c16-20ca-4b68-b061-32c92ef4c913 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:14.353794 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4a5e4c16-20ca-4b68-b061-32c92ef4c913 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "POST /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/action" status: 200 len: 97523 microversion: 2.1 time: 0.120884 Nov 02 23:18:14.354427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1166/1741] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:14 2021] POST /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3/action => generated 97523 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:14.359637 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-88d3ca7a-e9ef-4bfc-8de9-f6604de849cc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:14.360371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-88d3ca7a-e9ef-4bfc-8de9-f6604de849cc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:14.369133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88d3ca7a-e9ef-4bfc-8de9-f6604de849cc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:14.369772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88d3ca7a-e9ef-4bfc-8de9-f6604de849cc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:14.370302 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88d3ca7a-e9ef-4bfc-8de9-f6604de849cc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:14.370737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88d3ca7a-e9ef-4bfc-8de9-f6604de849cc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:14.515105 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-88d3ca7a-e9ef-4bfc-8de9-f6604de849cc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:14.523192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-88d3ca7a-e9ef-4bfc-8de9-f6604de849cc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651" status: 200 len: 1363 microversion: 2.1 time: 0.167547 Nov 02 23:18:14.523768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1167/1742] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:18:14 2021] GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:18:15.250123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b5992670-a1f9-47a3-b2bc-6123593031ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:15.250866 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b5992670-a1f9-47a3-b2bc-6123593031ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:15.257747 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5992670-a1f9-47a3-b2bc-6123593031ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:15.258197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5992670-a1f9-47a3-b2bc-6123593031ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:15.259022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5992670-a1f9-47a3-b2bc-6123593031ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:15.259464 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5992670-a1f9-47a3-b2bc-6123593031ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:15.414075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b5992670-a1f9-47a3-b2bc-6123593031ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:15.423300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b5992670-a1f9-47a3-b2bc-6123593031ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:15.425278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b5992670-a1f9-47a3-b2bc-6123593031ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:15.426499 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b5992670-a1f9-47a3-b2bc-6123593031ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.180213 Nov 02 23:18:15.427132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1168/1743] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:15 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:15.547791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5b32a9c4-6aa8-4093-af5c-7b5c35125cf7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:15.548397 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5b32a9c4-6aa8-4093-af5c-7b5c35125cf7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:15.554735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b32a9c4-6aa8-4093-af5c-7b5c35125cf7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:15.555212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b32a9c4-6aa8-4093-af5c-7b5c35125cf7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:15.555975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b32a9c4-6aa8-4093-af5c-7b5c35125cf7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:15.556403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b32a9c4-6aa8-4093-af5c-7b5c35125cf7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:15.693329 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5b32a9c4-6aa8-4093-af5c-7b5c35125cf7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:15.701024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5b32a9c4-6aa8-4093-af5c-7b5c35125cf7 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651" status: 200 len: 1363 microversion: 2.1 time: 0.156829 Nov 02 23:18:15.701602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1169/1744] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:18:15 2021] GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:18:16.451712 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d15ec751-3b5c-4b8f-aaa5-4fa6910e4174 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:16.452397 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d15ec751-3b5c-4b8f-aaa5-4fa6910e4174 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:16.458723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d15ec751-3b5c-4b8f-aaa5-4fa6910e4174 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:16.459192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d15ec751-3b5c-4b8f-aaa5-4fa6910e4174 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:16.460008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d15ec751-3b5c-4b8f-aaa5-4fa6910e4174 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:16.460384 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d15ec751-3b5c-4b8f-aaa5-4fa6910e4174 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:16.590044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d15ec751-3b5c-4b8f-aaa5-4fa6910e4174 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:16.598357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d15ec751-3b5c-4b8f-aaa5-4fa6910e4174 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:16.600362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d15ec751-3b5c-4b8f-aaa5-4fa6910e4174 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:16.601518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d15ec751-3b5c-4b8f-aaa5-4fa6910e4174 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.157487 Nov 02 23:18:16.602294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1170/1745] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:16 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:16.719422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-18316f2c-f269-40bd-b5de-e55b3ab508c4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:16.720036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-18316f2c-f269-40bd-b5de-e55b3ab508c4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:16.726910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-18316f2c-f269-40bd-b5de-e55b3ab508c4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:16.727389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-18316f2c-f269-40bd-b5de-e55b3ab508c4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:16.728182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-18316f2c-f269-40bd-b5de-e55b3ab508c4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:16.728621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-18316f2c-f269-40bd-b5de-e55b3ab508c4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:16.878268 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-18316f2c-f269-40bd-b5de-e55b3ab508c4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:16.886436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-18316f2c-f269-40bd-b5de-e55b3ab508c4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651" status: 200 len: 1363 microversion: 2.1 time: 0.170596 Nov 02 23:18:16.887121 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1171/1746] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:18:16 2021] GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:18:16.950539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-bc9ec06e-cf37-43c8-8cf5-9df798882617 req-fac75ad4-3243-4494-9fc1-353bd48b8373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91317c10-28a4-413c-ae6d-2021c9ed1651", "name": "network-vif-plugged", "status": "completed", "tag": "fff599b7-42ec-4525-81ff-f6549fc87633"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:16.952256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:18:16.952256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:18:16.959610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-bc9ec06e-cf37-43c8-8cf5-9df798882617 req-fac75ad4-3243-4494-9fc1-353bd48b8373 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:16.960060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-bc9ec06e-cf37-43c8-8cf5-9df798882617 req-fac75ad4-3243-4494-9fc1-353bd48b8373 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:16.971277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-bc9ec06e-cf37-43c8-8cf5-9df798882617 req-fac75ad4-3243-4494-9fc1-353bd48b8373 service nova] Creating event network-vif-plugged:fff599b7-42ec-4525-81ff-f6549fc87633 for instance 91317c10-28a4-413c-ae6d-2021c9ed1651 on hv-cinder-81584 Nov 02 23:18:16.976771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-bc9ec06e-cf37-43c8-8cf5-9df798882617 req-fac75ad4-3243-4494-9fc1-353bd48b8373 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088337 Nov 02 23:18:16.977688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1172/1747] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:18:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:18:17.620602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e15ed5a4-f6e2-45fa-b3a3-f6c77eacc648 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:17.621316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e15ed5a4-f6e2-45fa-b3a3-f6c77eacc648 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:17.628298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e15ed5a4-f6e2-45fa-b3a3-f6c77eacc648 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:17.628737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e15ed5a4-f6e2-45fa-b3a3-f6c77eacc648 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:17.629528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e15ed5a4-f6e2-45fa-b3a3-f6c77eacc648 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:17.629958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e15ed5a4-f6e2-45fa-b3a3-f6c77eacc648 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:17.771179 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e15ed5a4-f6e2-45fa-b3a3-f6c77eacc648 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:17.779384 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e15ed5a4-f6e2-45fa-b3a3-f6c77eacc648 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:17.780858 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e15ed5a4-f6e2-45fa-b3a3-f6c77eacc648 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:17.782293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e15ed5a4-f6e2-45fa-b3a3-f6c77eacc648 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.166064 Nov 02 23:18:17.782557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1173/1748] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:17 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:17.902804 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-82857caa-21c5-4daa-8e66-31eece48a22b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:17.903523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-82857caa-21c5-4daa-8e66-31eece48a22b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:17.909395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82857caa-21c5-4daa-8e66-31eece48a22b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:17.909838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82857caa-21c5-4daa-8e66-31eece48a22b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:17.910600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82857caa-21c5-4daa-8e66-31eece48a22b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:17.911058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82857caa-21c5-4daa-8e66-31eece48a22b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:18.057422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-82857caa-21c5-4daa-8e66-31eece48a22b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:18.065088 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-82857caa-21c5-4daa-8e66-31eece48a22b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651" status: 200 len: 1363 microversion: 2.1 time: 0.165833 Nov 02 23:18:18.065876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1174/1749] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:18:17 2021] GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:18:18.801048 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-60dc4edd-9f4d-4125-8070-0d570d5800fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:18.801727 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-60dc4edd-9f4d-4125-8070-0d570d5800fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:18.808086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-60dc4edd-9f4d-4125-8070-0d570d5800fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:18.808522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-60dc4edd-9f4d-4125-8070-0d570d5800fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:18.809284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-60dc4edd-9f4d-4125-8070-0d570d5800fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:18.809707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-60dc4edd-9f4d-4125-8070-0d570d5800fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:18.955899 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-60dc4edd-9f4d-4125-8070-0d570d5800fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:18.965070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-60dc4edd-9f4d-4125-8070-0d570d5800fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:18.966560 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-60dc4edd-9f4d-4125-8070-0d570d5800fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:18.967754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-60dc4edd-9f4d-4125-8070-0d570d5800fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.170417 Nov 02 23:18:18.968330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1175/1750] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:18 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:19.082176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d8262081-e1cc-4e38-9093-5a3b975f394f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:19.082792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d8262081-e1cc-4e38-9093-5a3b975f394f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:19.090232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8262081-e1cc-4e38-9093-5a3b975f394f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:19.090686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8262081-e1cc-4e38-9093-5a3b975f394f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:19.091686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8262081-e1cc-4e38-9093-5a3b975f394f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:19.092122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8262081-e1cc-4e38-9093-5a3b975f394f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:19.287940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d8262081-e1cc-4e38-9093-5a3b975f394f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:19.295498 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d8262081-e1cc-4e38-9093-5a3b975f394f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651" status: 200 len: 1363 microversion: 2.1 time: 0.217234 Nov 02 23:18:19.296083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1176/1751] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:18:19 2021] GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:18:19.986543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7c23aa3e-61c3-4204-92a3-6e830604423b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:19.987256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7c23aa3e-61c3-4204-92a3-6e830604423b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:19.993958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7c23aa3e-61c3-4204-92a3-6e830604423b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:19.994506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7c23aa3e-61c3-4204-92a3-6e830604423b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:19.995490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7c23aa3e-61c3-4204-92a3-6e830604423b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:19.995960 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7c23aa3e-61c3-4204-92a3-6e830604423b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:20.147637 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7c23aa3e-61c3-4204-92a3-6e830604423b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:20.156892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7c23aa3e-61c3-4204-92a3-6e830604423b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:20.158475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7c23aa3e-61c3-4204-92a3-6e830604423b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:20.159621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7c23aa3e-61c3-4204-92a3-6e830604423b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.177037 Nov 02 23:18:20.160203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1177/1752] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:19 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:20.315587 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-72455e59-25b9-4c2d-afc5-a1f75d1a83b1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:20.316191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-72455e59-25b9-4c2d-afc5-a1f75d1a83b1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:20.322656 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72455e59-25b9-4c2d-afc5-a1f75d1a83b1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:20.323157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72455e59-25b9-4c2d-afc5-a1f75d1a83b1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:20.323926 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72455e59-25b9-4c2d-afc5-a1f75d1a83b1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:20.324353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72455e59-25b9-4c2d-afc5-a1f75d1a83b1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:20.456555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-72455e59-25b9-4c2d-afc5-a1f75d1a83b1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:20.464636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-72455e59-25b9-4c2d-afc5-a1f75d1a83b1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651" status: 200 len: 1549 microversion: 2.1 time: 0.152585 Nov 02 23:18:20.465134 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1178/1753] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:18:20 2021] GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:18:20.480754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-64e42d57-d51b-4155-a3dd-73cf470ac683 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:20.481242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-64e42d57-d51b-4155-a3dd-73cf470ac683 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:20.487231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-64e42d57-d51b-4155-a3dd-73cf470ac683 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:20.487682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-64e42d57-d51b-4155-a3dd-73cf470ac683 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:20.488450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-64e42d57-d51b-4155-a3dd-73cf470ac683 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:20.488886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-64e42d57-d51b-4155-a3dd-73cf470ac683 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:20.570024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-64e42d57-d51b-4155-a3dd-73cf470ac683 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092856 Nov 02 23:18:20.570619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1179/1754] 10.222.0.41 () {58 vars in 1274 bytes} [Tue Nov 2 23:18:20 2021] GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:18:21.179372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1d1ae2d6-8980-4835-bca3-457acbffac3d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:21.180040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1d1ae2d6-8980-4835-bca3-457acbffac3d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:21.186098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d1ae2d6-8980-4835-bca3-457acbffac3d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:21.186545 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d1ae2d6-8980-4835-bca3-457acbffac3d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:21.187427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d1ae2d6-8980-4835-bca3-457acbffac3d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:21.187869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d1ae2d6-8980-4835-bca3-457acbffac3d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:21.495308 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1d1ae2d6-8980-4835-bca3-457acbffac3d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:21.503779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1d1ae2d6-8980-4835-bca3-457acbffac3d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:21.505280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1d1ae2d6-8980-4835-bca3-457acbffac3d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:21.506445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1d1ae2d6-8980-4835-bca3-457acbffac3d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.331454 Nov 02 23:18:21.507037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1180/1755] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:21 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:21.965734 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8c756bc7-c56a-471a-8bfd-3a7066763d4b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:21.966779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8c756bc7-c56a-471a-8bfd-3a7066763d4b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:21.972770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c756bc7-c56a-471a-8bfd-3a7066763d4b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:21.973292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c756bc7-c56a-471a-8bfd-3a7066763d4b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:21.974745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c756bc7-c56a-471a-8bfd-3a7066763d4b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:21.975262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c756bc7-c56a-471a-8bfd-3a7066763d4b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:22.065727 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8c756bc7-c56a-471a-8bfd-3a7066763d4b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 14 microversion: 2.1 time: 0.102966 Nov 02 23:18:22.067035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1181/1756] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:21 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 23:18:22.156708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-27854c92-4981-4fcf-99da-23f53010d38e req-832ec531-858b-411a-ab83-8af42e9860c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91317c10-28a4-413c-ae6d-2021c9ed1651", "tag": "fff599b7-42ec-4525-81ff-f6549fc87633"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:22.159603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:18:22.159603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:18:22.166891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-27854c92-4981-4fcf-99da-23f53010d38e req-832ec531-858b-411a-ab83-8af42e9860c8 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:22.167505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-27854c92-4981-4fcf-99da-23f53010d38e req-832ec531-858b-411a-ab83-8af42e9860c8 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:22.179006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-27854c92-4981-4fcf-99da-23f53010d38e req-832ec531-858b-411a-ab83-8af42e9860c8 service nova] Creating event network-changed:fff599b7-42ec-4525-81ff-f6549fc87633 for instance 91317c10-28a4-413c-ae6d-2021c9ed1651 on hv-cinder-81584 Nov 02 23:18:22.185367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-27854c92-4981-4fcf-99da-23f53010d38e req-832ec531-858b-411a-ab83-8af42e9860c8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115338 Nov 02 23:18:22.186696 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1182/1757] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:18:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:18:22.526034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-be0c432d-4242-47a6-b789-60f64ec4905c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:22.526843 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-be0c432d-4242-47a6-b789-60f64ec4905c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:22.533472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be0c432d-4242-47a6-b789-60f64ec4905c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:22.534265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be0c432d-4242-47a6-b789-60f64ec4905c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:22.535168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be0c432d-4242-47a6-b789-60f64ec4905c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:22.535703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be0c432d-4242-47a6-b789-60f64ec4905c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:22.728579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-be0c432d-4242-47a6-b789-60f64ec4905c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:22.747001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-be0c432d-4242-47a6-b789-60f64ec4905c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:22.750825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-be0c432d-4242-47a6-b789-60f64ec4905c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:22.753181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-be0c432d-4242-47a6-b789-60f64ec4905c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.231603 Nov 02 23:18:22.767348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1183/1758] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:22 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:23.078583 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b5f866a3-42cc-454a-9b70-33607b2bebdf tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:23.079601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b5f866a3-42cc-454a-9b70-33607b2bebdf tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:23.086657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5f866a3-42cc-454a-9b70-33607b2bebdf tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:23.087155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5f866a3-42cc-454a-9b70-33607b2bebdf tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:23.087926 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5f866a3-42cc-454a-9b70-33607b2bebdf tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:23.088363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5f866a3-42cc-454a-9b70-33607b2bebdf tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:23.173461 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b5f866a3-42cc-454a-9b70-33607b2bebdf tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 14 microversion: 2.1 time: 0.098987 Nov 02 23:18:23.174456 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1184/1759] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:23 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 23:18:23.781086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-01da57e4-160b-4a17-b150-58bc7926642a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:23.781892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-01da57e4-160b-4a17-b150-58bc7926642a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:23.790494 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-01da57e4-160b-4a17-b150-58bc7926642a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:23.790829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-01da57e4-160b-4a17-b150-58bc7926642a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:23.791629 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-01da57e4-160b-4a17-b150-58bc7926642a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:23.792054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-01da57e4-160b-4a17-b150-58bc7926642a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:23.939172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-01da57e4-160b-4a17-b150-58bc7926642a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:23.950182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-01da57e4-160b-4a17-b150-58bc7926642a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:23.952071 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-01da57e4-160b-4a17-b150-58bc7926642a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:23.954111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-01da57e4-160b-4a17-b150-58bc7926642a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.177267 Nov 02 23:18:23.955439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1185/1760] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:23 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:24.188347 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-256968c2-a61b-4dea-a5e7-b33af63d02f8 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:24.189848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-256968c2-a61b-4dea-a5e7-b33af63d02f8 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:24.196310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-256968c2-a61b-4dea-a5e7-b33af63d02f8 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:24.196756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-256968c2-a61b-4dea-a5e7-b33af63d02f8 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:24.197523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-256968c2-a61b-4dea-a5e7-b33af63d02f8 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:24.197956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-256968c2-a61b-4dea-a5e7-b33af63d02f8 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:24.335748 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-256968c2-a61b-4dea-a5e7-b33af63d02f8 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 14 microversion: 2.1 time: 0.154567 Nov 02 23:18:24.336389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1186/1761] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:24 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 23:18:24.977084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fac37eba-e84d-4f61-9e1b-97ee9a8b8b16 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:24.977774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fac37eba-e84d-4f61-9e1b-97ee9a8b8b16 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:24.984710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fac37eba-e84d-4f61-9e1b-97ee9a8b8b16 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:24.985153 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fac37eba-e84d-4f61-9e1b-97ee9a8b8b16 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:24.985972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fac37eba-e84d-4f61-9e1b-97ee9a8b8b16 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:24.986407 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fac37eba-e84d-4f61-9e1b-97ee9a8b8b16 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:25.131598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fac37eba-e84d-4f61-9e1b-97ee9a8b8b16 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:25.139851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fac37eba-e84d-4f61-9e1b-97ee9a8b8b16 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:25.141345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fac37eba-e84d-4f61-9e1b-97ee9a8b8b16 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:25.142559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fac37eba-e84d-4f61-9e1b-97ee9a8b8b16 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.169606 Nov 02 23:18:25.143174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1187/1762] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:24 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:25.345884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c5fca54d-0481-4479-aa59-558f27e10711 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:25.346805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c5fca54d-0481-4479-aa59-558f27e10711 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:25.354484 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c5fca54d-0481-4479-aa59-558f27e10711 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:25.354944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c5fca54d-0481-4479-aa59-558f27e10711 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:25.355739 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c5fca54d-0481-4479-aa59-558f27e10711 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:25.356168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c5fca54d-0481-4479-aa59-558f27e10711 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:25.452987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c5fca54d-0481-4479-aa59-558f27e10711 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 14 microversion: 2.1 time: 0.110605 Nov 02 23:18:25.453792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1188/1763] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:25 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 23:18:26.160821 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b05cc2ba-0ba9-4890-820b-8102ec666fab tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:26.162048 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b05cc2ba-0ba9-4890-820b-8102ec666fab tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:26.169209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b05cc2ba-0ba9-4890-820b-8102ec666fab tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:26.169653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b05cc2ba-0ba9-4890-820b-8102ec666fab tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:26.170506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b05cc2ba-0ba9-4890-820b-8102ec666fab tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:26.170885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b05cc2ba-0ba9-4890-820b-8102ec666fab tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:26.305102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b05cc2ba-0ba9-4890-820b-8102ec666fab tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:26.313619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b05cc2ba-0ba9-4890-820b-8102ec666fab tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:26.315144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b05cc2ba-0ba9-4890-820b-8102ec666fab tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:26.316300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b05cc2ba-0ba9-4890-820b-8102ec666fab tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.159632 Nov 02 23:18:26.316964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1189/1764] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:26 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:26.464240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b9c12940-87e8-4bbe-a55c-06563fcc21d3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:26.465190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b9c12940-87e8-4bbe-a55c-06563fcc21d3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:26.471472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9c12940-87e8-4bbe-a55c-06563fcc21d3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:26.471921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9c12940-87e8-4bbe-a55c-06563fcc21d3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:26.472684 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9c12940-87e8-4bbe-a55c-06563fcc21d3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:26.473115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9c12940-87e8-4bbe-a55c-06563fcc21d3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:26.557604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b9c12940-87e8-4bbe-a55c-06563fcc21d3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 14 microversion: 2.1 time: 0.096697 Nov 02 23:18:26.558155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1190/1765] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:26 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 23:18:27.339174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bf4affc8-1306-41bc-9dac-9af712a1c36a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:27.340519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bf4affc8-1306-41bc-9dac-9af712a1c36a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:27.353125 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf4affc8-1306-41bc-9dac-9af712a1c36a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:27.354023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf4affc8-1306-41bc-9dac-9af712a1c36a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:27.355492 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf4affc8-1306-41bc-9dac-9af712a1c36a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:27.356306 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf4affc8-1306-41bc-9dac-9af712a1c36a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:27.516868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bf4affc8-1306-41bc-9dac-9af712a1c36a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:27.532837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bf4affc8-1306-41bc-9dac-9af712a1c36a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:27.536044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bf4affc8-1306-41bc-9dac-9af712a1c36a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:27.538353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bf4affc8-1306-41bc-9dac-9af712a1c36a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.207047 Nov 02 23:18:27.539446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1191/1766] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:27 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:18:27.568587 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e332a75e-bc44-4d0f-b9fe-6d5fee5e5159 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:27.569491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e332a75e-bc44-4d0f-b9fe-6d5fee5e5159 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:27.575560 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e332a75e-bc44-4d0f-b9fe-6d5fee5e5159 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:27.575999 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e332a75e-bc44-4d0f-b9fe-6d5fee5e5159 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:27.576760 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e332a75e-bc44-4d0f-b9fe-6d5fee5e5159 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:27.577182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e332a75e-bc44-4d0f-b9fe-6d5fee5e5159 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:27.663902 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e332a75e-bc44-4d0f-b9fe-6d5fee5e5159 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 14 microversion: 2.1 time: 0.099355 Nov 02 23:18:27.664692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1192/1767] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:27 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 23:18:28.558774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3f17332c-8a65-431c-9b38-4600622ba827 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:28.559505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3f17332c-8a65-431c-9b38-4600622ba827 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:28.566808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f17332c-8a65-431c-9b38-4600622ba827 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:28.567791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f17332c-8a65-431c-9b38-4600622ba827 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:28.568577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f17332c-8a65-431c-9b38-4600622ba827 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:28.569003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f17332c-8a65-431c-9b38-4600622ba827 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:28.703765 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3f17332c-8a65-431c-9b38-4600622ba827 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:28.715959 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3f17332c-8a65-431c-9b38-4600622ba827 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:28.717603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3f17332c-8a65-431c-9b38-4600622ba827 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:28.719118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3f17332c-8a65-431c-9b38-4600622ba827 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.164399 Nov 02 23:18:28.719941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1193/1768] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:28 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:28.725715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1186ee5f-6086-4040-914b-78658ba5f769 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:28.726875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1186ee5f-6086-4040-914b-78658ba5f769 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:28.733519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1186ee5f-6086-4040-914b-78658ba5f769 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:28.734046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1186ee5f-6086-4040-914b-78658ba5f769 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:28.734994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1186ee5f-6086-4040-914b-78658ba5f769 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:28.735501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1186ee5f-6086-4040-914b-78658ba5f769 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:28.824693 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1186ee5f-6086-4040-914b-78658ba5f769 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 14 microversion: 2.1 time: 0.103183 Nov 02 23:18:28.826150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1194/1769] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:28 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 23:18:29.754026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2afdcc13-f3df-4ea7-85a8-dada8e767026 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:29.755440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2afdcc13-f3df-4ea7-85a8-dada8e767026 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:29.764206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2afdcc13-f3df-4ea7-85a8-dada8e767026 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:29.765055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2afdcc13-f3df-4ea7-85a8-dada8e767026 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:29.766339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2afdcc13-f3df-4ea7-85a8-dada8e767026 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:29.767070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2afdcc13-f3df-4ea7-85a8-dada8e767026 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:29.941184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2afdcc13-f3df-4ea7-85a8-dada8e767026 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:29.953644 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2afdcc13-f3df-4ea7-85a8-dada8e767026 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:29.955377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2afdcc13-f3df-4ea7-85a8-dada8e767026 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:29.956644 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2afdcc13-f3df-4ea7-85a8-dada8e767026 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.208653 Nov 02 23:18:29.957208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1195/1770] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:29 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:29.972655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4d410149-d519-4b00-a9c7-aa1cb1514f5e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:29.974083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4d410149-d519-4b00-a9c7-aa1cb1514f5e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:29.980029 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d410149-d519-4b00-a9c7-aa1cb1514f5e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:29.980476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d410149-d519-4b00-a9c7-aa1cb1514f5e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:29.981266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d410149-d519-4b00-a9c7-aa1cb1514f5e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:29.981701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d410149-d519-4b00-a9c7-aa1cb1514f5e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:30.076475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4d410149-d519-4b00-a9c7-aa1cb1514f5e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 14 microversion: 2.1 time: 0.106726 Nov 02 23:18:30.077331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1196/1771] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:29 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 23:18:30.975730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ce7edda1-4d9b-4428-9f22-d5c65dfae710 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:30.976453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ce7edda1-4d9b-4428-9f22-d5c65dfae710 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:30.983824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce7edda1-4d9b-4428-9f22-d5c65dfae710 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:30.984268 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce7edda1-4d9b-4428-9f22-d5c65dfae710 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:30.985069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce7edda1-4d9b-4428-9f22-d5c65dfae710 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:30.985501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce7edda1-4d9b-4428-9f22-d5c65dfae710 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:31.146958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ce7edda1-4d9b-4428-9f22-d5c65dfae710 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:31.155962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ce7edda1-4d9b-4428-9f22-d5c65dfae710 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:31.157505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ce7edda1-4d9b-4428-9f22-d5c65dfae710 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:31.158704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ce7edda1-4d9b-4428-9f22-d5c65dfae710 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.187305 Nov 02 23:18:31.159318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1197/1772] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:30 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:31.166581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-22a3a3d1-daa3-426d-85ac-f566ca3d07fc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:31.166581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-22a3a3d1-daa3-426d-85ac-f566ca3d07fc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:31.171443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22a3a3d1-daa3-426d-85ac-f566ca3d07fc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:31.171886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22a3a3d1-daa3-426d-85ac-f566ca3d07fc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:31.172662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22a3a3d1-daa3-426d-85ac-f566ca3d07fc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:31.173095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22a3a3d1-daa3-426d-85ac-f566ca3d07fc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:31.268739 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-22a3a3d1-daa3-426d-85ac-f566ca3d07fc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 4056 microversion: 2.1 time: 0.108128 Nov 02 23:18:31.269485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1198/1773] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:31 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 4056 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:18:32.178131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4d38365c-7e72-438d-9d71-163ce5b3d82d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:32.178856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4d38365c-7e72-438d-9d71-163ce5b3d82d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:32.185589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d38365c-7e72-438d-9d71-163ce5b3d82d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:32.186033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d38365c-7e72-438d-9d71-163ce5b3d82d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:32.186802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d38365c-7e72-438d-9d71-163ce5b3d82d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:32.187270 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d38365c-7e72-438d-9d71-163ce5b3d82d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:32.322989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4d38365c-7e72-438d-9d71-163ce5b3d82d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:32.331492 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4d38365c-7e72-438d-9d71-163ce5b3d82d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:32.333031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4d38365c-7e72-438d-9d71-163ce5b3d82d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:32.334183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4d38365c-7e72-438d-9d71-163ce5b3d82d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.160773 Nov 02 23:18:32.334748 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1199/1774] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:32 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:32.339301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ed4f555b-d50c-4202-9e9a-5efe90342039 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:32.340226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ed4f555b-d50c-4202-9e9a-5efe90342039 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:32.348033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ed4f555b-d50c-4202-9e9a-5efe90342039 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:32.348970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ed4f555b-d50c-4202-9e9a-5efe90342039 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:32.349782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ed4f555b-d50c-4202-9e9a-5efe90342039 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:32.350241 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ed4f555b-d50c-4202-9e9a-5efe90342039 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:32.445218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ed4f555b-d50c-4202-9e9a-5efe90342039 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 15025 microversion: 2.1 time: 0.109173 Nov 02 23:18:32.445888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1200/1775] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:32 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 15025 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:33.352610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-75f7a44a-9ff1-46c6-baa1-8f0c8f237878 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:33.353303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-75f7a44a-9ff1-46c6-baa1-8f0c8f237878 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:33.360328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-75f7a44a-9ff1-46c6-baa1-8f0c8f237878 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:33.360770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-75f7a44a-9ff1-46c6-baa1-8f0c8f237878 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:33.361549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-75f7a44a-9ff1-46c6-baa1-8f0c8f237878 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:33.361984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-75f7a44a-9ff1-46c6-baa1-8f0c8f237878 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:33.508045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-75f7a44a-9ff1-46c6-baa1-8f0c8f237878 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:33.516906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-75f7a44a-9ff1-46c6-baa1-8f0c8f237878 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:33.518391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-75f7a44a-9ff1-46c6-baa1-8f0c8f237878 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:33.519614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-75f7a44a-9ff1-46c6-baa1-8f0c8f237878 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.171066 Nov 02 23:18:33.520196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1201/1776] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:33 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:33.524719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1ff04902-e79e-4dc6-a2c3-caec89ca787a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:33.525639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1ff04902-e79e-4dc6-a2c3-caec89ca787a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:33.531919 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ff04902-e79e-4dc6-a2c3-caec89ca787a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:33.532362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ff04902-e79e-4dc6-a2c3-caec89ca787a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:33.533137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ff04902-e79e-4dc6-a2c3-caec89ca787a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:33.533569 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ff04902-e79e-4dc6-a2c3-caec89ca787a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:33.639233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1ff04902-e79e-4dc6-a2c3-caec89ca787a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 18561 microversion: 2.1 time: 0.117713 Nov 02 23:18:33.640149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1202/1777] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:33 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 18561 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:34.538445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-54675b99-8f3d-4270-ab8b-73d279d336a2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:34.539177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-54675b99-8f3d-4270-ab8b-73d279d336a2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:34.545934 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-54675b99-8f3d-4270-ab8b-73d279d336a2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:34.546393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-54675b99-8f3d-4270-ab8b-73d279d336a2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:34.547168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-54675b99-8f3d-4270-ab8b-73d279d336a2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:34.547598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-54675b99-8f3d-4270-ab8b-73d279d336a2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:34.680845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-54675b99-8f3d-4270-ab8b-73d279d336a2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:34.689083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-54675b99-8f3d-4270-ab8b-73d279d336a2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:34.690563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-54675b99-8f3d-4270-ab8b-73d279d336a2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:34.691803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-54675b99-8f3d-4270-ab8b-73d279d336a2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.157985 Nov 02 23:18:34.692874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1203/1778] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:34 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:34.697211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b9c99f49-778c-4b9e-84df-e10ddbba48f5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:34.698104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b9c99f49-778c-4b9e-84df-e10ddbba48f5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:34.704240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9c99f49-778c-4b9e-84df-e10ddbba48f5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:34.704686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9c99f49-778c-4b9e-84df-e10ddbba48f5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:34.705447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9c99f49-778c-4b9e-84df-e10ddbba48f5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:34.705876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9c99f49-778c-4b9e-84df-e10ddbba48f5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:34.801987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b9c99f49-778c-4b9e-84df-e10ddbba48f5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 20074 microversion: 2.1 time: 0.107375 Nov 02 23:18:34.802635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1204/1779] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:34 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 20074 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:35.711200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e6101930-fc38-417c-b5ed-8e453e7df5f5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:35.711875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e6101930-fc38-417c-b5ed-8e453e7df5f5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:35.718841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e6101930-fc38-417c-b5ed-8e453e7df5f5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:35.719317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e6101930-fc38-417c-b5ed-8e453e7df5f5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:35.720104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e6101930-fc38-417c-b5ed-8e453e7df5f5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:35.720517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e6101930-fc38-417c-b5ed-8e453e7df5f5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:35.857693 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e6101930-fc38-417c-b5ed-8e453e7df5f5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:35.866511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e6101930-fc38-417c-b5ed-8e453e7df5f5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:35.868042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e6101930-fc38-417c-b5ed-8e453e7df5f5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:35.869206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e6101930-fc38-417c-b5ed-8e453e7df5f5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.162181 Nov 02 23:18:35.869788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1205/1780] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:35 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:35.874099 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-87c7724e-bb12-4bb2-946b-20dab6759f31 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:35.875117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-87c7724e-bb12-4bb2-946b-20dab6759f31 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:35.882242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87c7724e-bb12-4bb2-946b-20dab6759f31 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:35.882716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87c7724e-bb12-4bb2-946b-20dab6759f31 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:35.883541 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87c7724e-bb12-4bb2-946b-20dab6759f31 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:35.883970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87c7724e-bb12-4bb2-946b-20dab6759f31 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:35.979989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-87c7724e-bb12-4bb2-946b-20dab6759f31 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 22772 microversion: 2.1 time: 0.108956 Nov 02 23:18:35.980923 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1206/1781] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:35 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 22772 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:36.888046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-11714aab-d9ba-454b-9c21-3ad1e355d182 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:36.888689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-11714aab-d9ba-454b-9c21-3ad1e355d182 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:36.895498 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-11714aab-d9ba-454b-9c21-3ad1e355d182 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:36.895943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-11714aab-d9ba-454b-9c21-3ad1e355d182 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:36.896723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-11714aab-d9ba-454b-9c21-3ad1e355d182 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:36.897136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-11714aab-d9ba-454b-9c21-3ad1e355d182 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:37.027053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-11714aab-d9ba-454b-9c21-3ad1e355d182 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:37.036602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-11714aab-d9ba-454b-9c21-3ad1e355d182 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:37.038089 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-11714aab-d9ba-454b-9c21-3ad1e355d182 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:37.039288 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-11714aab-d9ba-454b-9c21-3ad1e355d182 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.155326 Nov 02 23:18:37.039848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1207/1782] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:36 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:18:37.044135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aa5505ad-122b-4d3c-973e-304caab4df4f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:37.045048 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aa5505ad-122b-4d3c-973e-304caab4df4f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:37.050767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa5505ad-122b-4d3c-973e-304caab4df4f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:37.051248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa5505ad-122b-4d3c-973e-304caab4df4f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:37.052068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa5505ad-122b-4d3c-973e-304caab4df4f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:37.052512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa5505ad-122b-4d3c-973e-304caab4df4f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:37.146813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aa5505ad-122b-4d3c-973e-304caab4df4f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 23804 microversion: 2.1 time: 0.105706 Nov 02 23:18:37.147591 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1208/1783] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:37 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 23804 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:38.058058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-46f93a26-4798-4711-a936-30b2e03bb372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:38.058755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-46f93a26-4798-4711-a936-30b2e03bb372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:38.065621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-46f93a26-4798-4711-a936-30b2e03bb372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:38.066062 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-46f93a26-4798-4711-a936-30b2e03bb372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:38.066825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-46f93a26-4798-4711-a936-30b2e03bb372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:38.067923 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-46f93a26-4798-4711-a936-30b2e03bb372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:38.203545 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-46f93a26-4798-4711-a936-30b2e03bb372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:38.213354 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-46f93a26-4798-4711-a936-30b2e03bb372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:38.214983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-46f93a26-4798-4711-a936-30b2e03bb372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:38.216141 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-46f93a26-4798-4711-a936-30b2e03bb372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.162154 Nov 02 23:18:38.216695 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1209/1784] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:38 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:38.227594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3b504ada-7d9c-40de-8e27-2ead67304a93 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:38.227594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3b504ada-7d9c-40de-8e27-2ead67304a93 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:38.228911 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b504ada-7d9c-40de-8e27-2ead67304a93 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:38.229361 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b504ada-7d9c-40de-8e27-2ead67304a93 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:38.230127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b504ada-7d9c-40de-8e27-2ead67304a93 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:38.230553 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b504ada-7d9c-40de-8e27-2ead67304a93 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:38.327509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3b504ada-7d9c-40de-8e27-2ead67304a93 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 25700 microversion: 2.1 time: 0.108950 Nov 02 23:18:38.328442 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1210/1785] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:38 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 25700 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:39.235523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-15e96561-7711-42a3-ad30-4a483af63688 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:39.236218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-15e96561-7711-42a3-ad30-4a483af63688 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:39.243723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15e96561-7711-42a3-ad30-4a483af63688 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:39.244168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15e96561-7711-42a3-ad30-4a483af63688 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:39.244934 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15e96561-7711-42a3-ad30-4a483af63688 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:39.245363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15e96561-7711-42a3-ad30-4a483af63688 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:39.378391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-15e96561-7711-42a3-ad30-4a483af63688 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:39.387721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-15e96561-7711-42a3-ad30-4a483af63688 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:39.389284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-15e96561-7711-42a3-ad30-4a483af63688 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:39.390430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-15e96561-7711-42a3-ad30-4a483af63688 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.158996 Nov 02 23:18:39.391027 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1211/1786] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:39 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:39.395291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8246e7d6-a3e2-4ee0-8efc-27b216db6649 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:39.396189 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8246e7d6-a3e2-4ee0-8efc-27b216db6649 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:39.401783 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8246e7d6-a3e2-4ee0-8efc-27b216db6649 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:39.402231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8246e7d6-a3e2-4ee0-8efc-27b216db6649 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:39.403050 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8246e7d6-a3e2-4ee0-8efc-27b216db6649 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:39.403479 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8246e7d6-a3e2-4ee0-8efc-27b216db6649 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:39.499628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8246e7d6-a3e2-4ee0-8efc-27b216db6649 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 27043 microversion: 2.1 time: 0.107310 Nov 02 23:18:39.500309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1212/1787] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:39 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 27043 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:40.408817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-df168010-e423-4c34-ad54-ff03bbb2fb60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:40.409512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-df168010-e423-4c34-ad54-ff03bbb2fb60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:40.416403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-df168010-e423-4c34-ad54-ff03bbb2fb60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:40.416848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-df168010-e423-4c34-ad54-ff03bbb2fb60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:40.417616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-df168010-e423-4c34-ad54-ff03bbb2fb60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:40.418046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-df168010-e423-4c34-ad54-ff03bbb2fb60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:40.550898 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-df168010-e423-4c34-ad54-ff03bbb2fb60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:40.559661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-df168010-e423-4c34-ad54-ff03bbb2fb60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:40.561153 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-df168010-e423-4c34-ad54-ff03bbb2fb60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:18:40.562311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-df168010-e423-4c34-ad54-ff03bbb2fb60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 200 len: 1752 microversion: 2.20 time: 0.157599 Nov 02 23:18:40.562878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1213/1788] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:18:40 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:18:40.567717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f3b11a82-59e9-4298-a6e0-1a5a712568b1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:40.568613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f3b11a82-59e9-4298-a6e0-1a5a712568b1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:40.574256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3b11a82-59e9-4298-a6e0-1a5a712568b1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:40.574991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3b11a82-59e9-4298-a6e0-1a5a712568b1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:40.575782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3b11a82-59e9-4298-a6e0-1a5a712568b1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:40.576212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3b11a82-59e9-4298-a6e0-1a5a712568b1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:40.671932 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f3b11a82-59e9-4298-a6e0-1a5a712568b1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 27697 microversion: 2.1 time: 0.107783 Nov 02 23:18:40.672581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1214/1789] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:40 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 27697 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:40.677877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aff71c87-07c2-4440-9620-583f095e69c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:40.678436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aff71c87-07c2-4440-9620-583f095e69c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:40.685844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aff71c87-07c2-4440-9620-583f095e69c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:40.686435 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aff71c87-07c2-4440-9620-583f095e69c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:40.687233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aff71c87-07c2-4440-9620-583f095e69c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:40.687661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aff71c87-07c2-4440-9620-583f095e69c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:40.768567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-aff71c87-07c2-4440-9620-583f095e69c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] HTTP exception thrown: Cannot 'detach_volume' instance 15750fff-dec6-4bcc-a69c-0f9576f7970e while it is in task_state spawning Nov 02 23:18:40.769171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aff71c87-07c2-4440-9620-583f095e69c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Returning 409 to user: Cannot 'detach_volume' instance 15750fff-dec6-4bcc-a69c-0f9576f7970e while it is in task_state spawning {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:18:40.769998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aff71c87-07c2-4440-9620-583f095e69c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "DELETE /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments/a23a294f-90e9-4bd8-a347-0e9d124bb5a0" status: 409 len: 155 microversion: 2.20 time: 0.096219 Nov 02 23:18:40.770557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1215/1790] 10.222.0.41 () {60 vars in 1456 bytes} [Tue Nov 2 23:18:40 2021] DELETE /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments/a23a294f-90e9-4bd8-a347-0e9d124bb5a0 => generated 155 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 380 bytes (1 switches on core 0) Nov 02 23:18:40.779540 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3aacab2f-7a63-48d3-8eb6-d09d24695418 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:40.780489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3aacab2f-7a63-48d3-8eb6-d09d24695418 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:40.787110 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3aacab2f-7a63-48d3-8eb6-d09d24695418 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:40.787565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3aacab2f-7a63-48d3-8eb6-d09d24695418 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:40.788340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3aacab2f-7a63-48d3-8eb6-d09d24695418 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:40.788767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3aacab2f-7a63-48d3-8eb6-d09d24695418 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:40.818368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3aacab2f-7a63-48d3-8eb6-d09d24695418 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042306 Nov 02 23:18:40.818945 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1216/1791] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:18:40 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:18:41.683677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fcf61d2a-282d-4ed6-a173-56908b4a527d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:41.684624 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fcf61d2a-282d-4ed6-a173-56908b4a527d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:41.690960 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fcf61d2a-282d-4ed6-a173-56908b4a527d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:41.691409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fcf61d2a-282d-4ed6-a173-56908b4a527d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:41.692184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fcf61d2a-282d-4ed6-a173-56908b4a527d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:41.692612 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fcf61d2a-282d-4ed6-a173-56908b4a527d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:41.803711 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fcf61d2a-282d-4ed6-a173-56908b4a527d tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28108 microversion: 2.1 time: 0.123360 Nov 02 23:18:41.804286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1217/1792] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:41 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28108 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:41.831443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dabd6fe3-4355-4e0c-810d-7f696014d2e8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:41.832918 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dabd6fe3-4355-4e0c-810d-7f696014d2e8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:41.839834 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dabd6fe3-4355-4e0c-810d-7f696014d2e8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:41.840279 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dabd6fe3-4355-4e0c-810d-7f696014d2e8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:41.841044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dabd6fe3-4355-4e0c-810d-7f696014d2e8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:41.841501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dabd6fe3-4355-4e0c-810d-7f696014d2e8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:41.872008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dabd6fe3-4355-4e0c-810d-7f696014d2e8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045960 Nov 02 23:18:41.872559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1218/1793] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:18:41 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:18:42.815011 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b8c7f7b3-ac9b-4f1c-8789-591781d06f5a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:42.815920 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b8c7f7b3-ac9b-4f1c-8789-591781d06f5a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:42.822273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b8c7f7b3-ac9b-4f1c-8789-591781d06f5a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:42.822716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b8c7f7b3-ac9b-4f1c-8789-591781d06f5a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:42.823530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b8c7f7b3-ac9b-4f1c-8789-591781d06f5a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:42.824060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b8c7f7b3-ac9b-4f1c-8789-591781d06f5a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:42.929232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b8c7f7b3-ac9b-4f1c-8789-591781d06f5a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28225 microversion: 2.1 time: 0.117702 Nov 02 23:18:42.929877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1219/1794] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:42 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:18:42.934819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d3f8786b-9e26-4e02-9cfa-000f5673f44f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:42.935839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d3f8786b-9e26-4e02-9cfa-000f5673f44f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:42.942590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3f8786b-9e26-4e02-9cfa-000f5673f44f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:42.943064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3f8786b-9e26-4e02-9cfa-000f5673f44f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:42.943832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3f8786b-9e26-4e02-9cfa-000f5673f44f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:42.944261 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3f8786b-9e26-4e02-9cfa-000f5673f44f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:42.977545 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d3f8786b-9e26-4e02-9cfa-000f5673f44f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046460 Nov 02 23:18:42.978111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1220/1795] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:18:42 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:43.939543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4ea101e9-584b-4dc9-af27-2988d37187bb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:43.940463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4ea101e9-584b-4dc9-af27-2988d37187bb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:43.947427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ea101e9-584b-4dc9-af27-2988d37187bb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:43.947739 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ea101e9-584b-4dc9-af27-2988d37187bb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:43.948569 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ea101e9-584b-4dc9-af27-2988d37187bb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:43.948935 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ea101e9-584b-4dc9-af27-2988d37187bb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:44.044882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4ea101e9-584b-4dc9-af27-2988d37187bb tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28225 microversion: 2.1 time: 0.108811 Nov 02 23:18:44.049205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1221/1796] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:43 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:18:44.050523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-eef2640e-12ee-41f5-b7e6-d487cd8f3f5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:44.051557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-eef2640e-12ee-41f5-b7e6-d487cd8f3f5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:44.058530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eef2640e-12ee-41f5-b7e6-d487cd8f3f5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:44.058994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eef2640e-12ee-41f5-b7e6-d487cd8f3f5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:44.059761 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eef2640e-12ee-41f5-b7e6-d487cd8f3f5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:44.060206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eef2640e-12ee-41f5-b7e6-d487cd8f3f5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:44.090318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-eef2640e-12ee-41f5-b7e6-d487cd8f3f5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043582 Nov 02 23:18:44.090882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1222/1797] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:18:44 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:45.056908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-59a7a205-fefc-46f8-a345-8e32003feafc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:45.057828 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-59a7a205-fefc-46f8-a345-8e32003feafc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:45.064282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59a7a205-fefc-46f8-a345-8e32003feafc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:45.064732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59a7a205-fefc-46f8-a345-8e32003feafc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:45.065508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59a7a205-fefc-46f8-a345-8e32003feafc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:45.065937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59a7a205-fefc-46f8-a345-8e32003feafc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:45.159623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-59a7a205-fefc-46f8-a345-8e32003feafc tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28225 microversion: 2.1 time: 0.106150 Nov 02 23:18:45.160289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1223/1798] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:45 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:18:45.165253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9fe3e4e6-79d3-40c7-83d6-c6ccdb131d2c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:45.166227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9fe3e4e6-79d3-40c7-83d6-c6ccdb131d2c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:45.173018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9fe3e4e6-79d3-40c7-83d6-c6ccdb131d2c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:45.173462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9fe3e4e6-79d3-40c7-83d6-c6ccdb131d2c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:45.174223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9fe3e4e6-79d3-40c7-83d6-c6ccdb131d2c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:45.174657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9fe3e4e6-79d3-40c7-83d6-c6ccdb131d2c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:45.204813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9fe3e4e6-79d3-40c7-83d6-c6ccdb131d2c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043303 Nov 02 23:18:45.205366 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1224/1799] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:18:45 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:46.171086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6cea8673-92b0-428f-8745-fa621c5682c4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:46.171993 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6cea8673-92b0-428f-8745-fa621c5682c4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:46.178421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6cea8673-92b0-428f-8745-fa621c5682c4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:46.178863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6cea8673-92b0-428f-8745-fa621c5682c4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:46.179774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6cea8673-92b0-428f-8745-fa621c5682c4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:46.180106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6cea8673-92b0-428f-8745-fa621c5682c4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:46.277454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6cea8673-92b0-428f-8745-fa621c5682c4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28225 microversion: 2.1 time: 0.109828 Nov 02 23:18:46.278109 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1225/1800] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:46 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:18:46.283720 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dd4f0196-18d2-4075-bb5d-b691fe608c97 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:46.284709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dd4f0196-18d2-4075-bb5d-b691fe608c97 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:46.292380 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd4f0196-18d2-4075-bb5d-b691fe608c97 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:46.292766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd4f0196-18d2-4075-bb5d-b691fe608c97 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:46.293550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd4f0196-18d2-4075-bb5d-b691fe608c97 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:46.293981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd4f0196-18d2-4075-bb5d-b691fe608c97 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:46.326943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dd4f0196-18d2-4075-bb5d-b691fe608c97 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047590 Nov 02 23:18:46.327535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1226/1801] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:18:46 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:47.289072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-524f63cc-9287-4464-9c0a-ee01b28aed89 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:47.289978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-524f63cc-9287-4464-9c0a-ee01b28aed89 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:47.296357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-524f63cc-9287-4464-9c0a-ee01b28aed89 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:47.296795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-524f63cc-9287-4464-9c0a-ee01b28aed89 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:47.297584 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-524f63cc-9287-4464-9c0a-ee01b28aed89 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:47.298006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-524f63cc-9287-4464-9c0a-ee01b28aed89 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:47.404034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-524f63cc-9287-4464-9c0a-ee01b28aed89 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28225 microversion: 2.1 time: 0.118582 Nov 02 23:18:47.404600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1227/1802] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:47 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28225 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:18:47.409515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4e8ddcb9-572d-4613-8e87-7d496d55f325 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:47.410499 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4e8ddcb9-572d-4613-8e87-7d496d55f325 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:47.417343 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e8ddcb9-572d-4613-8e87-7d496d55f325 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:47.417783 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e8ddcb9-572d-4613-8e87-7d496d55f325 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:47.418547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e8ddcb9-572d-4613-8e87-7d496d55f325 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:47.418993 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e8ddcb9-572d-4613-8e87-7d496d55f325 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:47.452282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4e8ddcb9-572d-4613-8e87-7d496d55f325 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046448 Nov 02 23:18:47.452895 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1228/1803] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:18:47 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:48.416859 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-10751db7-6400-49e2-952c-e10df03bd95f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:48.417704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-10751db7-6400-49e2-952c-e10df03bd95f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:48.424217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10751db7-6400-49e2-952c-e10df03bd95f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:48.424662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10751db7-6400-49e2-952c-e10df03bd95f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:48.425443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10751db7-6400-49e2-952c-e10df03bd95f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:48.425875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10751db7-6400-49e2-952c-e10df03bd95f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:48.526169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-10751db7-6400-49e2-952c-e10df03bd95f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28225 microversion: 2.1 time: 0.113017 Nov 02 23:18:48.530025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1229/1804] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:48 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:18:48.531966 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f98f69ca-5fcd-4712-bdf1-182fa9c69b69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:48.532937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f98f69ca-5fcd-4712-bdf1-182fa9c69b69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:48.540904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f98f69ca-5fcd-4712-bdf1-182fa9c69b69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:48.541352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f98f69ca-5fcd-4712-bdf1-182fa9c69b69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:48.542166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f98f69ca-5fcd-4712-bdf1-182fa9c69b69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:48.542634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f98f69ca-5fcd-4712-bdf1-182fa9c69b69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:48.573077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f98f69ca-5fcd-4712-bdf1-182fa9c69b69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044820 Nov 02 23:18:48.573642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1230/1805] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:18:48 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:49.538180 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-832e03a1-731a-4a5d-9707-bbc150087412 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:49.539175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-832e03a1-731a-4a5d-9707-bbc150087412 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:49.545540 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-832e03a1-731a-4a5d-9707-bbc150087412 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:49.545989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-832e03a1-731a-4a5d-9707-bbc150087412 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:49.546756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-832e03a1-731a-4a5d-9707-bbc150087412 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:49.547218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-832e03a1-731a-4a5d-9707-bbc150087412 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:49.633089 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-832e03a1-731a-4a5d-9707-bbc150087412 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28225 microversion: 2.1 time: 0.098897 Nov 02 23:18:49.633766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1231/1806] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:49 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:18:49.638752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e3ec400a-1141-4ba0-83f2-f3718e6353b7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:49.639762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e3ec400a-1141-4ba0-83f2-f3718e6353b7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:49.646562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3ec400a-1141-4ba0-83f2-f3718e6353b7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:49.647039 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3ec400a-1141-4ba0-83f2-f3718e6353b7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:49.647809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3ec400a-1141-4ba0-83f2-f3718e6353b7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:49.648239 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3ec400a-1141-4ba0-83f2-f3718e6353b7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:49.679264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e3ec400a-1141-4ba0-83f2-f3718e6353b7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044260 Nov 02 23:18:49.679842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1232/1807] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:18:49 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:50.644858 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-18111347-33c2-4382-8d23-a6a5db6b46f9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:50.645759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-18111347-33c2-4382-8d23-a6a5db6b46f9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:50.652281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-18111347-33c2-4382-8d23-a6a5db6b46f9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:50.652768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-18111347-33c2-4382-8d23-a6a5db6b46f9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:50.653553 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-18111347-33c2-4382-8d23-a6a5db6b46f9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:50.653988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-18111347-33c2-4382-8d23-a6a5db6b46f9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:50.740955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-18111347-33c2-4382-8d23-a6a5db6b46f9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28225 microversion: 2.1 time: 0.099566 Nov 02 23:18:50.741612 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1233/1808] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:50 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:18:50.746639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-98e58ec4-48ce-4c69-9101-164299cfe86b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:50.747667 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-98e58ec4-48ce-4c69-9101-164299cfe86b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:50.755400 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98e58ec4-48ce-4c69-9101-164299cfe86b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:50.755850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98e58ec4-48ce-4c69-9101-164299cfe86b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:50.756633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98e58ec4-48ce-4c69-9101-164299cfe86b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:50.757065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98e58ec4-48ce-4c69-9101-164299cfe86b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:50.788006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-98e58ec4-48ce-4c69-9101-164299cfe86b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045155 Nov 02 23:18:50.788575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1234/1809] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:18:50 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:51.752676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5478f21e-fe0e-4dca-9d2f-1792d59926c1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:51.753570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5478f21e-fe0e-4dca-9d2f-1792d59926c1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:51.760259 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5478f21e-fe0e-4dca-9d2f-1792d59926c1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:51.760706 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5478f21e-fe0e-4dca-9d2f-1792d59926c1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:51.761463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5478f21e-fe0e-4dca-9d2f-1792d59926c1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:51.761891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5478f21e-fe0e-4dca-9d2f-1792d59926c1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:51.848313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5478f21e-fe0e-4dca-9d2f-1792d59926c1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28225 microversion: 2.1 time: 0.098653 Nov 02 23:18:51.852214 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1235/1810] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:51 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:18:51.854195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-40ad4ff1-c1c5-473e-8f6e-e4a05e531d6b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:51.855210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-40ad4ff1-c1c5-473e-8f6e-e4a05e531d6b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:51.862483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-40ad4ff1-c1c5-473e-8f6e-e4a05e531d6b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:51.863117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-40ad4ff1-c1c5-473e-8f6e-e4a05e531d6b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:51.864530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-40ad4ff1-c1c5-473e-8f6e-e4a05e531d6b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:51.864891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-40ad4ff1-c1c5-473e-8f6e-e4a05e531d6b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:51.897470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-40ad4ff1-c1c5-473e-8f6e-e4a05e531d6b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047173 Nov 02 23:18:51.898027 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1236/1811] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:18:51 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:52.859651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e3c7a45a-1bee-4503-b408-4b66699ca280 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:52.860562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e3c7a45a-1bee-4503-b408-4b66699ca280 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:52.866848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3c7a45a-1bee-4503-b408-4b66699ca280 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:52.867329 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3c7a45a-1bee-4503-b408-4b66699ca280 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:52.868096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3c7a45a-1bee-4503-b408-4b66699ca280 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:52.868537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3c7a45a-1bee-4503-b408-4b66699ca280 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:53.112940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e3c7a45a-1bee-4503-b408-4b66699ca280 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28225 microversion: 2.1 time: 0.256812 Nov 02 23:18:53.117056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1237/1812] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:52 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28225 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:18:53.120728 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1fdd3b6e-2568-4d46-8c0f-45097637581e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:53.121726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1fdd3b6e-2568-4d46-8c0f-45097637581e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:53.128313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fdd3b6e-2568-4d46-8c0f-45097637581e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:53.128754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fdd3b6e-2568-4d46-8c0f-45097637581e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:53.130009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fdd3b6e-2568-4d46-8c0f-45097637581e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:53.130439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fdd3b6e-2568-4d46-8c0f-45097637581e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:53.160565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1fdd3b6e-2568-4d46-8c0f-45097637581e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045680 Nov 02 23:18:53.161117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1238/1813] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:18:53 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:54.124640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c75e6c6f-3b5f-4503-a647-04dd525f2c36 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:54.125554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c75e6c6f-3b5f-4503-a647-04dd525f2c36 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:54.131846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c75e6c6f-3b5f-4503-a647-04dd525f2c36 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:54.132307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c75e6c6f-3b5f-4503-a647-04dd525f2c36 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:54.133067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c75e6c6f-3b5f-4503-a647-04dd525f2c36 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:54.133499 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c75e6c6f-3b5f-4503-a647-04dd525f2c36 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:54.223935 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c75e6c6f-3b5f-4503-a647-04dd525f2c36 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28225 microversion: 2.1 time: 0.102265 Nov 02 23:18:54.224583 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1239/1814] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:54 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:18:54.229611 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3344843f-1eab-49f1-929b-3b2dcb082762 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:54.230609 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3344843f-1eab-49f1-929b-3b2dcb082762 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:54.237605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3344843f-1eab-49f1-929b-3b2dcb082762 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:54.238046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3344843f-1eab-49f1-929b-3b2dcb082762 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:54.238871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3344843f-1eab-49f1-929b-3b2dcb082762 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:54.239339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3344843f-1eab-49f1-929b-3b2dcb082762 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:54.269425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3344843f-1eab-49f1-929b-3b2dcb082762 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043648 Nov 02 23:18:54.270513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1240/1815] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:18:54 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:55.239445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8bd11a00-ad29-4a68-9def-289d879947b4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:55.240410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8bd11a00-ad29-4a68-9def-289d879947b4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:55.246972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bd11a00-ad29-4a68-9def-289d879947b4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:55.247500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bd11a00-ad29-4a68-9def-289d879947b4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:55.249130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bd11a00-ad29-4a68-9def-289d879947b4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:55.249130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bd11a00-ad29-4a68-9def-289d879947b4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:55.337812 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8bd11a00-ad29-4a68-9def-289d879947b4 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28225 microversion: 2.1 time: 0.105581 Nov 02 23:18:55.338373 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1241/1816] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:55 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:18:55.343344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1ef42740-6af8-401f-8ed0-b6d0d3872223 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:55.344327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1ef42740-6af8-401f-8ed0-b6d0d3872223 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:55.352118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ef42740-6af8-401f-8ed0-b6d0d3872223 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:55.352571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ef42740-6af8-401f-8ed0-b6d0d3872223 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:55.353357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ef42740-6af8-401f-8ed0-b6d0d3872223 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:55.353787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ef42740-6af8-401f-8ed0-b6d0d3872223 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:55.385419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1ef42740-6af8-401f-8ed0-b6d0d3872223 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045759 Nov 02 23:18:55.385985 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1242/1817] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:18:55 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:56.348318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4dbaac1b-7d7a-413e-9616-888e9a1f50d0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:56.349212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4dbaac1b-7d7a-413e-9616-888e9a1f50d0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:56.355552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4dbaac1b-7d7a-413e-9616-888e9a1f50d0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:56.355993 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4dbaac1b-7d7a-413e-9616-888e9a1f50d0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:56.356759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4dbaac1b-7d7a-413e-9616-888e9a1f50d0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:56.357185 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4dbaac1b-7d7a-413e-9616-888e9a1f50d0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:56.452951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4dbaac1b-7d7a-413e-9616-888e9a1f50d0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28225 microversion: 2.1 time: 0.108073 Nov 02 23:18:56.456806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1243/1818] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:56 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:18:56.459490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-81dbf901-42e1-435e-96ec-8ffbcc7e88dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:56.460554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-81dbf901-42e1-435e-96ec-8ffbcc7e88dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:56.469028 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81dbf901-42e1-435e-96ec-8ffbcc7e88dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:56.469483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81dbf901-42e1-435e-96ec-8ffbcc7e88dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:56.470273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81dbf901-42e1-435e-96ec-8ffbcc7e88dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:56.470989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81dbf901-42e1-435e-96ec-8ffbcc7e88dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:56.505636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-81dbf901-42e1-435e-96ec-8ffbcc7e88dc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050841 Nov 02 23:18:56.506243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1244/1819] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:18:56 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:57.464568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-56dfed65-cd9b-4dcc-b48b-a07f5cdae011 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:57.465436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-56dfed65-cd9b-4dcc-b48b-a07f5cdae011 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:57.472164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56dfed65-cd9b-4dcc-b48b-a07f5cdae011 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:57.473181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56dfed65-cd9b-4dcc-b48b-a07f5cdae011 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:57.473974 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56dfed65-cd9b-4dcc-b48b-a07f5cdae011 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:57.474415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56dfed65-cd9b-4dcc-b48b-a07f5cdae011 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:57.584348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-56dfed65-cd9b-4dcc-b48b-a07f5cdae011 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28435 microversion: 2.1 time: 0.123609 Nov 02 23:18:57.584999 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1245/1820] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:57 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28435 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:18:57.589926 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d61a09dc-6c5e-4cd3-8f5f-4e6eabeba9f2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:57.590898 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d61a09dc-6c5e-4cd3-8f5f-4e6eabeba9f2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:57.607223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d61a09dc-6c5e-4cd3-8f5f-4e6eabeba9f2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:57.607685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d61a09dc-6c5e-4cd3-8f5f-4e6eabeba9f2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:57.608552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d61a09dc-6c5e-4cd3-8f5f-4e6eabeba9f2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:57.609037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d61a09dc-6c5e-4cd3-8f5f-4e6eabeba9f2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:57.642685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d61a09dc-6c5e-4cd3-8f5f-4e6eabeba9f2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056480 Nov 02 23:18:57.643290 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1246/1821] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:18:57 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:58.595522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-890bef2f-7ba7-411a-907f-84be31a9f507 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:58.596436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-890bef2f-7ba7-411a-907f-84be31a9f507 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:58.602704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-890bef2f-7ba7-411a-907f-84be31a9f507 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:58.603189 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-890bef2f-7ba7-411a-907f-84be31a9f507 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:58.603989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-890bef2f-7ba7-411a-907f-84be31a9f507 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:58.604418 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-890bef2f-7ba7-411a-907f-84be31a9f507 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:58.708725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-890bef2f-7ba7-411a-907f-84be31a9f507 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28516 microversion: 2.1 time: 0.116747 Nov 02 23:18:58.709369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1247/1822] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:58 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28516 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:18:58.714293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9a74ca87-a90b-449f-914b-580c478c7adf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:58.715289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9a74ca87-a90b-449f-914b-580c478c7adf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:58.722043 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a74ca87-a90b-449f-914b-580c478c7adf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:58.722534 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a74ca87-a90b-449f-914b-580c478c7adf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:58.723453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a74ca87-a90b-449f-914b-580c478c7adf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:58.723878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a74ca87-a90b-449f-914b-580c478c7adf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:58.755016 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9a74ca87-a90b-449f-914b-580c478c7adf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044416 Nov 02 23:18:58.755590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1248/1823] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:18:58 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:18:59.720200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fd270d44-bc66-438f-b7ee-348c5d0a400e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:18:59.721164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fd270d44-bc66-438f-b7ee-348c5d0a400e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:59.727854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd270d44-bc66-438f-b7ee-348c5d0a400e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:59.728309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd270d44-bc66-438f-b7ee-348c5d0a400e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:59.729101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd270d44-bc66-438f-b7ee-348c5d0a400e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:59.729538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd270d44-bc66-438f-b7ee-348c5d0a400e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:59.832680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fd270d44-bc66-438f-b7ee-348c5d0a400e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.116181 Nov 02 23:18:59.833341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1249/1824] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:18:59 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:18:59.838402 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d06115cb-0725-4df8-99ed-9cd6f832565e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:18:59.839429 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d06115cb-0725-4df8-99ed-9cd6f832565e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:18:59.846565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d06115cb-0725-4df8-99ed-9cd6f832565e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:59.847053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d06115cb-0725-4df8-99ed-9cd6f832565e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:59.848341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d06115cb-0725-4df8-99ed-9cd6f832565e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:18:59.848774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d06115cb-0725-4df8-99ed-9cd6f832565e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:18:59.882205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d06115cb-0725-4df8-99ed-9cd6f832565e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047626 Nov 02 23:18:59.882797 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1250/1825] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:18:59 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:00.844496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fd99b366-a740-4b94-9dc5-a4fa57c44f8c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:00.845404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fd99b366-a740-4b94-9dc5-a4fa57c44f8c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:00.851584 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd99b366-a740-4b94-9dc5-a4fa57c44f8c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:00.852029 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd99b366-a740-4b94-9dc5-a4fa57c44f8c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:00.852799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd99b366-a740-4b94-9dc5-a4fa57c44f8c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:00.853230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd99b366-a740-4b94-9dc5-a4fa57c44f8c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:00.944857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fd99b366-a740-4b94-9dc5-a4fa57c44f8c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.103873 Nov 02 23:19:00.945513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1251/1826] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:00 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:00.951076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f157e668-27fb-4fd9-9ad9-ee0a2736fe65 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:00.952095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f157e668-27fb-4fd9-9ad9-ee0a2736fe65 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:00.960131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f157e668-27fb-4fd9-9ad9-ee0a2736fe65 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:00.960581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f157e668-27fb-4fd9-9ad9-ee0a2736fe65 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:00.961376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f157e668-27fb-4fd9-9ad9-ee0a2736fe65 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:00.961809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f157e668-27fb-4fd9-9ad9-ee0a2736fe65 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:00.993832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f157e668-27fb-4fd9-9ad9-ee0a2736fe65 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047125 Nov 02 23:19:00.994393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1252/1827] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:00 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:01.956313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9d59825c-a791-4513-9b2a-21d6256298f3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:01.957219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9d59825c-a791-4513-9b2a-21d6256298f3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:01.963451 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d59825c-a791-4513-9b2a-21d6256298f3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:01.963893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d59825c-a791-4513-9b2a-21d6256298f3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:01.964656 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d59825c-a791-4513-9b2a-21d6256298f3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:01.965086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d59825c-a791-4513-9b2a-21d6256298f3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:02.093472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9d59825c-a791-4513-9b2a-21d6256298f3 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.140472 Nov 02 23:19:02.094303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1253/1828] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:01 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:02.099920 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-615239de-d5c1-49de-8b4f-f538c962b446 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:02.100912 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-615239de-d5c1-49de-8b4f-f538c962b446 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:02.111304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-615239de-d5c1-49de-8b4f-f538c962b446 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:02.111759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-615239de-d5c1-49de-8b4f-f538c962b446 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:02.112536 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-615239de-d5c1-49de-8b4f-f538c962b446 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:02.113598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-615239de-d5c1-49de-8b4f-f538c962b446 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:02.144106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-615239de-d5c1-49de-8b4f-f538c962b446 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048436 Nov 02 23:19:02.144589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1254/1829] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:02 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:03.105775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8d13afa3-01d7-490f-9fbb-f8b9dabe292b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:03.106603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8d13afa3-01d7-490f-9fbb-f8b9dabe292b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:03.113921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d13afa3-01d7-490f-9fbb-f8b9dabe292b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:03.114369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d13afa3-01d7-490f-9fbb-f8b9dabe292b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:03.115178 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d13afa3-01d7-490f-9fbb-f8b9dabe292b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:03.115610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d13afa3-01d7-490f-9fbb-f8b9dabe292b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:03.218834 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8d13afa3-01d7-490f-9fbb-f8b9dabe292b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.116657 Nov 02 23:19:03.219556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1255/1830] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:03 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:03.225262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0ebc099d-23e1-4f98-b037-4dbb9dc3a852 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:03.226248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0ebc099d-23e1-4f98-b037-4dbb9dc3a852 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:03.233287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0ebc099d-23e1-4f98-b037-4dbb9dc3a852 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:03.233738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0ebc099d-23e1-4f98-b037-4dbb9dc3a852 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:03.234516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0ebc099d-23e1-4f98-b037-4dbb9dc3a852 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:03.234977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0ebc099d-23e1-4f98-b037-4dbb9dc3a852 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:03.264876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0ebc099d-23e1-4f98-b037-4dbb9dc3a852 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043954 Nov 02 23:19:03.265439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1256/1831] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:03 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:04.231171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-066cd274-6d55-4850-9dbf-24e6e68f2ee9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:04.232110 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-066cd274-6d55-4850-9dbf-24e6e68f2ee9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:04.238266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-066cd274-6d55-4850-9dbf-24e6e68f2ee9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:04.238714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-066cd274-6d55-4850-9dbf-24e6e68f2ee9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:04.239546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-066cd274-6d55-4850-9dbf-24e6e68f2ee9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:04.239979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-066cd274-6d55-4850-9dbf-24e6e68f2ee9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:04.323987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-066cd274-6d55-4850-9dbf-24e6e68f2ee9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.096478 Nov 02 23:19:04.324911 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1257/1832] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:04 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:04.329838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c3edfada-47d1-461b-817f-f017189bf9f6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:04.330806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c3edfada-47d1-461b-817f-f017189bf9f6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:04.338140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3edfada-47d1-461b-817f-f017189bf9f6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:04.338589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3edfada-47d1-461b-817f-f017189bf9f6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:04.339384 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3edfada-47d1-461b-817f-f017189bf9f6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:04.339816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3edfada-47d1-461b-817f-f017189bf9f6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:04.370056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c3edfada-47d1-461b-817f-f017189bf9f6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043964 Nov 02 23:19:04.370610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1258/1833] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:04 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:05.336465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0d65c145-d833-45fd-9d45-ec10524dfb4a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:05.337314 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0d65c145-d833-45fd-9d45-ec10524dfb4a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:05.343639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d65c145-d833-45fd-9d45-ec10524dfb4a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:05.344088 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d65c145-d833-45fd-9d45-ec10524dfb4a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:05.344848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d65c145-d833-45fd-9d45-ec10524dfb4a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:05.345274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d65c145-d833-45fd-9d45-ec10524dfb4a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:05.434525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0d65c145-d833-45fd-9d45-ec10524dfb4a tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.102202 Nov 02 23:19:05.438475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1259/1834] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:05 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:05.440166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-972dd17f-042c-4feb-9435-fe5acb61bd31 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:05.441680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-972dd17f-042c-4feb-9435-fe5acb61bd31 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:05.448459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-972dd17f-042c-4feb-9435-fe5acb61bd31 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:05.448902 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-972dd17f-042c-4feb-9435-fe5acb61bd31 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:05.449932 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-972dd17f-042c-4feb-9435-fe5acb61bd31 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:05.450362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-972dd17f-042c-4feb-9435-fe5acb61bd31 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:05.480230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-972dd17f-042c-4feb-9435-fe5acb61bd31 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043849 Nov 02 23:19:05.480797 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1260/1835] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:05 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:06.446234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cf76528c-c4c6-4c71-8002-4779cbc94c2c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:06.447104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cf76528c-c4c6-4c71-8002-4779cbc94c2c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:06.453650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf76528c-c4c6-4c71-8002-4779cbc94c2c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:06.454053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf76528c-c4c6-4c71-8002-4779cbc94c2c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:06.454818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf76528c-c4c6-4c71-8002-4779cbc94c2c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:06.455273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf76528c-c4c6-4c71-8002-4779cbc94c2c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:06.541175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cf76528c-c4c6-4c71-8002-4779cbc94c2c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.098466 Nov 02 23:19:06.541823 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1261/1836] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:06 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:06.546890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-965fb4d6-7f95-4f42-a04f-e1d04d62f697 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:06.547913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-965fb4d6-7f95-4f42-a04f-e1d04d62f697 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:06.555615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-965fb4d6-7f95-4f42-a04f-e1d04d62f697 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:06.556061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-965fb4d6-7f95-4f42-a04f-e1d04d62f697 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:06.556837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-965fb4d6-7f95-4f42-a04f-e1d04d62f697 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:06.557271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-965fb4d6-7f95-4f42-a04f-e1d04d62f697 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:06.591416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-965fb4d6-7f95-4f42-a04f-e1d04d62f697 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046667 Nov 02 23:19:06.591416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1262/1837] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:06 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:07.553723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9d902101-26d9-44f9-b58c-cb6c2c6df7ae tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:07.554620 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9d902101-26d9-44f9-b58c-cb6c2c6df7ae tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:07.561031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d902101-26d9-44f9-b58c-cb6c2c6df7ae tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:07.561485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d902101-26d9-44f9-b58c-cb6c2c6df7ae tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:07.562252 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d902101-26d9-44f9-b58c-cb6c2c6df7ae tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:07.562689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d902101-26d9-44f9-b58c-cb6c2c6df7ae tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:07.647172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9d902101-26d9-44f9-b58c-cb6c2c6df7ae tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.097658 Nov 02 23:19:07.651164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1263/1838] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:07 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:07.652965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c6988bcb-3748-4db0-b896-f31c232cdee6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:07.653847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c6988bcb-3748-4db0-b896-f31c232cdee6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:07.661280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6988bcb-3748-4db0-b896-f31c232cdee6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:07.661732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6988bcb-3748-4db0-b896-f31c232cdee6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:07.662509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6988bcb-3748-4db0-b896-f31c232cdee6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:07.662957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6988bcb-3748-4db0-b896-f31c232cdee6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:07.694188 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c6988bcb-3748-4db0-b896-f31c232cdee6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045146 Nov 02 23:19:07.694745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1264/1839] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:07 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:08.658648 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f2b526b9-493d-46b5-beee-7450dc8afe6b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:08.659597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f2b526b9-493d-46b5-beee-7450dc8afe6b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:08.665871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f2b526b9-493d-46b5-beee-7450dc8afe6b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:08.666307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f2b526b9-493d-46b5-beee-7450dc8afe6b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:08.667110 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f2b526b9-493d-46b5-beee-7450dc8afe6b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:08.667557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f2b526b9-493d-46b5-beee-7450dc8afe6b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:08.761919 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f2b526b9-493d-46b5-beee-7450dc8afe6b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.106812 Nov 02 23:19:08.762573 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1265/1840] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:08 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:08.768205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6d3b7d40-d92e-4ea5-9e51-2d434e3d6152 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:08.769229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6d3b7d40-d92e-4ea5-9e51-2d434e3d6152 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:08.775830 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6d3b7d40-d92e-4ea5-9e51-2d434e3d6152 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:08.776275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6d3b7d40-d92e-4ea5-9e51-2d434e3d6152 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:08.777148 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6d3b7d40-d92e-4ea5-9e51-2d434e3d6152 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:08.778064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6d3b7d40-d92e-4ea5-9e51-2d434e3d6152 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:08.808561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6d3b7d40-d92e-4ea5-9e51-2d434e3d6152 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044590 Nov 02 23:19:08.809123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1266/1841] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:08 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:09.774637 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-62fe8347-d177-41d9-9c86-75fb0c3c4987 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:09.775592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-62fe8347-d177-41d9-9c86-75fb0c3c4987 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:09.781859 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-62fe8347-d177-41d9-9c86-75fb0c3c4987 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:09.782309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-62fe8347-d177-41d9-9c86-75fb0c3c4987 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:09.783124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-62fe8347-d177-41d9-9c86-75fb0c3c4987 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:09.783560 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-62fe8347-d177-41d9-9c86-75fb0c3c4987 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:09.868337 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-62fe8347-d177-41d9-9c86-75fb0c3c4987 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.097542 Nov 02 23:19:09.872270 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1267/1842] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:09 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:09.873890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-485e11e3-71df-4e1d-abf4-0e584f38cb6f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:09.874889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-485e11e3-71df-4e1d-abf4-0e584f38cb6f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:09.882358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-485e11e3-71df-4e1d-abf4-0e584f38cb6f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:09.882806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-485e11e3-71df-4e1d-abf4-0e584f38cb6f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:09.883606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-485e11e3-71df-4e1d-abf4-0e584f38cb6f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:09.884034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-485e11e3-71df-4e1d-abf4-0e584f38cb6f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:09.915974 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-485e11e3-71df-4e1d-abf4-0e584f38cb6f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045791 Nov 02 23:19:09.916538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1268/1843] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:09 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:10.880748 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-095314f2-5355-4c69-b85a-2da17703f7df tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:10.881699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-095314f2-5355-4c69-b85a-2da17703f7df tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:10.888170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-095314f2-5355-4c69-b85a-2da17703f7df tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:10.888648 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-095314f2-5355-4c69-b85a-2da17703f7df tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:10.889413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-095314f2-5355-4c69-b85a-2da17703f7df tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:10.889843 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-095314f2-5355-4c69-b85a-2da17703f7df tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:10.976356 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-095314f2-5355-4c69-b85a-2da17703f7df tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.099529 Nov 02 23:19:10.978670 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1269/1844] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:10 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:10.982272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-47423c17-da07-47bd-b740-1ebf9eb39caa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:10.983277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-47423c17-da07-47bd-b740-1ebf9eb39caa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:10.990051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47423c17-da07-47bd-b740-1ebf9eb39caa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:10.990519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47423c17-da07-47bd-b740-1ebf9eb39caa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:10.991309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47423c17-da07-47bd-b740-1ebf9eb39caa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:10.991899 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47423c17-da07-47bd-b740-1ebf9eb39caa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:11.021760 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-47423c17-da07-47bd-b740-1ebf9eb39caa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043432 Nov 02 23:19:11.022242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1270/1845] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:10 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:11.988510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3cc3418f-5b25-48ae-9d7c-8c91d93dba51 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:11.989455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3cc3418f-5b25-48ae-9d7c-8c91d93dba51 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:11.995891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3cc3418f-5b25-48ae-9d7c-8c91d93dba51 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:11.996337 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3cc3418f-5b25-48ae-9d7c-8c91d93dba51 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:11.997107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3cc3418f-5b25-48ae-9d7c-8c91d93dba51 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:11.997536 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3cc3418f-5b25-48ae-9d7c-8c91d93dba51 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:12.085614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3cc3418f-5b25-48ae-9d7c-8c91d93dba51 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.101083 Nov 02 23:19:12.086176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1271/1846] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:11 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:12.091412 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d831ff5d-c27d-4077-a80b-e04cf83c5bd6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:12.092367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d831ff5d-c27d-4077-a80b-e04cf83c5bd6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:12.099684 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d831ff5d-c27d-4077-a80b-e04cf83c5bd6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:12.100155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d831ff5d-c27d-4077-a80b-e04cf83c5bd6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:12.100918 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d831ff5d-c27d-4077-a80b-e04cf83c5bd6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:12.101338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d831ff5d-c27d-4077-a80b-e04cf83c5bd6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:12.130843 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d831ff5d-c27d-4077-a80b-e04cf83c5bd6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043324 Nov 02 23:19:12.131414 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1272/1847] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:12 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:13.096927 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4660a981-84ab-4406-9c46-c6f8b25f0019 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:13.098438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4660a981-84ab-4406-9c46-c6f8b25f0019 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:13.104899 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4660a981-84ab-4406-9c46-c6f8b25f0019 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:13.105354 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4660a981-84ab-4406-9c46-c6f8b25f0019 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:13.106133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4660a981-84ab-4406-9c46-c6f8b25f0019 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:13.106573 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4660a981-84ab-4406-9c46-c6f8b25f0019 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:13.194141 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4660a981-84ab-4406-9c46-c6f8b25f0019 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.100598 Nov 02 23:19:13.194791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1273/1848] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:13 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:13.200256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-033e71e2-cac7-4b35-87e6-d4d878e5d334 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:13.201249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-033e71e2-cac7-4b35-87e6-d4d878e5d334 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:13.208781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-033e71e2-cac7-4b35-87e6-d4d878e5d334 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:13.209227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-033e71e2-cac7-4b35-87e6-d4d878e5d334 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:13.210312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-033e71e2-cac7-4b35-87e6-d4d878e5d334 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:13.210413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-033e71e2-cac7-4b35-87e6-d4d878e5d334 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:13.241122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-033e71e2-cac7-4b35-87e6-d4d878e5d334 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044909 Nov 02 23:19:13.241639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1274/1849] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:13 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:14.205904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cce3ab7f-4a32-453f-b847-54e890dc17d5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:14.207576 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cce3ab7f-4a32-453f-b847-54e890dc17d5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:14.214101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cce3ab7f-4a32-453f-b847-54e890dc17d5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:14.214550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cce3ab7f-4a32-453f-b847-54e890dc17d5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:14.215360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cce3ab7f-4a32-453f-b847-54e890dc17d5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:14.215801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cce3ab7f-4a32-453f-b847-54e890dc17d5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:14.312233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cce3ab7f-4a32-453f-b847-54e890dc17d5 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.109951 Nov 02 23:19:14.316657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1275/1850] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:14 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:14.318547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-37cd9aa9-fe8b-4d3d-af3c-479fe9408815 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:14.319552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-37cd9aa9-fe8b-4d3d-af3c-479fe9408815 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:14.326793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-37cd9aa9-fe8b-4d3d-af3c-479fe9408815 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:14.327296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-37cd9aa9-fe8b-4d3d-af3c-479fe9408815 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:14.328072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-37cd9aa9-fe8b-4d3d-af3c-479fe9408815 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:14.328510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-37cd9aa9-fe8b-4d3d-af3c-479fe9408815 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:14.359898 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-37cd9aa9-fe8b-4d3d-af3c-479fe9408815 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045661 Nov 02 23:19:14.360471 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1276/1851] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:14 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:15.324666 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3c92084b-8a66-44ee-8c46-8cff30abbc8e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:15.325482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3c92084b-8a66-44ee-8c46-8cff30abbc8e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:15.332467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c92084b-8a66-44ee-8c46-8cff30abbc8e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:15.332912 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c92084b-8a66-44ee-8c46-8cff30abbc8e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:15.333684 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c92084b-8a66-44ee-8c46-8cff30abbc8e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:15.334113 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c92084b-8a66-44ee-8c46-8cff30abbc8e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:15.421669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3c92084b-8a66-44ee-8c46-8cff30abbc8e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.100833 Nov 02 23:19:15.422310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1277/1852] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:15 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:15.427219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1457ab63-484d-42ef-b75d-ad4199a632c7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:15.428193 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1457ab63-484d-42ef-b75d-ad4199a632c7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:15.434874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1457ab63-484d-42ef-b75d-ad4199a632c7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:15.435358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1457ab63-484d-42ef-b75d-ad4199a632c7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:15.436128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1457ab63-484d-42ef-b75d-ad4199a632c7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:15.436557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1457ab63-484d-42ef-b75d-ad4199a632c7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:15.467019 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1457ab63-484d-42ef-b75d-ad4199a632c7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043469 Nov 02 23:19:15.467574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1278/1853] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:15 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:16.433408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8d301ab1-109d-4b35-a2fc-9842a76d471b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:16.434128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8d301ab1-109d-4b35-a2fc-9842a76d471b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:16.440336 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d301ab1-109d-4b35-a2fc-9842a76d471b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:16.441275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d301ab1-109d-4b35-a2fc-9842a76d471b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:16.442032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d301ab1-109d-4b35-a2fc-9842a76d471b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:16.442457 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d301ab1-109d-4b35-a2fc-9842a76d471b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:16.528848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8d301ab1-109d-4b35-a2fc-9842a76d471b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.099000 Nov 02 23:19:16.532799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1279/1854] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:16 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:16.534332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a726322c-f895-4110-a273-da1596217155 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:16.535327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a726322c-f895-4110-a273-da1596217155 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:16.542245 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a726322c-f895-4110-a273-da1596217155 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:16.542689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a726322c-f895-4110-a273-da1596217155 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:16.543493 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a726322c-f895-4110-a273-da1596217155 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:16.543925 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a726322c-f895-4110-a273-da1596217155 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:16.574381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a726322c-f895-4110-a273-da1596217155 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043499 Nov 02 23:19:16.574948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1280/1855] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:16 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:17.540646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a8031251-3315-4bbc-965e-bac67d361138 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:17.541546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a8031251-3315-4bbc-965e-bac67d361138 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:17.547777 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a8031251-3315-4bbc-965e-bac67d361138 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:17.548224 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a8031251-3315-4bbc-965e-bac67d361138 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:17.548983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a8031251-3315-4bbc-965e-bac67d361138 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:17.549406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a8031251-3315-4bbc-965e-bac67d361138 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:17.640825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a8031251-3315-4bbc-965e-bac67d361138 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.103733 Nov 02 23:19:17.644786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1281/1856] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:17 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:17.646452 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6701d1f6-402e-49ee-8cf2-14afeda8c4c4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:17.647470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6701d1f6-402e-49ee-8cf2-14afeda8c4c4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:17.654381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6701d1f6-402e-49ee-8cf2-14afeda8c4c4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:17.654833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6701d1f6-402e-49ee-8cf2-14afeda8c4c4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:17.655638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6701d1f6-402e-49ee-8cf2-14afeda8c4c4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:17.656074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6701d1f6-402e-49ee-8cf2-14afeda8c4c4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:17.687596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6701d1f6-402e-49ee-8cf2-14afeda8c4c4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044911 Nov 02 23:19:17.688156 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1282/1857] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:17 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:18.652529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e609df3c-9401-4a4c-8e4f-7fefbd88c546 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:18.653449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e609df3c-9401-4a4c-8e4f-7fefbd88c546 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:18.660311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e609df3c-9401-4a4c-8e4f-7fefbd88c546 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:18.660759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e609df3c-9401-4a4c-8e4f-7fefbd88c546 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:18.661529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e609df3c-9401-4a4c-8e4f-7fefbd88c546 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:18.661965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e609df3c-9401-4a4c-8e4f-7fefbd88c546 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:18.747080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e609df3c-9401-4a4c-8e4f-7fefbd88c546 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.098042 Nov 02 23:19:18.747983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1283/1858] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:18 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:18.752965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6731c9dd-dfc4-4334-85ff-f1cb1cce8400 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:18.753959 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6731c9dd-dfc4-4334-85ff-f1cb1cce8400 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:18.760939 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6731c9dd-dfc4-4334-85ff-f1cb1cce8400 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:18.761389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6731c9dd-dfc4-4334-85ff-f1cb1cce8400 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:18.762163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6731c9dd-dfc4-4334-85ff-f1cb1cce8400 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:18.762594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6731c9dd-dfc4-4334-85ff-f1cb1cce8400 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:18.795063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6731c9dd-dfc4-4334-85ff-f1cb1cce8400 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045906 Nov 02 23:19:18.795642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1284/1859] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:18 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:19.759669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-94a6667f-d4fb-4aee-8bab-fd774956e01e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:19.760584 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-94a6667f-d4fb-4aee-8bab-fd774956e01e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:19.766894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94a6667f-d4fb-4aee-8bab-fd774956e01e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:19.767379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94a6667f-d4fb-4aee-8bab-fd774956e01e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:19.768292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94a6667f-d4fb-4aee-8bab-fd774956e01e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:19.768728 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94a6667f-d4fb-4aee-8bab-fd774956e01e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:19.853361 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-94a6667f-d4fb-4aee-8bab-fd774956e01e tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.097257 Nov 02 23:19:19.857239 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1285/1860] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:19 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:19.859146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-17f699f2-fa78-4ed9-988b-59087cb79c9e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:19.860134 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-17f699f2-fa78-4ed9-988b-59087cb79c9e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:19.867529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17f699f2-fa78-4ed9-988b-59087cb79c9e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:19.867981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17f699f2-fa78-4ed9-988b-59087cb79c9e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:19.868754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17f699f2-fa78-4ed9-988b-59087cb79c9e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:19.869190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17f699f2-fa78-4ed9-988b-59087cb79c9e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:19.899341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-17f699f2-fa78-4ed9-988b-59087cb79c9e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043962 Nov 02 23:19:19.899902 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1286/1861] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:19 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:20.864725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dc106679-b49e-4c9d-b02a-bfb189e53f77 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:20.865671 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dc106679-b49e-4c9d-b02a-bfb189e53f77 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:20.872352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dc106679-b49e-4c9d-b02a-bfb189e53f77 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:20.872794 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dc106679-b49e-4c9d-b02a-bfb189e53f77 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:20.873616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dc106679-b49e-4c9d-b02a-bfb189e53f77 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:20.874046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dc106679-b49e-4c9d-b02a-bfb189e53f77 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:20.967381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dc106679-b49e-4c9d-b02a-bfb189e53f77 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.106726 Nov 02 23:19:20.968066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1287/1862] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:20 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:20.973279 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ee38aa18-efc2-403e-bd39-96a109f8a19e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:20.974289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ee38aa18-efc2-403e-bd39-96a109f8a19e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:20.981567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ee38aa18-efc2-403e-bd39-96a109f8a19e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:20.982018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ee38aa18-efc2-403e-bd39-96a109f8a19e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:20.982811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ee38aa18-efc2-403e-bd39-96a109f8a19e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:20.983275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ee38aa18-efc2-403e-bd39-96a109f8a19e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:21.015777 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ee38aa18-efc2-403e-bd39-96a109f8a19e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046484 Nov 02 23:19:21.016382 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1288/1863] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:20 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:21.979251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e4b38e35-1ead-4731-b2d4-4d003bf22114 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:21.980186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e4b38e35-1ead-4731-b2d4-4d003bf22114 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:21.986667 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4b38e35-1ead-4731-b2d4-4d003bf22114 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:21.987149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4b38e35-1ead-4731-b2d4-4d003bf22114 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:21.988440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4b38e35-1ead-4731-b2d4-4d003bf22114 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:21.988867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4b38e35-1ead-4731-b2d4-4d003bf22114 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:22.074495 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e4b38e35-1ead-4731-b2d4-4d003bf22114 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.098442 Nov 02 23:19:22.078366 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1289/1864] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:21 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:22.080238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-72d2368c-2987-402c-aacd-4be80bdd4527 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:22.081212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-72d2368c-2987-402c-aacd-4be80bdd4527 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:22.088609 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72d2368c-2987-402c-aacd-4be80bdd4527 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:22.089052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72d2368c-2987-402c-aacd-4be80bdd4527 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:22.089811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72d2368c-2987-402c-aacd-4be80bdd4527 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:22.090242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72d2368c-2987-402c-aacd-4be80bdd4527 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:22.119983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-72d2368c-2987-402c-aacd-4be80bdd4527 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043427 Nov 02 23:19:22.120450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1290/1865] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:22 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:23.086116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f2442bf3-e42b-4ec4-a04c-bcb79d4325f0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:23.087003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f2442bf3-e42b-4ec4-a04c-bcb79d4325f0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:23.093271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f2442bf3-e42b-4ec4-a04c-bcb79d4325f0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:23.093710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f2442bf3-e42b-4ec4-a04c-bcb79d4325f0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:23.094492 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f2442bf3-e42b-4ec4-a04c-bcb79d4325f0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:23.094961 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f2442bf3-e42b-4ec4-a04c-bcb79d4325f0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:23.184653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f2442bf3-e42b-4ec4-a04c-bcb79d4325f0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.102074 Nov 02 23:19:23.185308 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1291/1866] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:23 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:23.191008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-475ec556-0e4b-4aed-a3d4-01346fae2718 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:23.191993 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-475ec556-0e4b-4aed-a3d4-01346fae2718 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:23.199137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-475ec556-0e4b-4aed-a3d4-01346fae2718 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:23.199579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-475ec556-0e4b-4aed-a3d4-01346fae2718 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:23.200347 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-475ec556-0e4b-4aed-a3d4-01346fae2718 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:23.200772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-475ec556-0e4b-4aed-a3d4-01346fae2718 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:23.236344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-475ec556-0e4b-4aed-a3d4-01346fae2718 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049631 Nov 02 23:19:23.236951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1292/1867] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:23 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:24.196387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0365895f-a90d-4f04-9b8b-a3e3eca95ed0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:24.197230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0365895f-a90d-4f04-9b8b-a3e3eca95ed0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:24.203972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0365895f-a90d-4f04-9b8b-a3e3eca95ed0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:24.204415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0365895f-a90d-4f04-9b8b-a3e3eca95ed0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:24.205178 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0365895f-a90d-4f04-9b8b-a3e3eca95ed0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:24.205604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0365895f-a90d-4f04-9b8b-a3e3eca95ed0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:24.304002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0365895f-a90d-4f04-9b8b-a3e3eca95ed0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.111174 Nov 02 23:19:24.304652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1293/1868] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:24 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:24.310071 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cf1e085c-e410-40dc-9c46-434684bbe495 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:24.311117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cf1e085c-e410-40dc-9c46-434684bbe495 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:24.317853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf1e085c-e410-40dc-9c46-434684bbe495 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:24.318296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf1e085c-e410-40dc-9c46-434684bbe495 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:24.319080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf1e085c-e410-40dc-9c46-434684bbe495 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:24.319505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf1e085c-e410-40dc-9c46-434684bbe495 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:24.351630 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cf1e085c-e410-40dc-9c46-434684bbe495 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045557 Nov 02 23:19:24.352425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1294/1869] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:24 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:25.316443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9250b046-a4cf-4add-9c59-99ca9f05f281 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:25.317283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9250b046-a4cf-4add-9c59-99ca9f05f281 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:25.323534 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9250b046-a4cf-4add-9c59-99ca9f05f281 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:25.324233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9250b046-a4cf-4add-9c59-99ca9f05f281 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:25.324995 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9250b046-a4cf-4add-9c59-99ca9f05f281 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:25.325454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9250b046-a4cf-4add-9c59-99ca9f05f281 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:25.412037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9250b046-a4cf-4add-9c59-99ca9f05f281 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.099756 Nov 02 23:19:25.412691 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1295/1870] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:25 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:25.417658 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a61e5d95-c227-4967-9d1d-2924b0a03064 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:25.418646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a61e5d95-c227-4967-9d1d-2924b0a03064 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:25.426141 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a61e5d95-c227-4967-9d1d-2924b0a03064 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:25.426581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a61e5d95-c227-4967-9d1d-2924b0a03064 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:25.427934 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a61e5d95-c227-4967-9d1d-2924b0a03064 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:25.427934 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a61e5d95-c227-4967-9d1d-2924b0a03064 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:25.458832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a61e5d95-c227-4967-9d1d-2924b0a03064 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044929 Nov 02 23:19:25.459431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1296/1871] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:25 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:26.423787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c98e6053-a578-4445-82f1-d0d45698b738 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:26.425173 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c98e6053-a578-4445-82f1-d0d45698b738 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:26.431548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c98e6053-a578-4445-82f1-d0d45698b738 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:26.431996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c98e6053-a578-4445-82f1-d0d45698b738 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:26.432758 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c98e6053-a578-4445-82f1-d0d45698b738 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:26.433190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c98e6053-a578-4445-82f1-d0d45698b738 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:26.519461 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c98e6053-a578-4445-82f1-d0d45698b738 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.098706 Nov 02 23:19:26.520108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1297/1872] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:26 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:26.525100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4ae99ee3-4f5d-4499-99ee-a59d8b5973a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:26.526084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4ae99ee3-4f5d-4499-99ee-a59d8b5973a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:26.533278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ae99ee3-4f5d-4499-99ee-a59d8b5973a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:26.533727 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ae99ee3-4f5d-4499-99ee-a59d8b5973a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:26.535082 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ae99ee3-4f5d-4499-99ee-a59d8b5973a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:26.535517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ae99ee3-4f5d-4499-99ee-a59d8b5973a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:26.565482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4ae99ee3-4f5d-4499-99ee-a59d8b5973a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044150 Nov 02 23:19:26.566052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1298/1873] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:26 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:27.531062 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-39f3feb4-3eb6-4d07-abc0-1e170eafb061 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:27.532006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-39f3feb4-3eb6-4d07-abc0-1e170eafb061 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:27.538378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39f3feb4-3eb6-4d07-abc0-1e170eafb061 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:27.538821 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39f3feb4-3eb6-4d07-abc0-1e170eafb061 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:27.539632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39f3feb4-3eb6-4d07-abc0-1e170eafb061 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:27.540061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39f3feb4-3eb6-4d07-abc0-1e170eafb061 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:27.630079 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-39f3feb4-3eb6-4d07-abc0-1e170eafb061 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.102538 Nov 02 23:19:27.634357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1299/1874] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:27 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:27.636351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-abaa80bb-767c-4320-8368-7bd446192a7d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:27.637346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-abaa80bb-767c-4320-8368-7bd446192a7d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:27.644135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-abaa80bb-767c-4320-8368-7bd446192a7d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:27.644584 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-abaa80bb-767c-4320-8368-7bd446192a7d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:27.645358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-abaa80bb-767c-4320-8368-7bd446192a7d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:27.645784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-abaa80bb-767c-4320-8368-7bd446192a7d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:27.679735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-abaa80bb-767c-4320-8368-7bd446192a7d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047780 Nov 02 23:19:27.680552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1300/1875] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:27 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:28.641421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d0d2e396-e825-4666-9f92-dfe0707ad22b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:28.642334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d0d2e396-e825-4666-9f92-dfe0707ad22b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:28.649278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d0d2e396-e825-4666-9f92-dfe0707ad22b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:28.649725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d0d2e396-e825-4666-9f92-dfe0707ad22b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:28.650508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d0d2e396-e825-4666-9f92-dfe0707ad22b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:28.650944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d0d2e396-e825-4666-9f92-dfe0707ad22b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:28.738453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d0d2e396-e825-4666-9f92-dfe0707ad22b tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.100486 Nov 02 23:19:28.742526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1301/1876] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:28 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:28.744191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-83e48dc1-c1f1-4fc0-9549-5c9bdf757ec5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:28.745165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-83e48dc1-c1f1-4fc0-9549-5c9bdf757ec5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:28.752169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83e48dc1-c1f1-4fc0-9549-5c9bdf757ec5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:28.752617 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83e48dc1-c1f1-4fc0-9549-5c9bdf757ec5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:28.754048 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83e48dc1-c1f1-4fc0-9549-5c9bdf757ec5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:28.754481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83e48dc1-c1f1-4fc0-9549-5c9bdf757ec5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:28.785516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-83e48dc1-c1f1-4fc0-9549-5c9bdf757ec5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045129 Nov 02 23:19:28.786075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1302/1877] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:28 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:29.750135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2707497b-0640-4455-91d5-5ab848ce8f79 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:29.751138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2707497b-0640-4455-91d5-5ab848ce8f79 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:29.757609 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2707497b-0640-4455-91d5-5ab848ce8f79 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:29.758138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2707497b-0640-4455-91d5-5ab848ce8f79 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:29.759178 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2707497b-0640-4455-91d5-5ab848ce8f79 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:29.759685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2707497b-0640-4455-91d5-5ab848ce8f79 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:29.852046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2707497b-0640-4455-91d5-5ab848ce8f79 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.105383 Nov 02 23:19:29.852732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1303/1878] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:29 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:29.857910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-22f07887-417c-408e-a416-c24566920277 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:29.858909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-22f07887-417c-408e-a416-c24566920277 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:29.865901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22f07887-417c-408e-a416-c24566920277 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:29.866361 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22f07887-417c-408e-a416-c24566920277 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:29.867149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22f07887-417c-408e-a416-c24566920277 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:29.867582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22f07887-417c-408e-a416-c24566920277 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:29.899552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-22f07887-417c-408e-a416-c24566920277 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045461 Nov 02 23:19:29.900128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1304/1879] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:29 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:30.864313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1f0f1370-0b92-4780-a50a-38cc6d960152 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:30.865215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1f0f1370-0b92-4780-a50a-38cc6d960152 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:30.871533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f0f1370-0b92-4780-a50a-38cc6d960152 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:30.871979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f0f1370-0b92-4780-a50a-38cc6d960152 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:30.872744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f0f1370-0b92-4780-a50a-38cc6d960152 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:30.873176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f0f1370-0b92-4780-a50a-38cc6d960152 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:30.976045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1f0f1370-0b92-4780-a50a-38cc6d960152 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 28684 microversion: 2.1 time: 0.115856 Nov 02 23:19:30.980091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1305/1880] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:30 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 28684 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:30.983170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-db46e9a3-4e4b-4359-baf5-f65e10cd56db tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:30.984291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-db46e9a3-4e4b-4359-baf5-f65e10cd56db tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:30.991462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db46e9a3-4e4b-4359-baf5-f65e10cd56db tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:30.991990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db46e9a3-4e4b-4359-baf5-f65e10cd56db tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:30.992837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db46e9a3-4e4b-4359-baf5-f65e10cd56db tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:30.993337 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db46e9a3-4e4b-4359-baf5-f65e10cd56db tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:31.023793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-db46e9a3-4e4b-4359-baf5-f65e10cd56db tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044600 Nov 02 23:19:31.024657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1306/1881] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:30 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:31.988038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6a6c6980-ac83-43f7-8266-0a36412646ba tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:31.989026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6a6c6980-ac83-43f7-8266-0a36412646ba tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:31.995466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a6c6980-ac83-43f7-8266-0a36412646ba tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:31.995912 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a6c6980-ac83-43f7-8266-0a36412646ba tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:31.996688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a6c6980-ac83-43f7-8266-0a36412646ba tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:31.997119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a6c6980-ac83-43f7-8266-0a36412646ba tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:32.093019 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6a6c6980-ac83-43f7-8266-0a36412646ba tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 29431 microversion: 2.1 time: 0.108846 Nov 02 23:19:32.093593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1307/1882] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:31 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 29431 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:32.099116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9227fd20-ca97-4c1c-92a1-df5d150b68f8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:32.100093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9227fd20-ca97-4c1c-92a1-df5d150b68f8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:32.106844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9227fd20-ca97-4c1c-92a1-df5d150b68f8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:32.107343 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9227fd20-ca97-4c1c-92a1-df5d150b68f8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:32.108101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9227fd20-ca97-4c1c-92a1-df5d150b68f8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:32.108530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9227fd20-ca97-4c1c-92a1-df5d150b68f8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:32.140509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9227fd20-ca97-4c1c-92a1-df5d150b68f8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045733 Nov 02 23:19:32.141078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1308/1883] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:32 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:33.104994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3e6d5e50-ac13-4447-9952-f67999b137ce tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:33.105906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3e6d5e50-ac13-4447-9952-f67999b137ce tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:33.112651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e6d5e50-ac13-4447-9952-f67999b137ce tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:33.113092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e6d5e50-ac13-4447-9952-f67999b137ce tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:33.113867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e6d5e50-ac13-4447-9952-f67999b137ce tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:33.114291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e6d5e50-ac13-4447-9952-f67999b137ce tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:33.211920 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3e6d5e50-ac13-4447-9952-f67999b137ce tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 31499 microversion: 2.1 time: 0.110542 Nov 02 23:19:33.216236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1309/1884] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:33 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 31499 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:33.218069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-03874eb2-6171-4d49-82ec-d3eb1ce1b245 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:33.219061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-03874eb2-6171-4d49-82ec-d3eb1ce1b245 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:33.225505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03874eb2-6171-4d49-82ec-d3eb1ce1b245 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:33.225940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03874eb2-6171-4d49-82ec-d3eb1ce1b245 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:33.226697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03874eb2-6171-4d49-82ec-d3eb1ce1b245 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:33.227152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03874eb2-6171-4d49-82ec-d3eb1ce1b245 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:33.258049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-03874eb2-6171-4d49-82ec-d3eb1ce1b245 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044136 Nov 02 23:19:33.258613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1310/1885] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:33 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:34.223788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4988e600-5774-4ea0-a73a-8a6771a7cbc2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:34.224694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4988e600-5774-4ea0-a73a-8a6771a7cbc2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:34.231018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4988e600-5774-4ea0-a73a-8a6771a7cbc2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:34.231465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4988e600-5774-4ea0-a73a-8a6771a7cbc2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:34.232233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4988e600-5774-4ea0-a73a-8a6771a7cbc2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:34.232658 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4988e600-5774-4ea0-a73a-8a6771a7cbc2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:34.331078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4988e600-5774-4ea0-a73a-8a6771a7cbc2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 33187 microversion: 2.1 time: 0.110653 Nov 02 23:19:34.331727 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1311/1886] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:34 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 33187 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:34.336631 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7733ab1e-f6f1-4db4-b7ab-d21ab5362ded tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:34.337598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7733ab1e-f6f1-4db4-b7ab-d21ab5362ded tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:34.344583 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7733ab1e-f6f1-4db4-b7ab-d21ab5362ded tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:34.345033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7733ab1e-f6f1-4db4-b7ab-d21ab5362ded tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:34.345810 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7733ab1e-f6f1-4db4-b7ab-d21ab5362ded tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:34.346811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7733ab1e-f6f1-4db4-b7ab-d21ab5362ded tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:34.377494 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7733ab1e-f6f1-4db4-b7ab-d21ab5362ded tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044597 Nov 02 23:19:34.378053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1312/1887] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:34 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:35.342865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-43876fab-50ee-4bcd-a8bc-cacc7036e826 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:35.343715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-43876fab-50ee-4bcd-a8bc-cacc7036e826 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:35.350601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-43876fab-50ee-4bcd-a8bc-cacc7036e826 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:35.351094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-43876fab-50ee-4bcd-a8bc-cacc7036e826 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:35.351889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-43876fab-50ee-4bcd-a8bc-cacc7036e826 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:35.352323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-43876fab-50ee-4bcd-a8bc-cacc7036e826 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:35.457091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-43876fab-50ee-4bcd-a8bc-cacc7036e826 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 34129 microversion: 2.1 time: 0.117852 Nov 02 23:19:35.457773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1313/1888] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:35 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 34129 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:35.463369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fc0cd5bb-dddc-4961-b449-b116ec5ed105 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:35.464400 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fc0cd5bb-dddc-4961-b449-b116ec5ed105 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:35.472716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc0cd5bb-dddc-4961-b449-b116ec5ed105 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:35.473173 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc0cd5bb-dddc-4961-b449-b116ec5ed105 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:35.473976 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc0cd5bb-dddc-4961-b449-b116ec5ed105 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:35.474416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc0cd5bb-dddc-4961-b449-b116ec5ed105 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:35.507689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fc0cd5bb-dddc-4961-b449-b116ec5ed105 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048672 Nov 02 23:19:35.508278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1314/1889] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:35 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:36.469345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0acd61fc-491d-4b10-ab5f-9331fe1f26f2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:36.470261 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0acd61fc-491d-4b10-ab5f-9331fe1f26f2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:36.476729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0acd61fc-491d-4b10-ab5f-9331fe1f26f2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:36.477176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0acd61fc-491d-4b10-ab5f-9331fe1f26f2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:36.477956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0acd61fc-491d-4b10-ab5f-9331fe1f26f2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:36.478384 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0acd61fc-491d-4b10-ab5f-9331fe1f26f2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:36.577291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0acd61fc-491d-4b10-ab5f-9331fe1f26f2 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 35334 microversion: 2.1 time: 0.111518 Nov 02 23:19:36.581640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1315/1890] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:36 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 35334 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:36.583126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5d70279d-54fe-47e2-bc4f-af40feb8a13a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:36.584133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5d70279d-54fe-47e2-bc4f-af40feb8a13a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:36.591071 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d70279d-54fe-47e2-bc4f-af40feb8a13a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:36.591526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d70279d-54fe-47e2-bc4f-af40feb8a13a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:36.592331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d70279d-54fe-47e2-bc4f-af40feb8a13a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:36.592769 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d70279d-54fe-47e2-bc4f-af40feb8a13a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:36.626677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5d70279d-54fe-47e2-bc4f-af40feb8a13a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047436 Nov 02 23:19:36.627279 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1316/1891] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:36 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:37.589401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ae671c6e-eeaf-4e5c-aec9-079daafec6c9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:37.590303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ae671c6e-eeaf-4e5c-aec9-079daafec6c9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:37.596703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ae671c6e-eeaf-4e5c-aec9-079daafec6c9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:37.597149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ae671c6e-eeaf-4e5c-aec9-079daafec6c9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:37.597911 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ae671c6e-eeaf-4e5c-aec9-079daafec6c9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:37.598334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ae671c6e-eeaf-4e5c-aec9-079daafec6c9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:37.696871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ae671c6e-eeaf-4e5c-aec9-079daafec6c9 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 36706 microversion: 2.1 time: 0.110950 Nov 02 23:19:37.698989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1317/1892] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:37 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 36706 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:37.703029 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cbe68868-9fdd-49ba-91da-3c7959f51499 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:37.704013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cbe68868-9fdd-49ba-91da-3c7959f51499 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:37.711458 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cbe68868-9fdd-49ba-91da-3c7959f51499 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:37.711918 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cbe68868-9fdd-49ba-91da-3c7959f51499 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:37.712664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cbe68868-9fdd-49ba-91da-3c7959f51499 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:37.713087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cbe68868-9fdd-49ba-91da-3c7959f51499 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:37.746228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cbe68868-9fdd-49ba-91da-3c7959f51499 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047288 Nov 02 23:19:37.746821 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1318/1893] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:37 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:38.708890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-318c72bc-f913-44a9-95aa-23eb9dbba462 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:38.709849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-318c72bc-f913-44a9-95aa-23eb9dbba462 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:38.715912 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-318c72bc-f913-44a9-95aa-23eb9dbba462 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:38.716357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-318c72bc-f913-44a9-95aa-23eb9dbba462 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:38.717119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-318c72bc-f913-44a9-95aa-23eb9dbba462 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:38.717544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-318c72bc-f913-44a9-95aa-23eb9dbba462 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:38.817884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-318c72bc-f913-44a9-95aa-23eb9dbba462 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 38197 microversion: 2.1 time: 0.112304 Nov 02 23:19:38.818559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1319/1894] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:38 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 38197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:38.824015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-55c11b03-33ea-47b6-aa30-e97290d3d8d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:38.824994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-55c11b03-33ea-47b6-aa30-e97290d3d8d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:38.831869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55c11b03-33ea-47b6-aa30-e97290d3d8d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:38.832313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55c11b03-33ea-47b6-aa30-e97290d3d8d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:38.833083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55c11b03-33ea-47b6-aa30-e97290d3d8d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:38.833517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55c11b03-33ea-47b6-aa30-e97290d3d8d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:38.865281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-55c11b03-33ea-47b6-aa30-e97290d3d8d5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045253 Nov 02 23:19:38.865870 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1320/1895] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:38 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:39.829914 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1c08d56c-7226-4caf-9f7e-e6167cfd0ab1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:39.831509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1c08d56c-7226-4caf-9f7e-e6167cfd0ab1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:39.837950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c08d56c-7226-4caf-9f7e-e6167cfd0ab1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:39.838398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c08d56c-7226-4caf-9f7e-e6167cfd0ab1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:39.839218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c08d56c-7226-4caf-9f7e-e6167cfd0ab1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:39.839658 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c08d56c-7226-4caf-9f7e-e6167cfd0ab1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:39.951533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1c08d56c-7226-4caf-9f7e-e6167cfd0ab1 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 38218 microversion: 2.1 time: 0.125058 Nov 02 23:19:39.952194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1321/1896] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:39 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 38218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:39.958024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-eb9de7da-a348-4e00-8cad-4d8a55972f2a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:39.959034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-eb9de7da-a348-4e00-8cad-4d8a55972f2a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:39.965843 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb9de7da-a348-4e00-8cad-4d8a55972f2a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:39.966283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb9de7da-a348-4e00-8cad-4d8a55972f2a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:39.967083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb9de7da-a348-4e00-8cad-4d8a55972f2a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:39.967510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb9de7da-a348-4e00-8cad-4d8a55972f2a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:39.997292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-eb9de7da-a348-4e00-8cad-4d8a55972f2a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043639 Nov 02 23:19:39.997767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1322/1897] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:39 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:40.964017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-50e2b2c6-61b7-4fed-92e0-b98d9a549f70 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:40.964953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-50e2b2c6-61b7-4fed-92e0-b98d9a549f70 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:40.971855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50e2b2c6-61b7-4fed-92e0-b98d9a549f70 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:40.972304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50e2b2c6-61b7-4fed-92e0-b98d9a549f70 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:40.973080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50e2b2c6-61b7-4fed-92e0-b98d9a549f70 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:40.973508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50e2b2c6-61b7-4fed-92e0-b98d9a549f70 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:41.060854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-50e2b2c6-61b7-4fed-92e0-b98d9a549f70 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 38218 microversion: 2.1 time: 0.100318 Nov 02 23:19:41.064881 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1323/1898] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:40 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 38218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:41.066388 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a722e22f-40bf-42c4-b514-18ad9f190a18 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:41.067399 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a722e22f-40bf-42c4-b514-18ad9f190a18 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:41.074497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a722e22f-40bf-42c4-b514-18ad9f190a18 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:41.074963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a722e22f-40bf-42c4-b514-18ad9f190a18 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:41.075737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a722e22f-40bf-42c4-b514-18ad9f190a18 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:41.076228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a722e22f-40bf-42c4-b514-18ad9f190a18 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:41.108918 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a722e22f-40bf-42c4-b514-18ad9f190a18 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046306 Nov 02 23:19:41.109484 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1324/1899] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:41 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:42.072339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a924c41c-6911-439d-8357-f6e811e36792 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:42.073234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a924c41c-6911-439d-8357-f6e811e36792 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:42.079977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a924c41c-6911-439d-8357-f6e811e36792 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:42.080974 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a924c41c-6911-439d-8357-f6e811e36792 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:42.081747 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a924c41c-6911-439d-8357-f6e811e36792 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:42.082172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a924c41c-6911-439d-8357-f6e811e36792 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:42.175232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a924c41c-6911-439d-8357-f6e811e36792 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 38218 microversion: 2.1 time: 0.105820 Nov 02 23:19:42.175894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1325/1900] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:42 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 38218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:42.181210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8064b560-8c7e-45ac-993d-81aa7994adbd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:42.182196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8064b560-8c7e-45ac-993d-81aa7994adbd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:42.189038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8064b560-8c7e-45ac-993d-81aa7994adbd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:42.189481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8064b560-8c7e-45ac-993d-81aa7994adbd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:42.190749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8064b560-8c7e-45ac-993d-81aa7994adbd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:42.191209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8064b560-8c7e-45ac-993d-81aa7994adbd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:42.222317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8064b560-8c7e-45ac-993d-81aa7994adbd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045038 Nov 02 23:19:42.222886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1326/1901] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:42 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:43.186735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f68ab7bd-1837-419e-8368-c7b694590064 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:19:43.187613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f68ab7bd-1837-419e-8368-c7b694590064 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:43.194557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f68ab7bd-1837-419e-8368-c7b694590064 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:43.195044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f68ab7bd-1837-419e-8368-c7b694590064 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:43.195818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f68ab7bd-1837-419e-8368-c7b694590064 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:43.196250 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f68ab7bd-1837-419e-8368-c7b694590064 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:43.304371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f68ab7bd-1837-419e-8368-c7b694590064 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action" status: 200 len: 38349 microversion: 2.1 time: 0.121181 Nov 02 23:19:43.305035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1327/1902] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:19:43 2021] POST /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/action => generated 38349 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:43.310277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-643509a3-3124-4999-b805-53c13ae74ccc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:43.311312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-643509a3-3124-4999-b805-53c13ae74ccc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:43.318559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-643509a3-3124-4999-b805-53c13ae74ccc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:43.319530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-643509a3-3124-4999-b805-53c13ae74ccc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:43.320317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-643509a3-3124-4999-b805-53c13ae74ccc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:43.320748 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-643509a3-3124-4999-b805-53c13ae74ccc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:43.356482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-643509a3-3124-4999-b805-53c13ae74ccc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050191 Nov 02 23:19:43.357069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1328/1903] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:43 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:19:43.362422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-48dde9f4-a988-4a1f-b3f6-a26a7f51e613 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:43.362910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-48dde9f4-a988-4a1f-b3f6-a26a7f51e613 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:43.369454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48dde9f4-a988-4a1f-b3f6-a26a7f51e613 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:43.369969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48dde9f4-a988-4a1f-b3f6-a26a7f51e613 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:43.370785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48dde9f4-a988-4a1f-b3f6-a26a7f51e613 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:43.371295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48dde9f4-a988-4a1f-b3f6-a26a7f51e613 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:43.397796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-48dde9f4-a988-4a1f-b3f6-a26a7f51e613 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/ips" status: 200 len: 146 microversion: 2.1 time: 0.039656 Nov 02 23:19:43.398385 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1329/1904] 10.222.0.41 () {58 vars in 1247 bytes} [Tue Nov 2 23:19:43 2021] GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:19:44.367327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a4fbef5a-37ca-47ec-8320-a848d91787aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:44.368214 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a4fbef5a-37ca-47ec-8320-a848d91787aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:44.374518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a4fbef5a-37ca-47ec-8320-a848d91787aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:44.375003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a4fbef5a-37ca-47ec-8320-a848d91787aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:44.375767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a4fbef5a-37ca-47ec-8320-a848d91787aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:44.376196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a4fbef5a-37ca-47ec-8320-a848d91787aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:44.406401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a4fbef5a-37ca-47ec-8320-a848d91787aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042820 Nov 02 23:19:44.406989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1330/1905] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:44 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:45.418133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5434cfba-31a5-416f-b5a2-95c1b044d732 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:45.418975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5434cfba-31a5-416f-b5a2-95c1b044d732 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:45.425806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5434cfba-31a5-416f-b5a2-95c1b044d732 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:45.426254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5434cfba-31a5-416f-b5a2-95c1b044d732 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:45.427096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5434cfba-31a5-416f-b5a2-95c1b044d732 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:45.427534 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5434cfba-31a5-416f-b5a2-95c1b044d732 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:45.457915 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5434cfba-31a5-416f-b5a2-95c1b044d732 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043626 Nov 02 23:19:45.458472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1331/1906] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:45 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:46.469540 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-212c6db2-7bb0-4b9b-b267-a655db45a98b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:46.470470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-212c6db2-7bb0-4b9b-b267-a655db45a98b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:46.478235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-212c6db2-7bb0-4b9b-b267-a655db45a98b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:46.478673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-212c6db2-7bb0-4b9b-b267-a655db45a98b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:46.479509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-212c6db2-7bb0-4b9b-b267-a655db45a98b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:46.479938 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-212c6db2-7bb0-4b9b-b267-a655db45a98b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:46.511260 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-212c6db2-7bb0-4b9b-b267-a655db45a98b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045500 Nov 02 23:19:46.511811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1332/1907] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:46 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:47.522784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4133a95e-bade-433d-bfd8-51b7bc0dac05 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:47.523824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4133a95e-bade-433d-bfd8-51b7bc0dac05 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:47.530128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4133a95e-bade-433d-bfd8-51b7bc0dac05 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:47.530589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4133a95e-bade-433d-bfd8-51b7bc0dac05 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:47.531398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4133a95e-bade-433d-bfd8-51b7bc0dac05 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:47.531836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4133a95e-bade-433d-bfd8-51b7bc0dac05 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:47.561451 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4133a95e-bade-433d-bfd8-51b7bc0dac05 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042504 Nov 02 23:19:47.562028 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1333/1908] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:47 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:48.574402 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3cd36dd3-bbf4-4aa4-8a46-6fc191113878 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:48.575327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3cd36dd3-bbf4-4aa4-8a46-6fc191113878 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:48.582175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3cd36dd3-bbf4-4aa4-8a46-6fc191113878 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:48.582620 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3cd36dd3-bbf4-4aa4-8a46-6fc191113878 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:48.583412 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3cd36dd3-bbf4-4aa4-8a46-6fc191113878 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:48.583833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3cd36dd3-bbf4-4aa4-8a46-6fc191113878 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:48.615393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3cd36dd3-bbf4-4aa4-8a46-6fc191113878 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044970 Nov 02 23:19:48.615980 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1334/1909] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:48 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:49.626992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-47e1c382-d11d-4408-8597-4f869f5d58d4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:49.627893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-47e1c382-d11d-4408-8597-4f869f5d58d4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:49.634150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47e1c382-d11d-4408-8597-4f869f5d58d4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:49.634589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47e1c382-d11d-4408-8597-4f869f5d58d4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:49.635396 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47e1c382-d11d-4408-8597-4f869f5d58d4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:49.635820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47e1c382-d11d-4408-8597-4f869f5d58d4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:49.665661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-47e1c382-d11d-4408-8597-4f869f5d58d4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042431 Nov 02 23:19:49.666228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1335/1910] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:49 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:50.677773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b247e524-fcfa-4a3e-b290-426da1296cd2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:50.678681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b247e524-fcfa-4a3e-b290-426da1296cd2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:50.685012 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b247e524-fcfa-4a3e-b290-426da1296cd2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:50.685463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b247e524-fcfa-4a3e-b290-426da1296cd2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:50.686234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b247e524-fcfa-4a3e-b290-426da1296cd2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:50.686670 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b247e524-fcfa-4a3e-b290-426da1296cd2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:50.716869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b247e524-fcfa-4a3e-b290-426da1296cd2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043414 Nov 02 23:19:50.717446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1336/1911] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:50 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:51.728418 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-870c8971-ee3c-4352-87b1-c81448cec7a8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:51.729318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-870c8971-ee3c-4352-87b1-c81448cec7a8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:51.735711 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-870c8971-ee3c-4352-87b1-c81448cec7a8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:51.736146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-870c8971-ee3c-4352-87b1-c81448cec7a8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:51.737504 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-870c8971-ee3c-4352-87b1-c81448cec7a8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:51.737930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-870c8971-ee3c-4352-87b1-c81448cec7a8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:51.767975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-870c8971-ee3c-4352-87b1-c81448cec7a8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043276 Nov 02 23:19:51.768773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1337/1912] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:51 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:52.779482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3ff0e45c-469c-4bb1-876d-047e6101f2f5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:52.780401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3ff0e45c-469c-4bb1-876d-047e6101f2f5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:52.787361 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3ff0e45c-469c-4bb1-876d-047e6101f2f5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:52.787804 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3ff0e45c-469c-4bb1-876d-047e6101f2f5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:52.788571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3ff0e45c-469c-4bb1-876d-047e6101f2f5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:52.789001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3ff0e45c-469c-4bb1-876d-047e6101f2f5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:52.818143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3ff0e45c-469c-4bb1-876d-047e6101f2f5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042403 Nov 02 23:19:52.819046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1338/1913] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:52 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:53.829890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-84ab3aae-4141-44b8-b914-da4e85aa30df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:53.830826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-84ab3aae-4141-44b8-b914-da4e85aa30df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:53.837149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-84ab3aae-4141-44b8-b914-da4e85aa30df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:53.837592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-84ab3aae-4141-44b8-b914-da4e85aa30df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:53.838382 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-84ab3aae-4141-44b8-b914-da4e85aa30df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:53.838811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-84ab3aae-4141-44b8-b914-da4e85aa30df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:53.868731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-84ab3aae-4141-44b8-b914-da4e85aa30df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042599 Nov 02 23:19:53.869528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1339/1914] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:53 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:54.879628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dbfbeb67-6ab0-4d0b-a11c-fb1821b09f9b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:54.880538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dbfbeb67-6ab0-4d0b-a11c-fb1821b09f9b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:54.887858 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbfbeb67-6ab0-4d0b-a11c-fb1821b09f9b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:54.888298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbfbeb67-6ab0-4d0b-a11c-fb1821b09f9b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:54.889109 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbfbeb67-6ab0-4d0b-a11c-fb1821b09f9b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:54.889534 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbfbeb67-6ab0-4d0b-a11c-fb1821b09f9b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:54.921050 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dbfbeb67-6ab0-4d0b-a11c-fb1821b09f9b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045210 Nov 02 23:19:54.921632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1340/1915] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:54 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:55.933375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a7924144-5dbc-4772-ba82-363401ffb35a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:55.934185 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a7924144-5dbc-4772-ba82-363401ffb35a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:55.941422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a7924144-5dbc-4772-ba82-363401ffb35a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:55.941864 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a7924144-5dbc-4772-ba82-363401ffb35a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:55.942635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a7924144-5dbc-4772-ba82-363401ffb35a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:55.943100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a7924144-5dbc-4772-ba82-363401ffb35a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:55.973258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a7924144-5dbc-4772-ba82-363401ffb35a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043723 Nov 02 23:19:55.973835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1341/1916] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:55 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:56.985082 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-74de5026-d890-4e98-8a42-0e3589e7aa2e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:56.985997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-74de5026-d890-4e98-8a42-0e3589e7aa2e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:56.992338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74de5026-d890-4e98-8a42-0e3589e7aa2e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:56.992782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74de5026-d890-4e98-8a42-0e3589e7aa2e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:56.993569 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74de5026-d890-4e98-8a42-0e3589e7aa2e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:56.993997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74de5026-d890-4e98-8a42-0e3589e7aa2e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:57.027345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-74de5026-d890-4e98-8a42-0e3589e7aa2e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045876 Nov 02 23:19:57.027930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1342/1917] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:56 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:58.038936 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7ee43e80-d325-4657-b7ca-1dcca60e3674 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:58.039979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7ee43e80-d325-4657-b7ca-1dcca60e3674 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:58.046155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ee43e80-d325-4657-b7ca-1dcca60e3674 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:58.046600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ee43e80-d325-4657-b7ca-1dcca60e3674 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:58.047403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ee43e80-d325-4657-b7ca-1dcca60e3674 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:58.047833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ee43e80-d325-4657-b7ca-1dcca60e3674 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:58.079197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7ee43e80-d325-4657-b7ca-1dcca60e3674 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044007 Nov 02 23:19:58.079778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1343/1918] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:58 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:19:59.090080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-576cbb00-8437-401e-ae76-2cc77207cdf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:19:59.091004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-576cbb00-8437-401e-ae76-2cc77207cdf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:19:59.097797 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-576cbb00-8437-401e-ae76-2cc77207cdf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:59.098241 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-576cbb00-8437-401e-ae76-2cc77207cdf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:59.099031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-576cbb00-8437-401e-ae76-2cc77207cdf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:19:59.099462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-576cbb00-8437-401e-ae76-2cc77207cdf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:19:59.130083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-576cbb00-8437-401e-ae76-2cc77207cdf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043725 Nov 02 23:19:59.130659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1344/1919] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:19:59 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:00.141970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-30a0a629-942b-4ce6-91d8-e54c046c686f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:00.143615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-30a0a629-942b-4ce6-91d8-e54c046c686f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:00.149538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30a0a629-942b-4ce6-91d8-e54c046c686f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:00.149983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30a0a629-942b-4ce6-91d8-e54c046c686f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:00.150752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30a0a629-942b-4ce6-91d8-e54c046c686f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:00.151212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30a0a629-942b-4ce6-91d8-e54c046c686f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:00.180365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-30a0a629-942b-4ce6-91d8-e54c046c686f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042358 Nov 02 23:20:00.180940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1345/1920] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:00 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:01.192002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-81ef73d5-4fa8-4032-9933-3ac059d9a24b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:01.192887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-81ef73d5-4fa8-4032-9933-3ac059d9a24b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:01.199606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81ef73d5-4fa8-4032-9933-3ac059d9a24b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:01.200063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81ef73d5-4fa8-4032-9933-3ac059d9a24b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:01.200837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81ef73d5-4fa8-4032-9933-3ac059d9a24b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:01.201272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81ef73d5-4fa8-4032-9933-3ac059d9a24b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:01.233150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-81ef73d5-4fa8-4032-9933-3ac059d9a24b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044954 Nov 02 23:20:01.233745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1346/1921] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:01 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:02.244626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-da849574-6950-40f9-ac2b-4e2e88f811ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:02.245521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-da849574-6950-40f9-ac2b-4e2e88f811ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:02.252388 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-da849574-6950-40f9-ac2b-4e2e88f811ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:02.252826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-da849574-6950-40f9-ac2b-4e2e88f811ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:02.253593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-da849574-6950-40f9-ac2b-4e2e88f811ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:02.254013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-da849574-6950-40f9-ac2b-4e2e88f811ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:02.286505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-da849574-6950-40f9-ac2b-4e2e88f811ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045613 Nov 02 23:20:02.287331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1347/1922] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:02 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:03.298070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3ee19562-b160-4dfb-b0c8-981a474c2e39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:03.299500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3ee19562-b160-4dfb-b0c8-981a474c2e39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:03.305654 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3ee19562-b160-4dfb-b0c8-981a474c2e39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:03.306092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3ee19562-b160-4dfb-b0c8-981a474c2e39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:03.306848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3ee19562-b160-4dfb-b0c8-981a474c2e39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:03.307300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3ee19562-b160-4dfb-b0c8-981a474c2e39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:03.337157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3ee19562-b160-4dfb-b0c8-981a474c2e39 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042832 Nov 02 23:20:03.337735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1348/1923] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:03 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:04.349307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-18270464-5510-41be-9dcd-f49bd588b38e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:04.350241 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-18270464-5510-41be-9dcd-f49bd588b38e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:04.356590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-18270464-5510-41be-9dcd-f49bd588b38e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:04.357031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-18270464-5510-41be-9dcd-f49bd588b38e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:04.357809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-18270464-5510-41be-9dcd-f49bd588b38e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:04.358223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-18270464-5510-41be-9dcd-f49bd588b38e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:04.388233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-18270464-5510-41be-9dcd-f49bd588b38e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043213 Nov 02 23:20:04.388803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1349/1924] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:04 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:05.400434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f8f8fed4-3c56-4a43-a485-0ab32e58eec9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:05.401321 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f8f8fed4-3c56-4a43-a485-0ab32e58eec9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:05.407183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8f8fed4-3c56-4a43-a485-0ab32e58eec9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:05.407670 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8f8fed4-3c56-4a43-a485-0ab32e58eec9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:05.408554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8f8fed4-3c56-4a43-a485-0ab32e58eec9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:05.408985 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8f8fed4-3c56-4a43-a485-0ab32e58eec9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:05.438084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f8f8fed4-3c56-4a43-a485-0ab32e58eec9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041897 Nov 02 23:20:05.438644 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1350/1925] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:05 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:06.450087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2d440b8d-ac52-4b84-8cbf-c2c194c4fd80 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:06.450944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2d440b8d-ac52-4b84-8cbf-c2c194c4fd80 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:06.457643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d440b8d-ac52-4b84-8cbf-c2c194c4fd80 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:06.458084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d440b8d-ac52-4b84-8cbf-c2c194c4fd80 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:06.458841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d440b8d-ac52-4b84-8cbf-c2c194c4fd80 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:06.459311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d440b8d-ac52-4b84-8cbf-c2c194c4fd80 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:06.489380 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2d440b8d-ac52-4b84-8cbf-c2c194c4fd80 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043382 Nov 02 23:20:06.489954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1351/1926] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:06 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:07.501066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-eedca495-625d-47e4-89ed-34d4dd48d029 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:07.502467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-eedca495-625d-47e4-89ed-34d4dd48d029 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:07.508931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eedca495-625d-47e4-89ed-34d4dd48d029 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:07.509374 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eedca495-625d-47e4-89ed-34d4dd48d029 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:07.510154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eedca495-625d-47e4-89ed-34d4dd48d029 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:07.510579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eedca495-625d-47e4-89ed-34d4dd48d029 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:07.540620 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-eedca495-625d-47e4-89ed-34d4dd48d029 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043336 Nov 02 23:20:07.541189 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1352/1927] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:07 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:08.552785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4f0246a3-1e0b-4516-834a-dd29f8ceab9a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:08.553688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4f0246a3-1e0b-4516-834a-dd29f8ceab9a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:08.559997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f0246a3-1e0b-4516-834a-dd29f8ceab9a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:08.560437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f0246a3-1e0b-4516-834a-dd29f8ceab9a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:08.561246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f0246a3-1e0b-4516-834a-dd29f8ceab9a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:08.561667 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f0246a3-1e0b-4516-834a-dd29f8ceab9a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:08.592193 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4f0246a3-1e0b-4516-834a-dd29f8ceab9a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043742 Nov 02 23:20:08.592775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1353/1928] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:08 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:09.603838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-48d1889c-7b84-40a7-8f1a-1993586a08a7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:09.604745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-48d1889c-7b84-40a7-8f1a-1993586a08a7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:09.611129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48d1889c-7b84-40a7-8f1a-1993586a08a7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:09.611578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48d1889c-7b84-40a7-8f1a-1993586a08a7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:09.612351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48d1889c-7b84-40a7-8f1a-1993586a08a7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:09.612783 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48d1889c-7b84-40a7-8f1a-1993586a08a7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:09.644896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-48d1889c-7b84-40a7-8f1a-1993586a08a7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044867 Nov 02 23:20:09.649242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1354/1929] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:09 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:10.656982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-26771562-8232-4689-8773-0aa44c51950a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:10.657878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-26771562-8232-4689-8773-0aa44c51950a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:10.664357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26771562-8232-4689-8773-0aa44c51950a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:10.664800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26771562-8232-4689-8773-0aa44c51950a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:10.665566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26771562-8232-4689-8773-0aa44c51950a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:10.665990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26771562-8232-4689-8773-0aa44c51950a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:10.696376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-26771562-8232-4689-8773-0aa44c51950a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043102 Nov 02 23:20:10.696960 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1355/1930] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:10 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:11.708431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1a9792ec-0e84-4e57-89d2-e749c752421d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:11.709335 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1a9792ec-0e84-4e57-89d2-e749c752421d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:11.715694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a9792ec-0e84-4e57-89d2-e749c752421d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:11.716129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a9792ec-0e84-4e57-89d2-e749c752421d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:11.716894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a9792ec-0e84-4e57-89d2-e749c752421d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:11.717319 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a9792ec-0e84-4e57-89d2-e749c752421d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:11.747220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1a9792ec-0e84-4e57-89d2-e749c752421d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042504 Nov 02 23:20:11.747806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1356/1931] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:11 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:12.758883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a7736394-dc9d-4a58-938b-edc173b1a7ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:12.759829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a7736394-dc9d-4a58-938b-edc173b1a7ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:12.766580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a7736394-dc9d-4a58-938b-edc173b1a7ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:12.767603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a7736394-dc9d-4a58-938b-edc173b1a7ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:12.768411 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a7736394-dc9d-4a58-938b-edc173b1a7ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:12.768842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a7736394-dc9d-4a58-938b-edc173b1a7ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:12.802486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a7736394-dc9d-4a58-938b-edc173b1a7ac tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047552 Nov 02 23:20:12.803119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1357/1932] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:12 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:13.813558 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-79dff546-a1d2-4dba-b1f4-b7f136dcf5f1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:13.814468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-79dff546-a1d2-4dba-b1f4-b7f136dcf5f1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:13.820969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79dff546-a1d2-4dba-b1f4-b7f136dcf5f1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:13.821414 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79dff546-a1d2-4dba-b1f4-b7f136dcf5f1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:13.822228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79dff546-a1d2-4dba-b1f4-b7f136dcf5f1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:13.822654 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79dff546-a1d2-4dba-b1f4-b7f136dcf5f1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:13.855600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-79dff546-a1d2-4dba-b1f4-b7f136dcf5f1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045797 Nov 02 23:20:13.856191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1358/1933] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:13 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:14.867861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9ed57d1f-2398-4e1d-9bc1-0c411e5be468 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:14.869224 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9ed57d1f-2398-4e1d-9bc1-0c411e5be468 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:14.876541 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ed57d1f-2398-4e1d-9bc1-0c411e5be468 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:14.876989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ed57d1f-2398-4e1d-9bc1-0c411e5be468 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:14.877775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ed57d1f-2398-4e1d-9bc1-0c411e5be468 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:14.878215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ed57d1f-2398-4e1d-9bc1-0c411e5be468 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:14.909996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9ed57d1f-2398-4e1d-9bc1-0c411e5be468 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045950 Nov 02 23:20:14.910576 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1359/1934] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:14 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:15.921635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d8b48da2-40ce-4c72-a2d6-40f2facb9b83 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:15.922542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d8b48da2-40ce-4c72-a2d6-40f2facb9b83 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:15.928963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8b48da2-40ce-4c72-a2d6-40f2facb9b83 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:15.929411 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8b48da2-40ce-4c72-a2d6-40f2facb9b83 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:15.930181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8b48da2-40ce-4c72-a2d6-40f2facb9b83 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:15.930610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8b48da2-40ce-4c72-a2d6-40f2facb9b83 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:15.961515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d8b48da2-40ce-4c72-a2d6-40f2facb9b83 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043606 Nov 02 23:20:15.962090 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1360/1935] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:15 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:16.973682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c037114a-5c28-490c-9521-f4e8ca4226d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:16.974566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c037114a-5c28-490c-9521-f4e8ca4226d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:16.980780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c037114a-5c28-490c-9521-f4e8ca4226d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:16.981214 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c037114a-5c28-490c-9521-f4e8ca4226d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:16.981968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c037114a-5c28-490c-9521-f4e8ca4226d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:16.982392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c037114a-5c28-490c-9521-f4e8ca4226d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:17.012087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c037114a-5c28-490c-9521-f4e8ca4226d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042799 Nov 02 23:20:17.012655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1361/1936] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:16 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:18.023227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8fa6a0f5-3f9e-4222-bcc0-4d98bf470313 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:18.024164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8fa6a0f5-3f9e-4222-bcc0-4d98bf470313 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:18.030432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8fa6a0f5-3f9e-4222-bcc0-4d98bf470313 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:18.030874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8fa6a0f5-3f9e-4222-bcc0-4d98bf470313 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:18.031675 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8fa6a0f5-3f9e-4222-bcc0-4d98bf470313 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:18.032108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8fa6a0f5-3f9e-4222-bcc0-4d98bf470313 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:18.062699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8fa6a0f5-3f9e-4222-bcc0-4d98bf470313 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043297 Nov 02 23:20:18.063311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1362/1937] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:18 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:19.073744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-57711ff1-30a1-4ed8-9902-03341acc0fe9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:19.074670 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-57711ff1-30a1-4ed8-9902-03341acc0fe9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:19.081399 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-57711ff1-30a1-4ed8-9902-03341acc0fe9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:19.081843 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-57711ff1-30a1-4ed8-9902-03341acc0fe9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:19.082602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-57711ff1-30a1-4ed8-9902-03341acc0fe9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:19.083056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-57711ff1-30a1-4ed8-9902-03341acc0fe9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:19.112695 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-57711ff1-30a1-4ed8-9902-03341acc0fe9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042992 Nov 02 23:20:19.113462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1363/1938] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:19 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:20.124195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bee3d7e4-1913-4deb-9e7b-6f3d962c8ce0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:20.125088 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bee3d7e4-1913-4deb-9e7b-6f3d962c8ce0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:20.131916 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bee3d7e4-1913-4deb-9e7b-6f3d962c8ce0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:20.132352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bee3d7e4-1913-4deb-9e7b-6f3d962c8ce0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:20.133144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bee3d7e4-1913-4deb-9e7b-6f3d962c8ce0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:20.133571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bee3d7e4-1913-4deb-9e7b-6f3d962c8ce0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:20.163907 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bee3d7e4-1913-4deb-9e7b-6f3d962c8ce0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043401 Nov 02 23:20:20.164473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1364/1939] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:20 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:21.175977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-03719892-dfad-4269-837e-c65cb4a55974 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:21.176964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-03719892-dfad-4269-837e-c65cb4a55974 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:21.183149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03719892-dfad-4269-837e-c65cb4a55974 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:21.183593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03719892-dfad-4269-837e-c65cb4a55974 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:21.184354 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03719892-dfad-4269-837e-c65cb4a55974 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:21.184783 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03719892-dfad-4269-837e-c65cb4a55974 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:21.214950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-03719892-dfad-4269-837e-c65cb4a55974 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043148 Nov 02 23:20:21.215542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1365/1940] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:21 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:22.226033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8d957e8a-9272-45a9-b823-26a7f2fc43f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:22.226989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8d957e8a-9272-45a9-b823-26a7f2fc43f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:22.233466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d957e8a-9272-45a9-b823-26a7f2fc43f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:22.233907 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d957e8a-9272-45a9-b823-26a7f2fc43f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:22.234669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d957e8a-9272-45a9-b823-26a7f2fc43f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:22.235611 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d957e8a-9272-45a9-b823-26a7f2fc43f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:22.265085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8d957e8a-9272-45a9-b823-26a7f2fc43f7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042746 Nov 02 23:20:22.265642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1366/1941] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:22 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:23.276654 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f63804a9-c9fc-40b2-9911-894fe9562538 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:23.277547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f63804a9-c9fc-40b2-9911-894fe9562538 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:23.284340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f63804a9-c9fc-40b2-9911-894fe9562538 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:23.284779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f63804a9-c9fc-40b2-9911-894fe9562538 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:23.285532 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f63804a9-c9fc-40b2-9911-894fe9562538 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:23.285958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f63804a9-c9fc-40b2-9911-894fe9562538 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:23.315840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f63804a9-c9fc-40b2-9911-894fe9562538 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043005 Nov 02 23:20:23.316406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1367/1942] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:23 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:24.327042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-54c6cb29-b4ed-43c0-ad83-20a38c08fdb0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:24.327941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-54c6cb29-b4ed-43c0-ad83-20a38c08fdb0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:24.334161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-54c6cb29-b4ed-43c0-ad83-20a38c08fdb0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:24.334608 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-54c6cb29-b4ed-43c0-ad83-20a38c08fdb0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:24.335389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-54c6cb29-b4ed-43c0-ad83-20a38c08fdb0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:24.335826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-54c6cb29-b4ed-43c0-ad83-20a38c08fdb0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:24.364735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-54c6cb29-b4ed-43c0-ad83-20a38c08fdb0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041696 Nov 02 23:20:24.365309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1368/1943] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:24 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:25.376426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-24c21bd0-2deb-4ea6-8837-0e6f917d0c66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:25.377314 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-24c21bd0-2deb-4ea6-8837-0e6f917d0c66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:25.383630 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24c21bd0-2deb-4ea6-8837-0e6f917d0c66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:25.384100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24c21bd0-2deb-4ea6-8837-0e6f917d0c66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:25.384857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24c21bd0-2deb-4ea6-8837-0e6f917d0c66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:25.385284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24c21bd0-2deb-4ea6-8837-0e6f917d0c66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:25.417961 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-24c21bd0-2deb-4ea6-8837-0e6f917d0c66 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045002 Nov 02 23:20:25.418553 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1369/1944] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:25 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:26.429503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-da01b654-b416-44c9-96ac-c32a5c4dc335 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:26.430357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-da01b654-b416-44c9-96ac-c32a5c4dc335 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:26.436605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-da01b654-b416-44c9-96ac-c32a5c4dc335 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:26.437051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-da01b654-b416-44c9-96ac-c32a5c4dc335 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:26.437815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-da01b654-b416-44c9-96ac-c32a5c4dc335 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:26.438811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-da01b654-b416-44c9-96ac-c32a5c4dc335 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:26.469194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-da01b654-b416-44c9-96ac-c32a5c4dc335 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043551 Nov 02 23:20:26.469777 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1370/1945] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:26 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:27.480747 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aac95103-2d67-4d23-a2db-c66edc181ebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:27.481635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aac95103-2d67-4d23-a2db-c66edc181ebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:27.488362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aac95103-2d67-4d23-a2db-c66edc181ebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:27.488804 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aac95103-2d67-4d23-a2db-c66edc181ebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:27.489566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aac95103-2d67-4d23-a2db-c66edc181ebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:27.489992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aac95103-2d67-4d23-a2db-c66edc181ebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:27.523376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aac95103-2d67-4d23-a2db-c66edc181ebc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046345 Nov 02 23:20:27.523939 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1371/1946] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:27 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:28.535021 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fc2ee02b-cd16-4239-b604-56d9b90c5894 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:28.535916 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fc2ee02b-cd16-4239-b604-56d9b90c5894 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:28.542163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc2ee02b-cd16-4239-b604-56d9b90c5894 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:28.542600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc2ee02b-cd16-4239-b604-56d9b90c5894 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:28.543397 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc2ee02b-cd16-4239-b604-56d9b90c5894 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:28.543824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc2ee02b-cd16-4239-b604-56d9b90c5894 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:28.576206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fc2ee02b-cd16-4239-b604-56d9b90c5894 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044922 Nov 02 23:20:28.576778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1372/1947] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:28 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:29.586877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4a72f555-0b92-4a96-9130-b8e994b49d7e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:29.587790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4a72f555-0b92-4a96-9130-b8e994b49d7e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:29.593986 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a72f555-0b92-4a96-9130-b8e994b49d7e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:29.594420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a72f555-0b92-4a96-9130-b8e994b49d7e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:29.595205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a72f555-0b92-4a96-9130-b8e994b49d7e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:29.595631 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a72f555-0b92-4a96-9130-b8e994b49d7e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:29.625115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4a72f555-0b92-4a96-9130-b8e994b49d7e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041925 Nov 02 23:20:29.626193 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1373/1948] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:29 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:30.637457 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e9c91e83-a3c8-4162-9cb1-135629703ceb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:30.638355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e9c91e83-a3c8-4162-9cb1-135629703ceb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:30.644851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9c91e83-a3c8-4162-9cb1-135629703ceb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:30.645293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9c91e83-a3c8-4162-9cb1-135629703ceb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:30.646059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9c91e83-a3c8-4162-9cb1-135629703ceb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:30.646487 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9c91e83-a3c8-4162-9cb1-135629703ceb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:30.677654 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e9c91e83-a3c8-4162-9cb1-135629703ceb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044053 Nov 02 23:20:30.678229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1374/1949] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:30 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:31.689762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-46df65c7-c619-4379-b8b8-c5e693024092 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:31.690806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-46df65c7-c619-4379-b8b8-c5e693024092 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:31.697431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-46df65c7-c619-4379-b8b8-c5e693024092 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:31.698128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-46df65c7-c619-4379-b8b8-c5e693024092 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:31.698905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-46df65c7-c619-4379-b8b8-c5e693024092 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:31.699355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-46df65c7-c619-4379-b8b8-c5e693024092 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:31.734192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-46df65c7-c619-4379-b8b8-c5e693024092 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047730 Nov 02 23:20:31.735121 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1375/1950] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:31 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:32.745838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b33abed0-ceb9-47f3-b4c8-8bd970ed7f30 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:32.746736 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b33abed0-ceb9-47f3-b4c8-8bd970ed7f30 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:32.753731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b33abed0-ceb9-47f3-b4c8-8bd970ed7f30 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:32.754211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b33abed0-ceb9-47f3-b4c8-8bd970ed7f30 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:32.755007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b33abed0-ceb9-47f3-b4c8-8bd970ed7f30 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:32.755438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b33abed0-ceb9-47f3-b4c8-8bd970ed7f30 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:32.785231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b33abed0-ceb9-47f3-b4c8-8bd970ed7f30 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043121 Nov 02 23:20:32.785855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1376/1951] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:32 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:33.797784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1041637d-e009-4b91-95cd-3255705e0575 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:33.798688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1041637d-e009-4b91-95cd-3255705e0575 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:33.805067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1041637d-e009-4b91-95cd-3255705e0575 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:33.805511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1041637d-e009-4b91-95cd-3255705e0575 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:33.806285 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1041637d-e009-4b91-95cd-3255705e0575 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:33.806711 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1041637d-e009-4b91-95cd-3255705e0575 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:33.838238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1041637d-e009-4b91-95cd-3255705e0575 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044723 Nov 02 23:20:33.838824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1377/1952] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:33 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:34.849569 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4ef3c736-f0d5-4a6e-b62d-4c47ea973712 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:34.850478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4ef3c736-f0d5-4a6e-b62d-4c47ea973712 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:34.856820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ef3c736-f0d5-4a6e-b62d-4c47ea973712 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:34.857268 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ef3c736-f0d5-4a6e-b62d-4c47ea973712 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:34.858035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ef3c736-f0d5-4a6e-b62d-4c47ea973712 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:34.858466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ef3c736-f0d5-4a6e-b62d-4c47ea973712 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:34.889855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4ef3c736-f0d5-4a6e-b62d-4c47ea973712 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043933 Nov 02 23:20:34.890679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1378/1953] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:34 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:35.901758 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bc9663e2-0777-4657-a891-adcb7092a75f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:35.902661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bc9663e2-0777-4657-a891-adcb7092a75f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:35.909563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc9663e2-0777-4657-a891-adcb7092a75f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:35.910010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc9663e2-0777-4657-a891-adcb7092a75f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:35.910778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc9663e2-0777-4657-a891-adcb7092a75f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:35.911231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc9663e2-0777-4657-a891-adcb7092a75f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:35.940438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bc9663e2-0777-4657-a891-adcb7092a75f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042394 Nov 02 23:20:35.941019 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1379/1954] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:35 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:36.737015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:20:36.737277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:20:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 23:20:36.952218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c0ecf50d-0ba1-411d-aef0-2fdc4c03cf38 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:36.953143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c0ecf50d-0ba1-411d-aef0-2fdc4c03cf38 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:36.959425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0ecf50d-0ba1-411d-aef0-2fdc4c03cf38 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:36.959867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0ecf50d-0ba1-411d-aef0-2fdc4c03cf38 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:36.960619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0ecf50d-0ba1-411d-aef0-2fdc4c03cf38 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:36.961044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0ecf50d-0ba1-411d-aef0-2fdc4c03cf38 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:36.991269 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c0ecf50d-0ba1-411d-aef0-2fdc4c03cf38 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042650 Nov 02 23:20:36.991769 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1380/1955] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:36 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:37.631591 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:20:37.631809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:20:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 23:20:38.002113 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3a37a7d8-09e7-4de5-b133-7bff0fd1867f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:38.003037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3a37a7d8-09e7-4de5-b133-7bff0fd1867f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:38.009244 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a37a7d8-09e7-4de5-b133-7bff0fd1867f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:38.009682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a37a7d8-09e7-4de5-b133-7bff0fd1867f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:38.010441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a37a7d8-09e7-4de5-b133-7bff0fd1867f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:38.010863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a37a7d8-09e7-4de5-b133-7bff0fd1867f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:38.040806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3a37a7d8-09e7-4de5-b133-7bff0fd1867f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042380 Nov 02 23:20:38.041368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1381/1956] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:37 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:39.052851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b487362f-4ab6-4784-a759-0641d4fe5ea6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:39.053767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b487362f-4ab6-4784-a759-0641d4fe5ea6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:39.060151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b487362f-4ab6-4784-a759-0641d4fe5ea6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:39.060591 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b487362f-4ab6-4784-a759-0641d4fe5ea6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:39.061357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b487362f-4ab6-4784-a759-0641d4fe5ea6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:39.061783 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b487362f-4ab6-4784-a759-0641d4fe5ea6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:39.092008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b487362f-4ab6-4784-a759-0641d4fe5ea6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042890 Nov 02 23:20:39.095636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1382/1957] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:39 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:40.103436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aa152928-f38d-4f72-80eb-298e9d6ac135 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:40.104330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aa152928-f38d-4f72-80eb-298e9d6ac135 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:40.111203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa152928-f38d-4f72-80eb-298e9d6ac135 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:40.111648 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa152928-f38d-4f72-80eb-298e9d6ac135 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:40.112400 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa152928-f38d-4f72-80eb-298e9d6ac135 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:40.112827 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa152928-f38d-4f72-80eb-298e9d6ac135 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:40.142072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aa152928-f38d-4f72-80eb-298e9d6ac135 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041906 Nov 02 23:20:40.146092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1383/1958] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:40 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:41.153384 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1a599543-5075-415d-b1c2-c6a37d80596c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:41.154295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1a599543-5075-415d-b1c2-c6a37d80596c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:41.160595 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a599543-5075-415d-b1c2-c6a37d80596c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:41.161048 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a599543-5075-415d-b1c2-c6a37d80596c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:41.161828 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a599543-5075-415d-b1c2-c6a37d80596c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:41.162264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a599543-5075-415d-b1c2-c6a37d80596c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:41.195913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1a599543-5075-415d-b1c2-c6a37d80596c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046268 Nov 02 23:20:41.196510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1384/1959] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:41 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:42.207564 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-987e7b68-65dc-4249-a1bb-cb1512896b70 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:42.208473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-987e7b68-65dc-4249-a1bb-cb1512896b70 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:42.214854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-987e7b68-65dc-4249-a1bb-cb1512896b70 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:42.215332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-987e7b68-65dc-4249-a1bb-cb1512896b70 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:42.216103 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-987e7b68-65dc-4249-a1bb-cb1512896b70 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:42.216533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-987e7b68-65dc-4249-a1bb-cb1512896b70 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:42.247194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-987e7b68-65dc-4249-a1bb-cb1512896b70 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043739 Nov 02 23:20:42.247487 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1385/1960] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:42 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:43.258903 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-875ec126-8637-457c-9278-07cde75ff579 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:43.259820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-875ec126-8637-457c-9278-07cde75ff579 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:43.266794 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-875ec126-8637-457c-9278-07cde75ff579 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:43.267259 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-875ec126-8637-457c-9278-07cde75ff579 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:43.268030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-875ec126-8637-457c-9278-07cde75ff579 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:43.268458 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-875ec126-8637-457c-9278-07cde75ff579 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:43.299789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-875ec126-8637-457c-9278-07cde75ff579 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044001 Nov 02 23:20:43.299789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1386/1961] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:43 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:44.311471 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1cf9dea3-d841-43f8-aedf-3003cbf0ec28 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:44.312375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1cf9dea3-d841-43f8-aedf-3003cbf0ec28 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:44.318808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1cf9dea3-d841-43f8-aedf-3003cbf0ec28 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:44.319289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1cf9dea3-d841-43f8-aedf-3003cbf0ec28 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:44.320062 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1cf9dea3-d841-43f8-aedf-3003cbf0ec28 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:44.320492 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1cf9dea3-d841-43f8-aedf-3003cbf0ec28 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:44.350632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1cf9dea3-d841-43f8-aedf-3003cbf0ec28 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042822 Nov 02 23:20:44.351238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1387/1962] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:44 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:45.361841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-50a683df-696e-4225-af11-aece38a004c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:45.362734 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-50a683df-696e-4225-af11-aece38a004c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:45.369166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50a683df-696e-4225-af11-aece38a004c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:45.369614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50a683df-696e-4225-af11-aece38a004c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:45.370383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50a683df-696e-4225-af11-aece38a004c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:45.370817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-50a683df-696e-4225-af11-aece38a004c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:45.402272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-50a683df-696e-4225-af11-aece38a004c0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043310 Nov 02 23:20:45.402272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1388/1963] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:45 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:46.412413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0d9ee6fb-4e2e-4c59-b6db-c1af888c2dd2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:46.413311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0d9ee6fb-4e2e-4c59-b6db-c1af888c2dd2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:46.419549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d9ee6fb-4e2e-4c59-b6db-c1af888c2dd2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:46.419997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d9ee6fb-4e2e-4c59-b6db-c1af888c2dd2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:46.420791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d9ee6fb-4e2e-4c59-b6db-c1af888c2dd2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:46.421221 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d9ee6fb-4e2e-4c59-b6db-c1af888c2dd2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:46.449890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0d9ee6fb-4e2e-4c59-b6db-c1af888c2dd2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041235 Nov 02 23:20:46.450643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1389/1964] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:46 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:47.461931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-22ae8272-e5af-4579-b138-ec6f3c99a34c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:47.462757 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-22ae8272-e5af-4579-b138-ec6f3c99a34c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:47.469540 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22ae8272-e5af-4579-b138-ec6f3c99a34c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:47.469982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22ae8272-e5af-4579-b138-ec6f3c99a34c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:47.477697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22ae8272-e5af-4579-b138-ec6f3c99a34c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:47.477697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22ae8272-e5af-4579-b138-ec6f3c99a34c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:47.501762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-22ae8272-e5af-4579-b138-ec6f3c99a34c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043637 Nov 02 23:20:47.502583 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1390/1965] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:47 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:48.513584 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d929890e-7fa4-4092-b852-df56dc5759cd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:48.514489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d929890e-7fa4-4092-b852-df56dc5759cd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:48.521765 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d929890e-7fa4-4092-b852-df56dc5759cd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:48.522203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d929890e-7fa4-4092-b852-df56dc5759cd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:48.523015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d929890e-7fa4-4092-b852-df56dc5759cd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:48.523432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d929890e-7fa4-4092-b852-df56dc5759cd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:48.552437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d929890e-7fa4-4092-b852-df56dc5759cd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042586 Nov 02 23:20:48.552997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1391/1966] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:48 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:49.565614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-32a9a816-4fb6-4aa3-affb-2a7c3bb911fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:49.566503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-32a9a816-4fb6-4aa3-affb-2a7c3bb911fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:49.572956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-32a9a816-4fb6-4aa3-affb-2a7c3bb911fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:49.573395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-32a9a816-4fb6-4aa3-affb-2a7c3bb911fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:49.574149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-32a9a816-4fb6-4aa3-affb-2a7c3bb911fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:49.574574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-32a9a816-4fb6-4aa3-affb-2a7c3bb911fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:49.604171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-32a9a816-4fb6-4aa3-affb-2a7c3bb911fd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042885 Nov 02 23:20:49.604740 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1392/1967] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:49 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:50.615906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9050a98f-0180-49f0-a3cd-915e784f4216 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:50.616803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9050a98f-0180-49f0-a3cd-915e784f4216 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:50.623097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9050a98f-0180-49f0-a3cd-915e784f4216 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:50.623539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9050a98f-0180-49f0-a3cd-915e784f4216 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:50.624300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9050a98f-0180-49f0-a3cd-915e784f4216 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:50.624723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9050a98f-0180-49f0-a3cd-915e784f4216 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:50.656601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9050a98f-0180-49f0-a3cd-915e784f4216 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044212 Nov 02 23:20:50.657487 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1393/1968] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:50 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:51.670323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2d51d9cb-790d-4f37-a942-5bf98d4c78e0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:51.671242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2d51d9cb-790d-4f37-a942-5bf98d4c78e0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:51.677502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d51d9cb-790d-4f37-a942-5bf98d4c78e0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:51.677950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d51d9cb-790d-4f37-a942-5bf98d4c78e0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:51.679145 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d51d9cb-790d-4f37-a942-5bf98d4c78e0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:51.679273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d51d9cb-790d-4f37-a942-5bf98d4c78e0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:51.708124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2d51d9cb-790d-4f37-a942-5bf98d4c78e0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041521 Nov 02 23:20:51.708684 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1394/1969] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:51 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:52.720164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0e9d7d43-5476-467d-bb91-a5e49ceef0f0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:52.721057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0e9d7d43-5476-467d-bb91-a5e49ceef0f0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:52.727319 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e9d7d43-5476-467d-bb91-a5e49ceef0f0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:52.727765 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e9d7d43-5476-467d-bb91-a5e49ceef0f0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:52.728526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e9d7d43-5476-467d-bb91-a5e49ceef0f0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:52.728954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e9d7d43-5476-467d-bb91-a5e49ceef0f0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:52.758692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0e9d7d43-5476-467d-bb91-a5e49ceef0f0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042814 Nov 02 23:20:52.759284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1395/1970] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:52 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:53.770852 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f7305c9e-2461-432e-82a3-7d5425a5305e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:53.771819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f7305c9e-2461-432e-82a3-7d5425a5305e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:53.778013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f7305c9e-2461-432e-82a3-7d5425a5305e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:53.778473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f7305c9e-2461-432e-82a3-7d5425a5305e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:53.779257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f7305c9e-2461-432e-82a3-7d5425a5305e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:53.779687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f7305c9e-2461-432e-82a3-7d5425a5305e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:53.807737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f7305c9e-2461-432e-82a3-7d5425a5305e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040635 Nov 02 23:20:53.808453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1396/1971] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:53 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:54.819627 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5a2ba9f3-cfe8-4a68-8a11-1f272d48b12e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:54.820527 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5a2ba9f3-cfe8-4a68-8a11-1f272d48b12e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:54.827031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a2ba9f3-cfe8-4a68-8a11-1f272d48b12e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:54.827476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a2ba9f3-cfe8-4a68-8a11-1f272d48b12e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:54.828758 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a2ba9f3-cfe8-4a68-8a11-1f272d48b12e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:54.829173 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a2ba9f3-cfe8-4a68-8a11-1f272d48b12e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:54.858581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5a2ba9f3-cfe8-4a68-8a11-1f272d48b12e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042752 Nov 02 23:20:54.859461 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1397/1972] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:54 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:55.869811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6834f71f-396a-412b-a3e8-e7a843c19d9f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:55.871486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6834f71f-396a-412b-a3e8-e7a843c19d9f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:55.877838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6834f71f-396a-412b-a3e8-e7a843c19d9f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:55.878290 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6834f71f-396a-412b-a3e8-e7a843c19d9f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:55.879094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6834f71f-396a-412b-a3e8-e7a843c19d9f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:55.879531 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6834f71f-396a-412b-a3e8-e7a843c19d9f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:55.910017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6834f71f-396a-412b-a3e8-e7a843c19d9f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043975 Nov 02 23:20:55.910582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1398/1973] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:55 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:56.922123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-725959af-7894-4fa1-8b09-5014112f862d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:56.923065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-725959af-7894-4fa1-8b09-5014112f862d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:56.929509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-725959af-7894-4fa1-8b09-5014112f862d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:56.929955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-725959af-7894-4fa1-8b09-5014112f862d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:56.930725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-725959af-7894-4fa1-8b09-5014112f862d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:56.931210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-725959af-7894-4fa1-8b09-5014112f862d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:56.966130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-725959af-7894-4fa1-8b09-5014112f862d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048457 Nov 02 23:20:56.966717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1399/1974] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:56 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:57.977738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c894d6fd-5d8c-48e5-b91f-b6a952bfa11f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:57.978628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c894d6fd-5d8c-48e5-b91f-b6a952bfa11f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:57.984798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c894d6fd-5d8c-48e5-b91f-b6a952bfa11f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:57.985238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c894d6fd-5d8c-48e5-b91f-b6a952bfa11f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:57.986002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c894d6fd-5d8c-48e5-b91f-b6a952bfa11f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:57.986426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c894d6fd-5d8c-48e5-b91f-b6a952bfa11f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:58.016058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c894d6fd-5d8c-48e5-b91f-b6a952bfa11f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041152 Nov 02 23:20:58.016433 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1400/1975] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:57 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:20:59.030313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a73ae9c0-889f-4ad0-94a2-61b93b24a778 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:20:59.031248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a73ae9c0-889f-4ad0-94a2-61b93b24a778 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:20:59.037618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a73ae9c0-889f-4ad0-94a2-61b93b24a778 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:59.038061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a73ae9c0-889f-4ad0-94a2-61b93b24a778 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:59.038838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a73ae9c0-889f-4ad0-94a2-61b93b24a778 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:20:59.039343 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a73ae9c0-889f-4ad0-94a2-61b93b24a778 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:20:59.074062 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a73ae9c0-889f-4ad0-94a2-61b93b24a778 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049907 Nov 02 23:20:59.074647 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1401/1976] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:20:59 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:00.086211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4ae70c68-fd4f-4671-a3d1-aa614ca7f124 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:00.087129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4ae70c68-fd4f-4671-a3d1-aa614ca7f124 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:00.092998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ae70c68-fd4f-4671-a3d1-aa614ca7f124 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:00.093432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ae70c68-fd4f-4671-a3d1-aa614ca7f124 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:00.094183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ae70c68-fd4f-4671-a3d1-aa614ca7f124 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:00.094607 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ae70c68-fd4f-4671-a3d1-aa614ca7f124 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:00.123665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4ae70c68-fd4f-4671-a3d1-aa614ca7f124 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041304 Nov 02 23:21:00.124411 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1402/1977] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:00 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:01.136149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f0117686-882a-4477-a420-7dba04ea7128 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:01.137082 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f0117686-882a-4477-a420-7dba04ea7128 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:01.143375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f0117686-882a-4477-a420-7dba04ea7128 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:01.143821 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f0117686-882a-4477-a420-7dba04ea7128 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:01.144586 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f0117686-882a-4477-a420-7dba04ea7128 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:01.145041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f0117686-882a-4477-a420-7dba04ea7128 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:01.179639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f0117686-882a-4477-a420-7dba04ea7128 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047151 Nov 02 23:21:01.180245 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1403/1978] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:01 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:02.192008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2e61a78d-06b7-4d15-be9c-a9de8d901344 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:02.192945 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2e61a78d-06b7-4d15-be9c-a9de8d901344 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:02.199470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2e61a78d-06b7-4d15-be9c-a9de8d901344 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:02.199920 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2e61a78d-06b7-4d15-be9c-a9de8d901344 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:02.200695 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2e61a78d-06b7-4d15-be9c-a9de8d901344 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:02.201128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2e61a78d-06b7-4d15-be9c-a9de8d901344 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:02.231557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2e61a78d-06b7-4d15-be9c-a9de8d901344 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043905 Nov 02 23:21:02.232333 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1404/1979] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:02 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:03.243691 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c0a791bc-3f5c-4717-96f6-8728f32baefb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:03.244625 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c0a791bc-3f5c-4717-96f6-8728f32baefb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:03.250970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0a791bc-3f5c-4717-96f6-8728f32baefb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:03.251436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0a791bc-3f5c-4717-96f6-8728f32baefb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:03.252205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0a791bc-3f5c-4717-96f6-8728f32baefb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:03.252640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0a791bc-3f5c-4717-96f6-8728f32baefb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:03.281908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c0a791bc-3f5c-4717-96f6-8728f32baefb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041968 Nov 02 23:21:03.282481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1405/1980] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:03 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:04.292763 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9e80f0ef-9f3d-48ef-9582-dc1c7e7f8165 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:04.293673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9e80f0ef-9f3d-48ef-9582-dc1c7e7f8165 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:04.300133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e80f0ef-9f3d-48ef-9582-dc1c7e7f8165 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:04.300580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e80f0ef-9f3d-48ef-9582-dc1c7e7f8165 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:04.301352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e80f0ef-9f3d-48ef-9582-dc1c7e7f8165 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:04.301779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e80f0ef-9f3d-48ef-9582-dc1c7e7f8165 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:04.333848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9e80f0ef-9f3d-48ef-9582-dc1c7e7f8165 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044861 Nov 02 23:21:04.334502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1406/1981] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:04 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:05.346268 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cd6435e5-fb5f-4543-9846-c9b32b809c1e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:05.347287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cd6435e5-fb5f-4543-9846-c9b32b809c1e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:05.353805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd6435e5-fb5f-4543-9846-c9b32b809c1e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:05.354250 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd6435e5-fb5f-4543-9846-c9b32b809c1e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:05.355050 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd6435e5-fb5f-4543-9846-c9b32b809c1e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:05.355485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd6435e5-fb5f-4543-9846-c9b32b809c1e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:05.388684 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cd6435e5-fb5f-4543-9846-c9b32b809c1e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046625 Nov 02 23:21:05.389520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1407/1982] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:05 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:21:06.400543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b671a83e-7b48-4c63-8552-7cc9565a0686 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:06.401439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b671a83e-7b48-4c63-8552-7cc9565a0686 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:06.408199 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b671a83e-7b48-4c63-8552-7cc9565a0686 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:06.408643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b671a83e-7b48-4c63-8552-7cc9565a0686 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:06.409405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b671a83e-7b48-4c63-8552-7cc9565a0686 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:06.409832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b671a83e-7b48-4c63-8552-7cc9565a0686 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:06.440279 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b671a83e-7b48-4c63-8552-7cc9565a0686 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043514 Nov 02 23:21:06.440853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1408/1983] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:06 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:07.452037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0dbc9c46-5e12-4e3c-a829-0e4adc8e0538 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:07.453423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0dbc9c46-5e12-4e3c-a829-0e4adc8e0538 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:07.459728 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0dbc9c46-5e12-4e3c-a829-0e4adc8e0538 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:07.460108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0dbc9c46-5e12-4e3c-a829-0e4adc8e0538 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:07.460868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0dbc9c46-5e12-4e3c-a829-0e4adc8e0538 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:07.461291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0dbc9c46-5e12-4e3c-a829-0e4adc8e0538 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:07.502584 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0dbc9c46-5e12-4e3c-a829-0e4adc8e0538 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054168 Nov 02 23:21:07.503515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1409/1984] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:07 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:08.517419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7af203a6-6d2a-4c17-8d31-7fe95d7d8fe7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:08.518314 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7af203a6-6d2a-4c17-8d31-7fe95d7d8fe7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:08.524737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7af203a6-6d2a-4c17-8d31-7fe95d7d8fe7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:08.525577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7af203a6-6d2a-4c17-8d31-7fe95d7d8fe7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:08.525949 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7af203a6-6d2a-4c17-8d31-7fe95d7d8fe7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:08.526379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7af203a6-6d2a-4c17-8d31-7fe95d7d8fe7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:08.556380 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7af203a6-6d2a-4c17-8d31-7fe95d7d8fe7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043339 Nov 02 23:21:08.557007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1410/1985] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:08 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:09.568298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d67eca93-25ac-4c7d-be4f-768d1c581f26 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:09.569209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d67eca93-25ac-4c7d-be4f-768d1c581f26 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:09.576065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d67eca93-25ac-4c7d-be4f-768d1c581f26 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:09.576502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d67eca93-25ac-4c7d-be4f-768d1c581f26 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:09.577281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d67eca93-25ac-4c7d-be4f-768d1c581f26 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:09.577701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d67eca93-25ac-4c7d-be4f-768d1c581f26 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:09.607635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d67eca93-25ac-4c7d-be4f-768d1c581f26 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043255 Nov 02 23:21:09.608213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1411/1986] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:09 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:10.619962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-88eb2592-1ab4-4ffc-afe9-c7f157ae2580 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:10.620905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-88eb2592-1ab4-4ffc-afe9-c7f157ae2580 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:10.628013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88eb2592-1ab4-4ffc-afe9-c7f157ae2580 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:10.628465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88eb2592-1ab4-4ffc-afe9-c7f157ae2580 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:10.629251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88eb2592-1ab4-4ffc-afe9-c7f157ae2580 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:10.629683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88eb2592-1ab4-4ffc-afe9-c7f157ae2580 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:10.659699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-88eb2592-1ab4-4ffc-afe9-c7f157ae2580 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043480 Nov 02 23:21:10.660369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1412/1987] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:10 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:11.671243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-24560523-6e56-4f96-865b-559a2ce1eb7f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:11.672224 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-24560523-6e56-4f96-865b-559a2ce1eb7f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:11.678445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24560523-6e56-4f96-865b-559a2ce1eb7f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:11.678883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24560523-6e56-4f96-865b-559a2ce1eb7f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:11.679677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24560523-6e56-4f96-865b-559a2ce1eb7f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:11.680101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24560523-6e56-4f96-865b-559a2ce1eb7f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:11.710507 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-24560523-6e56-4f96-865b-559a2ce1eb7f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042973 Nov 02 23:21:11.711108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1413/1988] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:11 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:12.722377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2ec03613-2b80-4edb-bb01-29ff3b0cdf94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:12.723292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2ec03613-2b80-4edb-bb01-29ff3b0cdf94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:12.729661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ec03613-2b80-4edb-bb01-29ff3b0cdf94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:12.730107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ec03613-2b80-4edb-bb01-29ff3b0cdf94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:12.730873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ec03613-2b80-4edb-bb01-29ff3b0cdf94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:12.731326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ec03613-2b80-4edb-bb01-29ff3b0cdf94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:12.765660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2ec03613-2b80-4edb-bb01-29ff3b0cdf94 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047018 Nov 02 23:21:12.766440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1414/1989] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:12 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:13.777355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-93295c6e-3fa0-467e-b1a7-d4e7be01d19e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:13.778332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-93295c6e-3fa0-467e-b1a7-d4e7be01d19e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:13.784609 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93295c6e-3fa0-467e-b1a7-d4e7be01d19e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:13.785046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93295c6e-3fa0-467e-b1a7-d4e7be01d19e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:13.785798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93295c6e-3fa0-467e-b1a7-d4e7be01d19e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:13.786223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93295c6e-3fa0-467e-b1a7-d4e7be01d19e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:13.815360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-93295c6e-3fa0-467e-b1a7-d4e7be01d19e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041718 Nov 02 23:21:13.815929 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1415/1990] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:13 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:14.827133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-53b9d1f1-bb1c-463c-a61f-2f1dd535c43b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:14.828059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-53b9d1f1-bb1c-463c-a61f-2f1dd535c43b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:14.834376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53b9d1f1-bb1c-463c-a61f-2f1dd535c43b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:14.834819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53b9d1f1-bb1c-463c-a61f-2f1dd535c43b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:14.835627 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53b9d1f1-bb1c-463c-a61f-2f1dd535c43b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:14.836055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53b9d1f1-bb1c-463c-a61f-2f1dd535c43b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:14.867377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-53b9d1f1-bb1c-463c-a61f-2f1dd535c43b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043934 Nov 02 23:21:14.867962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1416/1991] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:14 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:15.879162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-87971dba-9364-4d38-aa64-d2641cab983d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:15.880069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-87971dba-9364-4d38-aa64-d2641cab983d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:15.886693 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87971dba-9364-4d38-aa64-d2641cab983d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:15.887184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87971dba-9364-4d38-aa64-d2641cab983d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:15.887962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87971dba-9364-4d38-aa64-d2641cab983d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:15.888429 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87971dba-9364-4d38-aa64-d2641cab983d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:15.918896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-87971dba-9364-4d38-aa64-d2641cab983d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043565 Nov 02 23:21:15.919714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1417/1992] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:15 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:21:16.930036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0702adc8-bbf2-43eb-8dd5-13a049b59dff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:16.931051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0702adc8-bbf2-43eb-8dd5-13a049b59dff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:16.937432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0702adc8-bbf2-43eb-8dd5-13a049b59dff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:16.937875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0702adc8-bbf2-43eb-8dd5-13a049b59dff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:16.938641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0702adc8-bbf2-43eb-8dd5-13a049b59dff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:16.939096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0702adc8-bbf2-43eb-8dd5-13a049b59dff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:16.968891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0702adc8-bbf2-43eb-8dd5-13a049b59dff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042582 Nov 02 23:21:16.969455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1418/1993] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:16 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:17.980376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f98fc073-787d-4624-91ee-31bb7a96ddb9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:17.981273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f98fc073-787d-4624-91ee-31bb7a96ddb9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:17.988075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f98fc073-787d-4624-91ee-31bb7a96ddb9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:17.988523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f98fc073-787d-4624-91ee-31bb7a96ddb9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:17.989281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f98fc073-787d-4624-91ee-31bb7a96ddb9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:17.989710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f98fc073-787d-4624-91ee-31bb7a96ddb9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:18.019527 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f98fc073-787d-4624-91ee-31bb7a96ddb9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042836 Nov 02 23:21:18.020103 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1419/1994] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:17 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:19.030968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f3bb22c1-8e26-4727-af99-d983d08a5273 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:19.031871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f3bb22c1-8e26-4727-af99-d983d08a5273 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:19.038130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3bb22c1-8e26-4727-af99-d983d08a5273 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:19.038570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3bb22c1-8e26-4727-af99-d983d08a5273 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:19.039366 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3bb22c1-8e26-4727-af99-d983d08a5273 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:19.039796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3bb22c1-8e26-4727-af99-d983d08a5273 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:19.069304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f3bb22c1-8e26-4727-af99-d983d08a5273 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042706 Nov 02 23:21:19.069876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1420/1995] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:19 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:20.081602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-335a0bfa-7545-4ed0-88db-1971f9750ac3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:20.082508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-335a0bfa-7545-4ed0-88db-1971f9750ac3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:20.088704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-335a0bfa-7545-4ed0-88db-1971f9750ac3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:20.089152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-335a0bfa-7545-4ed0-88db-1971f9750ac3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:20.089913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-335a0bfa-7545-4ed0-88db-1971f9750ac3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:20.090341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-335a0bfa-7545-4ed0-88db-1971f9750ac3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:20.119641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-335a0bfa-7545-4ed0-88db-1971f9750ac3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042384 Nov 02 23:21:20.120215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1421/1996] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:20 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:21.131318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8bab27a1-37eb-4f4b-a274-253e5b4b3bf1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:21.132143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8bab27a1-37eb-4f4b-a274-253e5b4b3bf1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:21.138319 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bab27a1-37eb-4f4b-a274-253e5b4b3bf1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:21.138759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bab27a1-37eb-4f4b-a274-253e5b4b3bf1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:21.139570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bab27a1-37eb-4f4b-a274-253e5b4b3bf1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:21.140002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bab27a1-37eb-4f4b-a274-253e5b4b3bf1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:21.169131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8bab27a1-37eb-4f4b-a274-253e5b4b3bf1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041698 Nov 02 23:21:21.169694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1422/1997] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:21 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:22.181234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9d9991a2-60ac-4d3a-a19b-d33c7d2df2b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:22.182130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9d9991a2-60ac-4d3a-a19b-d33c7d2df2b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:22.188946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d9991a2-60ac-4d3a-a19b-d33c7d2df2b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:22.189384 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d9991a2-60ac-4d3a-a19b-d33c7d2df2b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:22.190144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d9991a2-60ac-4d3a-a19b-d33c7d2df2b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:22.190568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d9991a2-60ac-4d3a-a19b-d33c7d2df2b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:22.221254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9d9991a2-60ac-4d3a-a19b-d33c7d2df2b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043763 Nov 02 23:21:22.221870 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1423/1998] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:22 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:23.232301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b8e93660-6df1-4a98-89db-d5b20eefd481 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:23.233786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b8e93660-6df1-4a98-89db-d5b20eefd481 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:23.240155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b8e93660-6df1-4a98-89db-d5b20eefd481 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:23.240596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b8e93660-6df1-4a98-89db-d5b20eefd481 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:23.241391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b8e93660-6df1-4a98-89db-d5b20eefd481 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:23.241815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b8e93660-6df1-4a98-89db-d5b20eefd481 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:23.272162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b8e93660-6df1-4a98-89db-d5b20eefd481 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043586 Nov 02 23:21:23.272741 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1424/1999] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:23 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:24.282703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cf234a7e-85b2-4205-87d4-da8d01f3837d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:24.283652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cf234a7e-85b2-4205-87d4-da8d01f3837d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:24.289886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf234a7e-85b2-4205-87d4-da8d01f3837d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:24.290405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf234a7e-85b2-4205-87d4-da8d01f3837d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:24.291146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf234a7e-85b2-4205-87d4-da8d01f3837d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:24.291575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf234a7e-85b2-4205-87d4-da8d01f3837d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:24.321336 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cf234a7e-85b2-4205-87d4-da8d01f3837d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042381 Nov 02 23:21:24.322175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1425/2000] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:24 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:25.332400 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f34d541a-abb4-49b5-8d08-421d8e44804e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:25.333301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f34d541a-abb4-49b5-8d08-421d8e44804e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:25.339949 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f34d541a-abb4-49b5-8d08-421d8e44804e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:25.340394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f34d541a-abb4-49b5-8d08-421d8e44804e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:25.341187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f34d541a-abb4-49b5-8d08-421d8e44804e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:25.341599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f34d541a-abb4-49b5-8d08-421d8e44804e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:25.375266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f34d541a-abb4-49b5-8d08-421d8e44804e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046578 Nov 02 23:21:25.376053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1426/2001] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:25 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:26.387446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-85c75180-a051-4ecc-8441-6241db9f7513 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:26.401325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-85c75180-a051-4ecc-8441-6241db9f7513 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:26.401325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85c75180-a051-4ecc-8441-6241db9f7513 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:26.401325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85c75180-a051-4ecc-8441-6241db9f7513 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:26.401325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85c75180-a051-4ecc-8441-6241db9f7513 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:26.401759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85c75180-a051-4ecc-8441-6241db9f7513 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:26.431364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-85c75180-a051-4ecc-8441-6241db9f7513 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048012 Nov 02 23:21:26.431941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1427/2002] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:26 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:27.443137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3c6f1956-8216-4ece-a6a8-ccc813e1f7d3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:27.444039 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3c6f1956-8216-4ece-a6a8-ccc813e1f7d3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:27.451181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c6f1956-8216-4ece-a6a8-ccc813e1f7d3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:27.451623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c6f1956-8216-4ece-a6a8-ccc813e1f7d3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:27.452971 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c6f1956-8216-4ece-a6a8-ccc813e1f7d3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:27.453391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c6f1956-8216-4ece-a6a8-ccc813e1f7d3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:27.483515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3c6f1956-8216-4ece-a6a8-ccc813e1f7d3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044191 Nov 02 23:21:27.487433 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1428/2003] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:27 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:28.495053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-56f67121-1389-4927-8fa3-1436274cfa9f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:28.495958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-56f67121-1389-4927-8fa3-1436274cfa9f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:28.502148 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56f67121-1389-4927-8fa3-1436274cfa9f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:28.502591 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56f67121-1389-4927-8fa3-1436274cfa9f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:28.503396 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56f67121-1389-4927-8fa3-1436274cfa9f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:28.503829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56f67121-1389-4927-8fa3-1436274cfa9f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:28.534461 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-56f67121-1389-4927-8fa3-1436274cfa9f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042914 Nov 02 23:21:28.535508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1429/2004] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:28 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:29.546880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-499a969f-7831-449c-99f2-aecf799573b2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:29.547797 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-499a969f-7831-449c-99f2-aecf799573b2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:29.554288 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-499a969f-7831-449c-99f2-aecf799573b2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:29.554758 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-499a969f-7831-449c-99f2-aecf799573b2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:29.555566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-499a969f-7831-449c-99f2-aecf799573b2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:29.555991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-499a969f-7831-449c-99f2-aecf799573b2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:29.585708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-499a969f-7831-449c-99f2-aecf799573b2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043233 Nov 02 23:21:29.586274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1430/2005] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:29 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:30.597273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c2d09e62-657a-4428-8ab5-c8f5c398eabd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:30.598167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c2d09e62-657a-4428-8ab5-c8f5c398eabd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:30.604120 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2d09e62-657a-4428-8ab5-c8f5c398eabd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:30.604597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2d09e62-657a-4428-8ab5-c8f5c398eabd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:30.605356 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2d09e62-657a-4428-8ab5-c8f5c398eabd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:30.605784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2d09e62-657a-4428-8ab5-c8f5c398eabd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:30.636716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c2d09e62-657a-4428-8ab5-c8f5c398eabd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043119 Nov 02 23:21:30.637294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1431/2006] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:30 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:31.648680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fd1714a5-492c-45f0-ab57-32a572a6792e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:31.649591 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fd1714a5-492c-45f0-ab57-32a572a6792e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:31.656700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd1714a5-492c-45f0-ab57-32a572a6792e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:31.657148 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd1714a5-492c-45f0-ab57-32a572a6792e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:31.657922 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd1714a5-492c-45f0-ab57-32a572a6792e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:31.658357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd1714a5-492c-45f0-ab57-32a572a6792e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:31.688792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fd1714a5-492c-45f0-ab57-32a572a6792e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044178 Nov 02 23:21:31.689393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1432/2007] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:31 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:32.700665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9820c326-6f45-4dc1-a6ff-bac6a65dd53c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:32.701697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9820c326-6f45-4dc1-a6ff-bac6a65dd53c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:32.707997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9820c326-6f45-4dc1-a6ff-bac6a65dd53c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:32.708448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9820c326-6f45-4dc1-a6ff-bac6a65dd53c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:32.709322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9820c326-6f45-4dc1-a6ff-bac6a65dd53c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:32.709757 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9820c326-6f45-4dc1-a6ff-bac6a65dd53c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:32.741346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9820c326-6f45-4dc1-a6ff-bac6a65dd53c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044666 Nov 02 23:21:32.741940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1433/2008] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:32 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:33.754115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-93dc6ab3-5f34-4981-8f04-c1d022f685ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:33.755068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-93dc6ab3-5f34-4981-8f04-c1d022f685ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:33.761542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93dc6ab3-5f34-4981-8f04-c1d022f685ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:33.761995 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93dc6ab3-5f34-4981-8f04-c1d022f685ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:33.762774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93dc6ab3-5f34-4981-8f04-c1d022f685ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:33.763239 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93dc6ab3-5f34-4981-8f04-c1d022f685ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:33.794217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-93dc6ab3-5f34-4981-8f04-c1d022f685ea tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043997 Nov 02 23:21:33.794802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1434/2009] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:33 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:34.805387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ec3ea497-4757-4417-a422-c73f7aec8b8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:34.806281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ec3ea497-4757-4417-a422-c73f7aec8b8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:34.816324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec3ea497-4757-4417-a422-c73f7aec8b8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:34.816774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec3ea497-4757-4417-a422-c73f7aec8b8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:34.817540 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec3ea497-4757-4417-a422-c73f7aec8b8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:34.817971 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec3ea497-4757-4417-a422-c73f7aec8b8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:34.848170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ec3ea497-4757-4417-a422-c73f7aec8b8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046561 Nov 02 23:21:34.848985 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1435/2010] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:34 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:35.860355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9f6ad801-1be7-45ae-a253-3ea4b8c89cf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:35.861276 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9f6ad801-1be7-45ae-a253-3ea4b8c89cf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:35.867563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f6ad801-1be7-45ae-a253-3ea4b8c89cf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:35.868004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f6ad801-1be7-45ae-a253-3ea4b8c89cf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:35.868770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f6ad801-1be7-45ae-a253-3ea4b8c89cf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:35.869195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f6ad801-1be7-45ae-a253-3ea4b8c89cf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:35.899229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9f6ad801-1be7-45ae-a253-3ea4b8c89cf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043154 Nov 02 23:21:35.899800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1436/2011] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:35 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:36.910853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f8391a22-39f8-4f15-8d72-c062ac5fb0a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:36.911852 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f8391a22-39f8-4f15-8d72-c062ac5fb0a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:36.918063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8391a22-39f8-4f15-8d72-c062ac5fb0a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:36.918511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8391a22-39f8-4f15-8d72-c062ac5fb0a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:36.919310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8391a22-39f8-4f15-8d72-c062ac5fb0a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:36.919745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8391a22-39f8-4f15-8d72-c062ac5fb0a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:36.951181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f8391a22-39f8-4f15-8d72-c062ac5fb0a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044027 Nov 02 23:21:36.951824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1437/2012] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:36 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:37.962584 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3d46413b-bc51-4426-95bc-fc7e21ef5653 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:37.963430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3d46413b-bc51-4426-95bc-fc7e21ef5653 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:37.969594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3d46413b-bc51-4426-95bc-fc7e21ef5653 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:37.970037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3d46413b-bc51-4426-95bc-fc7e21ef5653 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:37.970789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3d46413b-bc51-4426-95bc-fc7e21ef5653 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:37.971241 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3d46413b-bc51-4426-95bc-fc7e21ef5653 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:37.999567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3d46413b-bc51-4426-95bc-fc7e21ef5653 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040785 Nov 02 23:21:38.000118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1438/2013] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:37 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:39.011969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ecd99af9-cae0-4cfe-8d1f-3cab6a4f71ef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:39.012859 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ecd99af9-cae0-4cfe-8d1f-3cab6a4f71ef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:39.019524 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ecd99af9-cae0-4cfe-8d1f-3cab6a4f71ef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:39.019966 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ecd99af9-cae0-4cfe-8d1f-3cab6a4f71ef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:39.020722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ecd99af9-cae0-4cfe-8d1f-3cab6a4f71ef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:39.021146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ecd99af9-cae0-4cfe-8d1f-3cab6a4f71ef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:39.052073 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ecd99af9-cae0-4cfe-8d1f-3cab6a4f71ef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043860 Nov 02 23:21:39.052640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1439/2014] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:39 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:40.063440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-18cbdaa8-95ac-49a9-aea1-f3a3dd1ea1a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:40.064308 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-18cbdaa8-95ac-49a9-aea1-f3a3dd1ea1a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:40.070470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-18cbdaa8-95ac-49a9-aea1-f3a3dd1ea1a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:40.070930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-18cbdaa8-95ac-49a9-aea1-f3a3dd1ea1a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:40.071943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-18cbdaa8-95ac-49a9-aea1-f3a3dd1ea1a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:40.072372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-18cbdaa8-95ac-49a9-aea1-f3a3dd1ea1a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:40.101788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-18cbdaa8-95ac-49a9-aea1-f3a3dd1ea1a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042098 Nov 02 23:21:40.102364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1440/2015] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:40 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:41.113645 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6a607d48-c056-4ddc-b0c6-f86ac69dc814 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:41.114566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6a607d48-c056-4ddc-b0c6-f86ac69dc814 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:41.120777 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a607d48-c056-4ddc-b0c6-f86ac69dc814 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:41.121219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a607d48-c056-4ddc-b0c6-f86ac69dc814 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:41.121971 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a607d48-c056-4ddc-b0c6-f86ac69dc814 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:41.122394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a607d48-c056-4ddc-b0c6-f86ac69dc814 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:41.151657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6a607d48-c056-4ddc-b0c6-f86ac69dc814 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042213 Nov 02 23:21:41.152212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1441/2016] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:41 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:42.163606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b370fc27-84cc-468c-9311-c222f2e717ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:42.164502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b370fc27-84cc-468c-9311-c222f2e717ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:42.170723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b370fc27-84cc-468c-9311-c222f2e717ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:42.171197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b370fc27-84cc-468c-9311-c222f2e717ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:42.171958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b370fc27-84cc-468c-9311-c222f2e717ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:42.172395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b370fc27-84cc-468c-9311-c222f2e717ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:42.201590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b370fc27-84cc-468c-9311-c222f2e717ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041699 Nov 02 23:21:42.202188 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1442/2017] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:42 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:43.213541 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6dac7fc1-a23c-46b2-83e2-7161b01dc995 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:43.214471 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6dac7fc1-a23c-46b2-83e2-7161b01dc995 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:43.220722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6dac7fc1-a23c-46b2-83e2-7161b01dc995 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:43.221162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6dac7fc1-a23c-46b2-83e2-7161b01dc995 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:43.221937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6dac7fc1-a23c-46b2-83e2-7161b01dc995 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:43.222361 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6dac7fc1-a23c-46b2-83e2-7161b01dc995 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:43.252186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6dac7fc1-a23c-46b2-83e2-7161b01dc995 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042350 Nov 02 23:21:43.252752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1443/2018] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:43 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:44.263690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0c03c652-52bf-422a-9796-4710aa55db0a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:44.264590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0c03c652-52bf-422a-9796-4710aa55db0a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:44.271307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0c03c652-52bf-422a-9796-4710aa55db0a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:44.271750 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0c03c652-52bf-422a-9796-4710aa55db0a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:44.272507 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0c03c652-52bf-422a-9796-4710aa55db0a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:44.272932 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0c03c652-52bf-422a-9796-4710aa55db0a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:44.302216 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0c03c652-52bf-422a-9796-4710aa55db0a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042226 Nov 02 23:21:44.302795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1444/2019] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:44 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:45.313598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2d6b977a-3af7-43aa-9ed7-eb0127fbeb48 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:45.314805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2d6b977a-3af7-43aa-9ed7-eb0127fbeb48 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:45.320699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d6b977a-3af7-43aa-9ed7-eb0127fbeb48 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:45.321141 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d6b977a-3af7-43aa-9ed7-eb0127fbeb48 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:45.322147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d6b977a-3af7-43aa-9ed7-eb0127fbeb48 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:45.322572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d6b977a-3af7-43aa-9ed7-eb0127fbeb48 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:45.352625 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2d6b977a-3af7-43aa-9ed7-eb0127fbeb48 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042556 Nov 02 23:21:45.353197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1445/2020] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:45 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:46.364437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-eb12ed50-c446-4f93-8bbf-ec67dbd0c532 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:46.366204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-eb12ed50-c446-4f93-8bbf-ec67dbd0c532 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:46.372906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb12ed50-c446-4f93-8bbf-ec67dbd0c532 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:46.373349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb12ed50-c446-4f93-8bbf-ec67dbd0c532 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:46.374105 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb12ed50-c446-4f93-8bbf-ec67dbd0c532 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:46.374528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb12ed50-c446-4f93-8bbf-ec67dbd0c532 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:46.404287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-eb12ed50-c446-4f93-8bbf-ec67dbd0c532 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043992 Nov 02 23:21:46.404839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1446/2021] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:46 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:47.415683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-15587a92-8534-4ef2-9555-d289e524267c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:47.416600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-15587a92-8534-4ef2-9555-d289e524267c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:47.422843 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15587a92-8534-4ef2-9555-d289e524267c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:47.423326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15587a92-8534-4ef2-9555-d289e524267c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:47.424094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15587a92-8534-4ef2-9555-d289e524267c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:47.424528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15587a92-8534-4ef2-9555-d289e524267c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:47.454656 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-15587a92-8534-4ef2-9555-d289e524267c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042119 Nov 02 23:21:47.455235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1447/2022] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:47 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:48.466038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7b7d73b4-1568-4e1b-be25-a59ba764d056 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:48.466884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7b7d73b4-1568-4e1b-be25-a59ba764d056 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:48.473122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7b7d73b4-1568-4e1b-be25-a59ba764d056 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:48.473567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7b7d73b4-1568-4e1b-be25-a59ba764d056 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:48.474329 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7b7d73b4-1568-4e1b-be25-a59ba764d056 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:48.474758 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7b7d73b4-1568-4e1b-be25-a59ba764d056 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:48.503738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7b7d73b4-1568-4e1b-be25-a59ba764d056 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041480 Nov 02 23:21:48.504300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1448/2023] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:48 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:49.515195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4e6e8f88-135b-4897-b7e0-4f9178cf42ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:49.516093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4e6e8f88-135b-4897-b7e0-4f9178cf42ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:49.522349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e6e8f88-135b-4897-b7e0-4f9178cf42ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:49.522791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e6e8f88-135b-4897-b7e0-4f9178cf42ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:49.523574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e6e8f88-135b-4897-b7e0-4f9178cf42ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:49.524023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e6e8f88-135b-4897-b7e0-4f9178cf42ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:49.552763 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4e6e8f88-135b-4897-b7e0-4f9178cf42ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041291 Nov 02 23:21:49.553323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1449/2024] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:49 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:50.565138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a476becb-4b3b-4942-ae9e-8ea4bcd7f6f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:50.566056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a476becb-4b3b-4942-ae9e-8ea4bcd7f6f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:50.572593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a476becb-4b3b-4942-ae9e-8ea4bcd7f6f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:50.573029 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a476becb-4b3b-4942-ae9e-8ea4bcd7f6f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:50.573781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a476becb-4b3b-4942-ae9e-8ea4bcd7f6f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:50.574204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a476becb-4b3b-4942-ae9e-8ea4bcd7f6f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:50.603561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a476becb-4b3b-4942-ae9e-8ea4bcd7f6f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042642 Nov 02 23:21:50.604138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1450/2025] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:50 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:51.615011 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-013af5a7-2928-4e56-bc03-5661cc99ab4b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:51.615931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-013af5a7-2928-4e56-bc03-5661cc99ab4b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:51.622228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-013af5a7-2928-4e56-bc03-5661cc99ab4b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:51.622667 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-013af5a7-2928-4e56-bc03-5661cc99ab4b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:51.623470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-013af5a7-2928-4e56-bc03-5661cc99ab4b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:51.623893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-013af5a7-2928-4e56-bc03-5661cc99ab4b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:51.653276 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-013af5a7-2928-4e56-bc03-5661cc99ab4b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041975 Nov 02 23:21:51.653837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1451/2026] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:51 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:52.665163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3005531b-d77f-4829-85bf-54ae5faef992 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:52.666057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3005531b-d77f-4829-85bf-54ae5faef992 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:52.672280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3005531b-d77f-4829-85bf-54ae5faef992 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:52.673353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3005531b-d77f-4829-85bf-54ae5faef992 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:52.674119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3005531b-d77f-4829-85bf-54ae5faef992 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:52.674547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3005531b-d77f-4829-85bf-54ae5faef992 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:52.704194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3005531b-d77f-4829-85bf-54ae5faef992 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042722 Nov 02 23:21:52.704994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1452/2027] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:52 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:53.715812 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c1ea4d44-078c-490b-bdcb-47c4d5520c54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:53.716829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c1ea4d44-078c-490b-bdcb-47c4d5520c54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:53.723403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c1ea4d44-078c-490b-bdcb-47c4d5520c54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:53.723845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c1ea4d44-078c-490b-bdcb-47c4d5520c54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:53.724610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c1ea4d44-078c-490b-bdcb-47c4d5520c54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:53.725036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c1ea4d44-078c-490b-bdcb-47c4d5520c54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:53.755146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c1ea4d44-078c-490b-bdcb-47c4d5520c54 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043175 Nov 02 23:21:53.755736 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1453/2028] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:53 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:54.765769 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1edd4bf7-67cd-4e1d-ad02-5dd9784e8f8d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:54.767181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1edd4bf7-67cd-4e1d-ad02-5dd9784e8f8d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:54.773466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1edd4bf7-67cd-4e1d-ad02-5dd9784e8f8d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:54.773912 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1edd4bf7-67cd-4e1d-ad02-5dd9784e8f8d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:54.774670 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1edd4bf7-67cd-4e1d-ad02-5dd9784e8f8d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:54.775152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1edd4bf7-67cd-4e1d-ad02-5dd9784e8f8d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:54.804290 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1edd4bf7-67cd-4e1d-ad02-5dd9784e8f8d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042299 Nov 02 23:21:54.804851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1454/2029] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:54 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:55.815824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-63b687eb-cad5-4bfd-9948-fb4245b41112 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:55.816721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-63b687eb-cad5-4bfd-9948-fb4245b41112 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:55.823231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-63b687eb-cad5-4bfd-9948-fb4245b41112 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:55.823681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-63b687eb-cad5-4bfd-9948-fb4245b41112 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:55.824439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-63b687eb-cad5-4bfd-9948-fb4245b41112 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:55.824871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-63b687eb-cad5-4bfd-9948-fb4245b41112 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:55.854091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-63b687eb-cad5-4bfd-9948-fb4245b41112 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041994 Nov 02 23:21:55.854657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1455/2030] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:55 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:56.865241 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7e3037c9-e96a-4738-818d-a55582a8b75b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:56.866725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7e3037c9-e96a-4738-818d-a55582a8b75b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:56.873956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7e3037c9-e96a-4738-818d-a55582a8b75b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:56.874581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7e3037c9-e96a-4738-818d-a55582a8b75b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:56.875461 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7e3037c9-e96a-4738-818d-a55582a8b75b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:56.876532 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7e3037c9-e96a-4738-818d-a55582a8b75b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:56.913922 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7e3037c9-e96a-4738-818d-a55582a8b75b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052088 Nov 02 23:21:56.914501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1456/2031] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:56 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:57.924411 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-02035194-35a2-48ef-a1cf-ac2ce25dac57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:57.925313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-02035194-35a2-48ef-a1cf-ac2ce25dac57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:57.931523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-02035194-35a2-48ef-a1cf-ac2ce25dac57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:57.931969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-02035194-35a2-48ef-a1cf-ac2ce25dac57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:57.932726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-02035194-35a2-48ef-a1cf-ac2ce25dac57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:57.933157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-02035194-35a2-48ef-a1cf-ac2ce25dac57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:57.963622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-02035194-35a2-48ef-a1cf-ac2ce25dac57 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042871 Nov 02 23:21:57.964005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1457/2032] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:57 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:21:58.975483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6ac1713c-c670-4576-95fe-ef4089a32972 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:21:58.976425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6ac1713c-c670-4576-95fe-ef4089a32972 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:21:58.982819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ac1713c-c670-4576-95fe-ef4089a32972 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:58.983306 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ac1713c-c670-4576-95fe-ef4089a32972 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:58.984080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ac1713c-c670-4576-95fe-ef4089a32972 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:21:58.984514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ac1713c-c670-4576-95fe-ef4089a32972 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:21:59.036109 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6ac1713c-c670-4576-95fe-ef4089a32972 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064128 Nov 02 23:21:59.037154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1458/2033] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:21:58 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:00.048717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-10b6b082-e06e-4304-b053-541438230dc7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:00.049610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-10b6b082-e06e-4304-b053-541438230dc7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:00.055711 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10b6b082-e06e-4304-b053-541438230dc7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:00.056072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10b6b082-e06e-4304-b053-541438230dc7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:00.056827 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10b6b082-e06e-4304-b053-541438230dc7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:00.057253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10b6b082-e06e-4304-b053-541438230dc7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:00.092534 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-10b6b082-e06e-4304-b053-541438230dc7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047830 Nov 02 23:22:00.093097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1459/2034] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:00 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:01.107550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cca4e353-6588-49e5-ac33-53cd3a304107 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:01.108455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cca4e353-6588-49e5-ac33-53cd3a304107 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:01.115114 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cca4e353-6588-49e5-ac33-53cd3a304107 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:01.115562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cca4e353-6588-49e5-ac33-53cd3a304107 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:01.116340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cca4e353-6588-49e5-ac33-53cd3a304107 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:01.116767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cca4e353-6588-49e5-ac33-53cd3a304107 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:01.146534 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cca4e353-6588-49e5-ac33-53cd3a304107 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042717 Nov 02 23:22:01.150409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1460/2035] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:01 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:02.157217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a0e3742c-2a6b-4bbf-bd0f-30a923a3050e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:02.158117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a0e3742c-2a6b-4bbf-bd0f-30a923a3050e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:02.164436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0e3742c-2a6b-4bbf-bd0f-30a923a3050e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:02.164876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0e3742c-2a6b-4bbf-bd0f-30a923a3050e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:02.165649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0e3742c-2a6b-4bbf-bd0f-30a923a3050e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:02.166074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0e3742c-2a6b-4bbf-bd0f-30a923a3050e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:02.195861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a0e3742c-2a6b-4bbf-bd0f-30a923a3050e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042460 Nov 02 23:22:02.196950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1461/2036] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:02 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:03.208437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7a068955-a4f5-43fd-a89d-7e7b025b7da2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:03.209277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7a068955-a4f5-43fd-a89d-7e7b025b7da2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:03.215668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7a068955-a4f5-43fd-a89d-7e7b025b7da2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:03.216122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7a068955-a4f5-43fd-a89d-7e7b025b7da2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:03.216938 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7a068955-a4f5-43fd-a89d-7e7b025b7da2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:03.217387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7a068955-a4f5-43fd-a89d-7e7b025b7da2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:03.246805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7a068955-a4f5-43fd-a89d-7e7b025b7da2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042991 Nov 02 23:22:03.247404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1462/2037] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:03 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:04.258501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2e456c4b-578d-431e-99d3-1d0a940f5e13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:04.259445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2e456c4b-578d-431e-99d3-1d0a940f5e13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:04.265746 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2e456c4b-578d-431e-99d3-1d0a940f5e13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:04.266194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2e456c4b-578d-431e-99d3-1d0a940f5e13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:04.266990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2e456c4b-578d-431e-99d3-1d0a940f5e13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:04.267913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2e456c4b-578d-431e-99d3-1d0a940f5e13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:04.297327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2e456c4b-578d-431e-99d3-1d0a940f5e13 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042622 Nov 02 23:22:04.297896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1463/2038] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:04 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:05.308802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-65d40ee3-7502-4b4a-b40c-1b3ce1f6f24d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:05.309694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-65d40ee3-7502-4b4a-b40c-1b3ce1f6f24d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:05.316732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-65d40ee3-7502-4b4a-b40c-1b3ce1f6f24d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:05.317178 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-65d40ee3-7502-4b4a-b40c-1b3ce1f6f24d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:05.317941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-65d40ee3-7502-4b4a-b40c-1b3ce1f6f24d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:05.318367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-65d40ee3-7502-4b4a-b40c-1b3ce1f6f24d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:05.348301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-65d40ee3-7502-4b4a-b40c-1b3ce1f6f24d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043123 Nov 02 23:22:05.348794 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1464/2039] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:05 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:06.359242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bbcc115e-8763-40a2-9afd-763e4595ab51 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:06.360202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bbcc115e-8763-40a2-9afd-763e4595ab51 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:06.366396 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bbcc115e-8763-40a2-9afd-763e4595ab51 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:06.366847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bbcc115e-8763-40a2-9afd-763e4595ab51 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:06.367639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bbcc115e-8763-40a2-9afd-763e4595ab51 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:06.368066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bbcc115e-8763-40a2-9afd-763e4595ab51 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:06.399211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bbcc115e-8763-40a2-9afd-763e4595ab51 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043642 Nov 02 23:22:06.399780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1465/2040] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:06 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:07.412517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ec8d5825-8514-4fd6-acf9-88e422225e0e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:07.413869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ec8d5825-8514-4fd6-acf9-88e422225e0e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:07.421738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec8d5825-8514-4fd6-acf9-88e422225e0e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:07.422241 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec8d5825-8514-4fd6-acf9-88e422225e0e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:07.423112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec8d5825-8514-4fd6-acf9-88e422225e0e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:07.423600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ec8d5825-8514-4fd6-acf9-88e422225e0e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:07.453259 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ec8d5825-8514-4fd6-acf9-88e422225e0e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046714 Nov 02 23:22:07.453811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1466/2041] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:07 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:08.465586 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b70f75cd-ef1e-48af-b714-ac5079c74eb6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:08.466166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b70f75cd-ef1e-48af-b714-ac5079c74eb6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:08.472486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b70f75cd-ef1e-48af-b714-ac5079c74eb6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:08.472931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b70f75cd-ef1e-48af-b714-ac5079c74eb6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:08.473703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b70f75cd-ef1e-48af-b714-ac5079c74eb6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:08.474137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b70f75cd-ef1e-48af-b714-ac5079c74eb6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:08.503633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b70f75cd-ef1e-48af-b714-ac5079c74eb6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042049 Nov 02 23:22:08.504340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1467/2042] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:08 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:09.514798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2b4cdd32-f530-411e-9a7b-3feb324e39a4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:09.515738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2b4cdd32-f530-411e-9a7b-3feb324e39a4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:09.522382 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b4cdd32-f530-411e-9a7b-3feb324e39a4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:09.522831 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b4cdd32-f530-411e-9a7b-3feb324e39a4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:09.524046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b4cdd32-f530-411e-9a7b-3feb324e39a4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:09.524485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b4cdd32-f530-411e-9a7b-3feb324e39a4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:09.555912 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2b4cdd32-f530-411e-9a7b-3feb324e39a4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044873 Nov 02 23:22:09.556820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1468/2043] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:09 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:10.567890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-854470b0-a573-4827-be52-efa18ca7a3f0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:10.568806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-854470b0-a573-4827-be52-efa18ca7a3f0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:10.575252 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-854470b0-a573-4827-be52-efa18ca7a3f0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:10.575704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-854470b0-a573-4827-be52-efa18ca7a3f0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:10.576488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-854470b0-a573-4827-be52-efa18ca7a3f0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:10.576940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-854470b0-a573-4827-be52-efa18ca7a3f0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:10.610672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-854470b0-a573-4827-be52-efa18ca7a3f0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047081 Nov 02 23:22:10.611496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1469/2044] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:10 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:11.622465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b1fb5cba-9299-4e7c-bcbd-b0e7847444bd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:11.623481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b1fb5cba-9299-4e7c-bcbd-b0e7847444bd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:11.630392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b1fb5cba-9299-4e7c-bcbd-b0e7847444bd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:11.630844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b1fb5cba-9299-4e7c-bcbd-b0e7847444bd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:11.631656 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b1fb5cba-9299-4e7c-bcbd-b0e7847444bd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:11.632596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b1fb5cba-9299-4e7c-bcbd-b0e7847444bd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:11.662797 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b1fb5cba-9299-4e7c-bcbd-b0e7847444bd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043940 Nov 02 23:22:11.663421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1470/2045] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:11 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:12.673848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f1c381a2-2ccc-492e-949c-ae0612a820db tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:12.674749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f1c381a2-2ccc-492e-949c-ae0612a820db tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:12.681683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f1c381a2-2ccc-492e-949c-ae0612a820db tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:12.682130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f1c381a2-2ccc-492e-949c-ae0612a820db tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:12.682902 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f1c381a2-2ccc-492e-949c-ae0612a820db tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:12.683362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f1c381a2-2ccc-492e-949c-ae0612a820db tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:12.712820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f1c381a2-2ccc-492e-949c-ae0612a820db tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042833 Nov 02 23:22:12.713377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1471/2046] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:12 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:13.724525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8dfcbaea-7421-4b23-a9e6-84a063e384fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:13.725441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8dfcbaea-7421-4b23-a9e6-84a063e384fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:13.731954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8dfcbaea-7421-4b23-a9e6-84a063e384fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:13.732406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8dfcbaea-7421-4b23-a9e6-84a063e384fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:13.733188 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8dfcbaea-7421-4b23-a9e6-84a063e384fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:13.733640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8dfcbaea-7421-4b23-a9e6-84a063e384fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:13.766124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8dfcbaea-7421-4b23-a9e6-84a063e384fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046204 Nov 02 23:22:13.766849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1472/2047] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:13 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:14.779312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0442dd01-a27a-49d3-83c9-e5368bb33bb8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:14.780244 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0442dd01-a27a-49d3-83c9-e5368bb33bb8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:14.787106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0442dd01-a27a-49d3-83c9-e5368bb33bb8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:14.787561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0442dd01-a27a-49d3-83c9-e5368bb33bb8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:14.788815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0442dd01-a27a-49d3-83c9-e5368bb33bb8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:14.789378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0442dd01-a27a-49d3-83c9-e5368bb33bb8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:14.822541 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0442dd01-a27a-49d3-83c9-e5368bb33bb8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047478 Nov 02 23:22:14.823789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1473/2048] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:14 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:15.835513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bcf5c3c3-867f-48b1-8be5-686aa8c4f74e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:15.836408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bcf5c3c3-867f-48b1-8be5-686aa8c4f74e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:15.842696 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcf5c3c3-867f-48b1-8be5-686aa8c4f74e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:15.843174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcf5c3c3-867f-48b1-8be5-686aa8c4f74e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:15.843935 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcf5c3c3-867f-48b1-8be5-686aa8c4f74e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:15.844363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcf5c3c3-867f-48b1-8be5-686aa8c4f74e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:15.879569 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bcf5c3c3-867f-48b1-8be5-686aa8c4f74e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049155 Nov 02 23:22:15.880068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1474/2049] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:15 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:16.890317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4b3d0e83-d6a2-46b0-9cc1-75cc3974b540 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:16.891249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4b3d0e83-d6a2-46b0-9cc1-75cc3974b540 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:16.898021 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b3d0e83-d6a2-46b0-9cc1-75cc3974b540 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:16.898464 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b3d0e83-d6a2-46b0-9cc1-75cc3974b540 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:16.899287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b3d0e83-d6a2-46b0-9cc1-75cc3974b540 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:16.899724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b3d0e83-d6a2-46b0-9cc1-75cc3974b540 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:16.929195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4b3d0e83-d6a2-46b0-9cc1-75cc3974b540 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042621 Nov 02 23:22:16.929755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1475/2050] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:16 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:17.940533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-71edec11-1090-4e1f-9c46-d894997c2cef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:17.941506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-71edec11-1090-4e1f-9c46-d894997c2cef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:17.947974 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-71edec11-1090-4e1f-9c46-d894997c2cef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:17.948443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-71edec11-1090-4e1f-9c46-d894997c2cef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:17.949202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-71edec11-1090-4e1f-9c46-d894997c2cef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:17.949631 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-71edec11-1090-4e1f-9c46-d894997c2cef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:17.979064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-71edec11-1090-4e1f-9c46-d894997c2cef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042231 Nov 02 23:22:17.979662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1476/2051] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:17 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:18.991120 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9e189175-fa48-47ef-8363-e5eb8c0dcade tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:18.992054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9e189175-fa48-47ef-8363-e5eb8c0dcade tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:18.998220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e189175-fa48-47ef-8363-e5eb8c0dcade tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:18.998673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e189175-fa48-47ef-8363-e5eb8c0dcade tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:18.999475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e189175-fa48-47ef-8363-e5eb8c0dcade tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:18.999910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e189175-fa48-47ef-8363-e5eb8c0dcade tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:19.030157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9e189175-fa48-47ef-8363-e5eb8c0dcade tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043166 Nov 02 23:22:19.031004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1477/2052] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:18 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:20.041537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a89ee9ce-df63-4998-99d7-99bcd4b50987 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:20.042462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a89ee9ce-df63-4998-99d7-99bcd4b50987 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:20.048628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a89ee9ce-df63-4998-99d7-99bcd4b50987 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:20.049074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a89ee9ce-df63-4998-99d7-99bcd4b50987 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:20.049823 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a89ee9ce-df63-4998-99d7-99bcd4b50987 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:20.050246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a89ee9ce-df63-4998-99d7-99bcd4b50987 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:20.079091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a89ee9ce-df63-4998-99d7-99bcd4b50987 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041266 Nov 02 23:22:20.079646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1478/2053] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:20 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:21.091106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-432bf502-7282-4189-9945-4f6a79118915 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:21.091999 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-432bf502-7282-4189-9945-4f6a79118915 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:21.098686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-432bf502-7282-4189-9945-4f6a79118915 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:21.099164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-432bf502-7282-4189-9945-4f6a79118915 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:21.099926 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-432bf502-7282-4189-9945-4f6a79118915 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:21.100358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-432bf502-7282-4189-9945-4f6a79118915 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:21.129967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-432bf502-7282-4189-9945-4f6a79118915 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042693 Nov 02 23:22:21.130774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1479/2054] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:21 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:22.141508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8d08a8f2-149c-4458-a31f-3f56511538ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:22.142413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8d08a8f2-149c-4458-a31f-3f56511538ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:22.148705 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d08a8f2-149c-4458-a31f-3f56511538ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:22.149155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d08a8f2-149c-4458-a31f-3f56511538ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:22.149917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d08a8f2-149c-4458-a31f-3f56511538ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:22.150349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d08a8f2-149c-4458-a31f-3f56511538ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:22.179942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8d08a8f2-149c-4458-a31f-3f56511538ce tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042179 Nov 02 23:22:22.180486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1480/2055] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:22 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:23.361442 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-db02e57b-20ab-484b-a916-a50aeb22e116 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:23.362368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-db02e57b-20ab-484b-a916-a50aeb22e116 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:23.368790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db02e57b-20ab-484b-a916-a50aeb22e116 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:23.369234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db02e57b-20ab-484b-a916-a50aeb22e116 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:23.369991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db02e57b-20ab-484b-a916-a50aeb22e116 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:23.370419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db02e57b-20ab-484b-a916-a50aeb22e116 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:23.399046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-db02e57b-20ab-484b-a916-a50aeb22e116 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.211594 Nov 02 23:22:23.399598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1481/2056] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:23 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:24.410765 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ddc1ebc4-8c88-43bb-ba96-e462bf8b9979 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:24.411694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ddc1ebc4-8c88-43bb-ba96-e462bf8b9979 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:24.417822 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddc1ebc4-8c88-43bb-ba96-e462bf8b9979 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:24.418262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddc1ebc4-8c88-43bb-ba96-e462bf8b9979 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:24.419050 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddc1ebc4-8c88-43bb-ba96-e462bf8b9979 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:24.419483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddc1ebc4-8c88-43bb-ba96-e462bf8b9979 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:24.447541 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ddc1ebc4-8c88-43bb-ba96-e462bf8b9979 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041032 Nov 02 23:22:24.448086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1482/2057] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:24 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:25.458717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-22504037-c6fe-4714-8a2d-cc700a095220 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:25.459698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-22504037-c6fe-4714-8a2d-cc700a095220 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:25.465806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22504037-c6fe-4714-8a2d-cc700a095220 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:25.466251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22504037-c6fe-4714-8a2d-cc700a095220 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:25.467030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22504037-c6fe-4714-8a2d-cc700a095220 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:25.467453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22504037-c6fe-4714-8a2d-cc700a095220 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:25.496691 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-22504037-c6fe-4714-8a2d-cc700a095220 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041648 Nov 02 23:22:25.497239 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1483/2058] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:25 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:26.508387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e7fd570b-5761-4572-b86a-5507f28ed7a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:26.509291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e7fd570b-5761-4572-b86a-5507f28ed7a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:26.515532 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e7fd570b-5761-4572-b86a-5507f28ed7a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:26.515970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e7fd570b-5761-4572-b86a-5507f28ed7a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:26.516727 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e7fd570b-5761-4572-b86a-5507f28ed7a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:26.517152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e7fd570b-5761-4572-b86a-5507f28ed7a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:26.546045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e7fd570b-5761-4572-b86a-5507f28ed7a6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041345 Nov 02 23:22:26.546617 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1484/2059] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:26 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:27.556962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1510df2f-4aed-4b51-b110-b8c46ba3a1b3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:27.557872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1510df2f-4aed-4b51-b110-b8c46ba3a1b3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:27.564044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1510df2f-4aed-4b51-b110-b8c46ba3a1b3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:27.564496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1510df2f-4aed-4b51-b110-b8c46ba3a1b3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:27.565257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1510df2f-4aed-4b51-b110-b8c46ba3a1b3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:27.565687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1510df2f-4aed-4b51-b110-b8c46ba3a1b3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:27.595298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1510df2f-4aed-4b51-b110-b8c46ba3a1b3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041971 Nov 02 23:22:27.595851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1485/2060] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:27 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:28.606689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-52ac3887-0d6d-432f-bf9c-246f06021131 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:28.607619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-52ac3887-0d6d-432f-bf9c-246f06021131 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:28.614421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52ac3887-0d6d-432f-bf9c-246f06021131 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:28.614860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52ac3887-0d6d-432f-bf9c-246f06021131 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:28.615649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52ac3887-0d6d-432f-bf9c-246f06021131 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:28.616080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52ac3887-0d6d-432f-bf9c-246f06021131 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:28.644602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-52ac3887-0d6d-432f-bf9c-246f06021131 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041088 Nov 02 23:22:28.645156 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1486/2061] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:28 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:29.655952 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1700e698-78a8-4994-9eb2-e45f2b526af0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:29.656841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1700e698-78a8-4994-9eb2-e45f2b526af0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:29.663042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1700e698-78a8-4994-9eb2-e45f2b526af0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:29.663484 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1700e698-78a8-4994-9eb2-e45f2b526af0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:29.664232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1700e698-78a8-4994-9eb2-e45f2b526af0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:29.664653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1700e698-78a8-4994-9eb2-e45f2b526af0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:29.693632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1700e698-78a8-4994-9eb2-e45f2b526af0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041370 Nov 02 23:22:29.694176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1487/2062] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:29 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:30.705447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-14fceb64-98a2-41e1-be62-81bbb3a0f2bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:30.707033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-14fceb64-98a2-41e1-be62-81bbb3a0f2bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:30.713280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14fceb64-98a2-41e1-be62-81bbb3a0f2bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:30.713280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14fceb64-98a2-41e1-be62-81bbb3a0f2bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:30.714002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14fceb64-98a2-41e1-be62-81bbb3a0f2bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:30.714436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14fceb64-98a2-41e1-be62-81bbb3a0f2bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:30.743719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-14fceb64-98a2-41e1-be62-81bbb3a0f2bc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042181 Nov 02 23:22:30.744295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1488/2063] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:30 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:31.755470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-936e4670-4007-4c27-8317-09851e46f9dd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:31.756483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-936e4670-4007-4c27-8317-09851e46f9dd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:31.762698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-936e4670-4007-4c27-8317-09851e46f9dd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:31.763273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-936e4670-4007-4c27-8317-09851e46f9dd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:31.763979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-936e4670-4007-4c27-8317-09851e46f9dd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:31.764411 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-936e4670-4007-4c27-8317-09851e46f9dd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:31.793901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-936e4670-4007-4c27-8317-09851e46f9dd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042176 Nov 02 23:22:31.794454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1489/2064] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:31 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:22:32.805855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b0bf6a26-5ed6-463d-afbd-55e6a094a929 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:32.806759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b0bf6a26-5ed6-463d-afbd-55e6a094a929 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:32.813001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b0bf6a26-5ed6-463d-afbd-55e6a094a929 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:32.813446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b0bf6a26-5ed6-463d-afbd-55e6a094a929 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:32.814212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b0bf6a26-5ed6-463d-afbd-55e6a094a929 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:32.814646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b0bf6a26-5ed6-463d-afbd-55e6a094a929 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:32.843037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b0bf6a26-5ed6-463d-afbd-55e6a094a929 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040914 Nov 02 23:22:32.843588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1490/2065] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:32 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:33.855087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-eb2aa2c9-d6cf-4de1-9e5a-5bfa4edbade7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:33.856019 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-eb2aa2c9-d6cf-4de1-9e5a-5bfa4edbade7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:33.862293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb2aa2c9-d6cf-4de1-9e5a-5bfa4edbade7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:33.863349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb2aa2c9-d6cf-4de1-9e5a-5bfa4edbade7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:33.864117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb2aa2c9-d6cf-4de1-9e5a-5bfa4edbade7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:33.864547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb2aa2c9-d6cf-4de1-9e5a-5bfa4edbade7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:33.893604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-eb2aa2c9-d6cf-4de1-9e5a-5bfa4edbade7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042308 Nov 02 23:22:33.894163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1491/2066] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:33 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:34.905429 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9c4ab3b1-26a3-42d4-a2e5-e2d38c8e07c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:34.906333 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9c4ab3b1-26a3-42d4-a2e5-e2d38c8e07c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:34.913170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c4ab3b1-26a3-42d4-a2e5-e2d38c8e07c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:34.913612 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c4ab3b1-26a3-42d4-a2e5-e2d38c8e07c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:34.914370 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c4ab3b1-26a3-42d4-a2e5-e2d38c8e07c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:34.914800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c4ab3b1-26a3-42d4-a2e5-e2d38c8e07c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:34.942756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9c4ab3b1-26a3-42d4-a2e5-e2d38c8e07c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041114 Nov 02 23:22:34.943326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1492/2067] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:34 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:35.953614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6c1a6b23-e35e-4847-872a-98343a71dc53 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:35.954506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6c1a6b23-e35e-4847-872a-98343a71dc53 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:35.960630 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c1a6b23-e35e-4847-872a-98343a71dc53 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:35.961068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c1a6b23-e35e-4847-872a-98343a71dc53 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:35.961821 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c1a6b23-e35e-4847-872a-98343a71dc53 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:35.962242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c1a6b23-e35e-4847-872a-98343a71dc53 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:35.991106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6c1a6b23-e35e-4847-872a-98343a71dc53 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041193 Nov 02 23:22:35.991644 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1493/2068] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:35 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:37.001306 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6b549c39-8178-4d4e-9d82-d35386381b02 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:37.002204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6b549c39-8178-4d4e-9d82-d35386381b02 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:37.008931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6b549c39-8178-4d4e-9d82-d35386381b02 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:37.009379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6b549c39-8178-4d4e-9d82-d35386381b02 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:37.010134 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6b549c39-8178-4d4e-9d82-d35386381b02 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:37.010560 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6b549c39-8178-4d4e-9d82-d35386381b02 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:37.038582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6b549c39-8178-4d4e-9d82-d35386381b02 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040962 Nov 02 23:22:37.039159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1494/2069] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:36 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:38.049394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1191965c-53bf-4f5f-8f86-52d4ff6403fa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:38.050300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1191965c-53bf-4f5f-8f86-52d4ff6403fa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:38.056630 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1191965c-53bf-4f5f-8f86-52d4ff6403fa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:38.057074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1191965c-53bf-4f5f-8f86-52d4ff6403fa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:38.057834 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1191965c-53bf-4f5f-8f86-52d4ff6403fa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:38.058261 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1191965c-53bf-4f5f-8f86-52d4ff6403fa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:38.088155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1191965c-53bf-4f5f-8f86-52d4ff6403fa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042435 Nov 02 23:22:38.088708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1495/2070] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:38 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:39.099877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6cbd307f-ba68-4be8-a9f8-c1ed9e95311f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:39.100781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6cbd307f-ba68-4be8-a9f8-c1ed9e95311f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:39.107007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6cbd307f-ba68-4be8-a9f8-c1ed9e95311f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:39.107445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6cbd307f-ba68-4be8-a9f8-c1ed9e95311f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:39.108205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6cbd307f-ba68-4be8-a9f8-c1ed9e95311f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:39.108632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6cbd307f-ba68-4be8-a9f8-c1ed9e95311f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:39.137636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6cbd307f-ba68-4be8-a9f8-c1ed9e95311f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041915 Nov 02 23:22:39.138176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1496/2071] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:39 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:40.150035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-63a5aa54-19ea-427e-bf7e-1a6134b5c326 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:40.151176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-63a5aa54-19ea-427e-bf7e-1a6134b5c326 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:40.157420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-63a5aa54-19ea-427e-bf7e-1a6134b5c326 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:40.157867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-63a5aa54-19ea-427e-bf7e-1a6134b5c326 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:40.158632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-63a5aa54-19ea-427e-bf7e-1a6134b5c326 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:40.159107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-63a5aa54-19ea-427e-bf7e-1a6134b5c326 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:40.188052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-63a5aa54-19ea-427e-bf7e-1a6134b5c326 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042282 Nov 02 23:22:40.188616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1497/2072] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:40 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:41.199537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8134ad5d-a649-4d8e-a707-9bb8c5eaa05c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:41.200442 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8134ad5d-a649-4d8e-a707-9bb8c5eaa05c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:41.206883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8134ad5d-a649-4d8e-a707-9bb8c5eaa05c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:41.207370 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8134ad5d-a649-4d8e-a707-9bb8c5eaa05c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:41.208185 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8134ad5d-a649-4d8e-a707-9bb8c5eaa05c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:41.208620 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8134ad5d-a649-4d8e-a707-9bb8c5eaa05c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:41.239128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8134ad5d-a649-4d8e-a707-9bb8c5eaa05c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043482 Nov 02 23:22:41.239709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1498/2073] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:41 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:42.250462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bacd9d04-143b-4702-a419-adcab393c5ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:42.251390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bacd9d04-143b-4702-a419-adcab393c5ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:42.257604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bacd9d04-143b-4702-a419-adcab393c5ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:42.258048 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bacd9d04-143b-4702-a419-adcab393c5ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:42.258801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bacd9d04-143b-4702-a419-adcab393c5ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:42.259256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bacd9d04-143b-4702-a419-adcab393c5ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:42.289055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bacd9d04-143b-4702-a419-adcab393c5ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042306 Nov 02 23:22:42.289635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1499/2074] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:42 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:43.300328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-18fde352-2c20-4ba7-864b-875d4a071fdd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:43.301229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-18fde352-2c20-4ba7-864b-875d4a071fdd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:43.307431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-18fde352-2c20-4ba7-864b-875d4a071fdd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:43.307867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-18fde352-2c20-4ba7-864b-875d4a071fdd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:43.308623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-18fde352-2c20-4ba7-864b-875d4a071fdd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:43.309058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-18fde352-2c20-4ba7-864b-875d4a071fdd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:43.339869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-18fde352-2c20-4ba7-864b-875d4a071fdd tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043175 Nov 02 23:22:43.340364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1500/2075] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:43 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:44.351606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b5ea9db7-f05f-473e-b77f-4d9c2e1ccb22 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:44.352530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b5ea9db7-f05f-473e-b77f-4d9c2e1ccb22 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:44.358748 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5ea9db7-f05f-473e-b77f-4d9c2e1ccb22 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:44.359218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5ea9db7-f05f-473e-b77f-4d9c2e1ccb22 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:44.359966 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5ea9db7-f05f-473e-b77f-4d9c2e1ccb22 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:44.360394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5ea9db7-f05f-473e-b77f-4d9c2e1ccb22 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:44.390427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b5ea9db7-f05f-473e-b77f-4d9c2e1ccb22 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042511 Nov 02 23:22:44.391014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1501/2076] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:44 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:45.402596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f87bb4a5-6414-401d-b549-fdbe75dd0fbf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:45.403518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f87bb4a5-6414-401d-b549-fdbe75dd0fbf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:45.409642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f87bb4a5-6414-401d-b549-fdbe75dd0fbf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:45.410091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f87bb4a5-6414-401d-b549-fdbe75dd0fbf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:45.411767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f87bb4a5-6414-401d-b549-fdbe75dd0fbf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:45.412220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f87bb4a5-6414-401d-b549-fdbe75dd0fbf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:45.442118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f87bb4a5-6414-401d-b549-fdbe75dd0fbf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043163 Nov 02 23:22:45.442676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1502/2077] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:45 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:45.998051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:22:45.998322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:22:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 23:22:46.453398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f3ebd74d-ec30-4d7e-ac53-fdb12ca8402d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:46.455293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f3ebd74d-ec30-4d7e-ac53-fdb12ca8402d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:46.462317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3ebd74d-ec30-4d7e-ac53-fdb12ca8402d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:46.462948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3ebd74d-ec30-4d7e-ac53-fdb12ca8402d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:46.463721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3ebd74d-ec30-4d7e-ac53-fdb12ca8402d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:46.464151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3ebd74d-ec30-4d7e-ac53-fdb12ca8402d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:46.493226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f3ebd74d-ec30-4d7e-ac53-fdb12ca8402d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043577 Nov 02 23:22:46.493781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1503/2078] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:46 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:47.504627 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1bf6850a-d4e5-445a-b0d5-08ac1e84a7c8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:47.505467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1bf6850a-d4e5-445a-b0d5-08ac1e84a7c8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:47.511743 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1bf6850a-d4e5-445a-b0d5-08ac1e84a7c8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:47.512193 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1bf6850a-d4e5-445a-b0d5-08ac1e84a7c8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:47.512962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1bf6850a-d4e5-445a-b0d5-08ac1e84a7c8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:47.513392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1bf6850a-d4e5-445a-b0d5-08ac1e84a7c8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:47.543010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1bf6850a-d4e5-445a-b0d5-08ac1e84a7c8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042147 Nov 02 23:22:47.543561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1504/2079] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:47 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:48.553910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bef0817a-be1e-4176-a13e-7ccc0c8b3309 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:48.554809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bef0817a-be1e-4176-a13e-7ccc0c8b3309 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:48.561652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bef0817a-be1e-4176-a13e-7ccc0c8b3309 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:48.562078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bef0817a-be1e-4176-a13e-7ccc0c8b3309 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:48.562881 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bef0817a-be1e-4176-a13e-7ccc0c8b3309 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:48.563340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bef0817a-be1e-4176-a13e-7ccc0c8b3309 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:48.592932 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bef0817a-be1e-4176-a13e-7ccc0c8b3309 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043355 Nov 02 23:22:48.593489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1505/2080] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:48 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:49.604104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4aa2173b-945f-4560-aa86-7d0975587eb7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:49.605026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4aa2173b-945f-4560-aa86-7d0975587eb7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:49.611216 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4aa2173b-945f-4560-aa86-7d0975587eb7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:49.611662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4aa2173b-945f-4560-aa86-7d0975587eb7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:49.612420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4aa2173b-945f-4560-aa86-7d0975587eb7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:49.612844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4aa2173b-945f-4560-aa86-7d0975587eb7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:49.642383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4aa2173b-945f-4560-aa86-7d0975587eb7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042022 Nov 02 23:22:49.642948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1506/2081] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:49 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:50.653504 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f538b8ef-4ef2-488e-9fa0-97ac6671927d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:50.654432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f538b8ef-4ef2-488e-9fa0-97ac6671927d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:50.660578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f538b8ef-4ef2-488e-9fa0-97ac6671927d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:50.661026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f538b8ef-4ef2-488e-9fa0-97ac6671927d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:50.661791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f538b8ef-4ef2-488e-9fa0-97ac6671927d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:50.662265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f538b8ef-4ef2-488e-9fa0-97ac6671927d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:50.691344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f538b8ef-4ef2-488e-9fa0-97ac6671927d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041501 Nov 02 23:22:50.691900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1507/2082] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:50 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:51.703580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a515a409-4697-4229-a69e-ad3682df18f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:51.704606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a515a409-4697-4229-a69e-ad3682df18f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:51.711554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a515a409-4697-4229-a69e-ad3682df18f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:51.712003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a515a409-4697-4229-a69e-ad3682df18f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:51.712772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a515a409-4697-4229-a69e-ad3682df18f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:51.713209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a515a409-4697-4229-a69e-ad3682df18f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:51.741921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a515a409-4697-4229-a69e-ad3682df18f4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042024 Nov 02 23:22:51.742484 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1508/2083] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:51 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:52.752908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e3a2f35d-9b48-480c-8862-14a6538d6b9f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:52.754494 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e3a2f35d-9b48-480c-8862-14a6538d6b9f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:52.760755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3a2f35d-9b48-480c-8862-14a6538d6b9f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:52.761104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3a2f35d-9b48-480c-8862-14a6538d6b9f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:52.761872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3a2f35d-9b48-480c-8862-14a6538d6b9f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:52.762307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3a2f35d-9b48-480c-8862-14a6538d6b9f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:52.791824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e3a2f35d-9b48-480c-8862-14a6538d6b9f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042660 Nov 02 23:22:52.792372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1509/2084] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:52 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:53.802185 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fbaa8383-b311-4eca-855e-388c3bc7744b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:53.803652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fbaa8383-b311-4eca-855e-388c3bc7744b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:53.809769 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbaa8383-b311-4eca-855e-388c3bc7744b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:53.810211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbaa8383-b311-4eca-855e-388c3bc7744b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:53.810991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbaa8383-b311-4eca-855e-388c3bc7744b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:53.811422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbaa8383-b311-4eca-855e-388c3bc7744b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:53.839812 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fbaa8383-b311-4eca-855e-388c3bc7744b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041311 Nov 02 23:22:53.840406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1510/2085] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:53 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:54.851835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e0adf2f4-01ee-4749-a7f8-a8895b29f60a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:54.852817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e0adf2f4-01ee-4749-a7f8-a8895b29f60a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:54.859098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0adf2f4-01ee-4749-a7f8-a8895b29f60a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:54.859546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0adf2f4-01ee-4749-a7f8-a8895b29f60a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:54.860314 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0adf2f4-01ee-4749-a7f8-a8895b29f60a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:54.860739 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0adf2f4-01ee-4749-a7f8-a8895b29f60a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:54.890049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e0adf2f4-01ee-4749-a7f8-a8895b29f60a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042698 Nov 02 23:22:54.890608 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1511/2086] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:54 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:55.902271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a5e83914-5e0a-46a7-96d0-f67b5e357bae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:55.903749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a5e83914-5e0a-46a7-96d0-f67b5e357bae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:55.910580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5e83914-5e0a-46a7-96d0-f67b5e357bae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:55.911066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5e83914-5e0a-46a7-96d0-f67b5e357bae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:55.911847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5e83914-5e0a-46a7-96d0-f67b5e357bae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:55.912819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5e83914-5e0a-46a7-96d0-f67b5e357bae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:55.940732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a5e83914-5e0a-46a7-96d0-f67b5e357bae tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042724 Nov 02 23:22:55.941274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1512/2087] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:55 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:22:56.952643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5fd3af72-2cc9-416a-a822-234910f1b655 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:56.953590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5fd3af72-2cc9-416a-a822-234910f1b655 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:56.959695 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5fd3af72-2cc9-416a-a822-234910f1b655 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:56.960144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5fd3af72-2cc9-416a-a822-234910f1b655 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:56.960912 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5fd3af72-2cc9-416a-a822-234910f1b655 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:56.961342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5fd3af72-2cc9-416a-a822-234910f1b655 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:56.991636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5fd3af72-2cc9-416a-a822-234910f1b655 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042559 Nov 02 23:22:56.992198 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1513/2088] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:56 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:58.003047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-396740c1-f012-4e0f-aafb-311d54e6a82a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:58.003969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-396740c1-f012-4e0f-aafb-311d54e6a82a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:58.010137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-396740c1-f012-4e0f-aafb-311d54e6a82a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:58.010578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-396740c1-f012-4e0f-aafb-311d54e6a82a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:58.011368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-396740c1-f012-4e0f-aafb-311d54e6a82a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:58.011793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-396740c1-f012-4e0f-aafb-311d54e6a82a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:58.040791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-396740c1-f012-4e0f-aafb-311d54e6a82a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041451 Nov 02 23:22:58.041334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1514/2089] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:57 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:22:59.052180 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-36afb195-8e5f-44b0-969e-05f7242147a8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:22:59.053153 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-36afb195-8e5f-44b0-969e-05f7242147a8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:22:59.059645 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-36afb195-8e5f-44b0-969e-05f7242147a8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:59.060085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-36afb195-8e5f-44b0-969e-05f7242147a8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:59.060886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-36afb195-8e5f-44b0-969e-05f7242147a8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:22:59.061311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-36afb195-8e5f-44b0-969e-05f7242147a8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:22:59.096191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-36afb195-8e5f-44b0-969e-05f7242147a8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047752 Nov 02 23:22:59.096749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1515/2090] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:22:59 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:00.107559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-52a8e82c-b042-4b6c-ab64-20dd514d3ee8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:00.108462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-52a8e82c-b042-4b6c-ab64-20dd514d3ee8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:00.114162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52a8e82c-b042-4b6c-ab64-20dd514d3ee8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:00.114607 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52a8e82c-b042-4b6c-ab64-20dd514d3ee8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:00.115904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52a8e82c-b042-4b6c-ab64-20dd514d3ee8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:00.116335 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52a8e82c-b042-4b6c-ab64-20dd514d3ee8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:00.145157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-52a8e82c-b042-4b6c-ab64-20dd514d3ee8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041413 Nov 02 23:23:00.145918 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1516/2091] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:00 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:01.156952 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8c9b7d83-0904-40a4-aa1b-2fb55b03e529 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:01.157958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8c9b7d83-0904-40a4-aa1b-2fb55b03e529 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:01.164840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c9b7d83-0904-40a4-aa1b-2fb55b03e529 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:01.165293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c9b7d83-0904-40a4-aa1b-2fb55b03e529 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:01.166053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c9b7d83-0904-40a4-aa1b-2fb55b03e529 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:01.166476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c9b7d83-0904-40a4-aa1b-2fb55b03e529 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:01.196477 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8c9b7d83-0904-40a4-aa1b-2fb55b03e529 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043112 Nov 02 23:23:01.196783 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1517/2092] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:01 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:02.213458 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-999104a5-ce5d-46ab-9970-28b785f38f27 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:02.214366 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-999104a5-ce5d-46ab-9970-28b785f38f27 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:02.220447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-999104a5-ce5d-46ab-9970-28b785f38f27 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:02.220894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-999104a5-ce5d-46ab-9970-28b785f38f27 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:02.221671 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-999104a5-ce5d-46ab-9970-28b785f38f27 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:02.222100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-999104a5-ce5d-46ab-9970-28b785f38f27 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:02.252182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-999104a5-ce5d-46ab-9970-28b785f38f27 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048258 Nov 02 23:23:02.252758 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1518/2093] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:02 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:03.264348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c553cd22-c787-4c63-abec-b678ab30c71f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:03.265317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c553cd22-c787-4c63-abec-b678ab30c71f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:03.271620 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c553cd22-c787-4c63-abec-b678ab30c71f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:03.272028 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c553cd22-c787-4c63-abec-b678ab30c71f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:03.273028 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c553cd22-c787-4c63-abec-b678ab30c71f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:03.273211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c553cd22-c787-4c63-abec-b678ab30c71f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:03.303293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c553cd22-c787-4c63-abec-b678ab30c71f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042071 Nov 02 23:23:03.303871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1519/2094] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:03 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:23:04.314777 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-396194d8-493e-4ac5-9b4e-ec42f7760248 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:04.315698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-396194d8-493e-4ac5-9b4e-ec42f7760248 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:04.322216 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-396194d8-493e-4ac5-9b4e-ec42f7760248 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:04.322655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-396194d8-493e-4ac5-9b4e-ec42f7760248 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:04.323454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-396194d8-493e-4ac5-9b4e-ec42f7760248 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:04.323879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-396194d8-493e-4ac5-9b4e-ec42f7760248 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:04.353225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-396194d8-493e-4ac5-9b4e-ec42f7760248 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042105 Nov 02 23:23:04.353788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1520/2095] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:04 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:05.365203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1ac43f7e-81e6-47b1-b2ac-ba2ca71671b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:05.366255 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1ac43f7e-81e6-47b1-b2ac-ba2ca71671b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:05.372492 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ac43f7e-81e6-47b1-b2ac-ba2ca71671b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:05.372962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ac43f7e-81e6-47b1-b2ac-ba2ca71671b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:05.373762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ac43f7e-81e6-47b1-b2ac-ba2ca71671b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:05.374214 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ac43f7e-81e6-47b1-b2ac-ba2ca71671b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:05.403219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1ac43f7e-81e6-47b1-b2ac-ba2ca71671b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042324 Nov 02 23:23:05.403770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1521/2096] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:05 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:06.414988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4ad6ab5e-ed7a-40aa-bd89-e51602401a21 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:06.415987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4ad6ab5e-ed7a-40aa-bd89-e51602401a21 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:06.422559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ad6ab5e-ed7a-40aa-bd89-e51602401a21 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:06.423028 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ad6ab5e-ed7a-40aa-bd89-e51602401a21 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:06.423794 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ad6ab5e-ed7a-40aa-bd89-e51602401a21 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:06.424219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ad6ab5e-ed7a-40aa-bd89-e51602401a21 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:06.452869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4ad6ab5e-ed7a-40aa-bd89-e51602401a21 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042144 Nov 02 23:23:06.453415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1522/2097] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:06 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:23:07.464909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-01210c42-f293-4d91-a606-ec8133db69bf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:07.465844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-01210c42-f293-4d91-a606-ec8133db69bf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:07.472155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-01210c42-f293-4d91-a606-ec8133db69bf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:07.472512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-01210c42-f293-4d91-a606-ec8133db69bf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:07.473261 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-01210c42-f293-4d91-a606-ec8133db69bf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:07.473683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-01210c42-f293-4d91-a606-ec8133db69bf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:07.503646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-01210c42-f293-4d91-a606-ec8133db69bf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042595 Nov 02 23:23:07.504197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1523/2098] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:07 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:08.514855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-73879964-4202-46bd-8113-41efd6e2a2a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:08.515796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-73879964-4202-46bd-8113-41efd6e2a2a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:08.522379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73879964-4202-46bd-8113-41efd6e2a2a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:08.522814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73879964-4202-46bd-8113-41efd6e2a2a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:08.523603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73879964-4202-46bd-8113-41efd6e2a2a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:08.524026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73879964-4202-46bd-8113-41efd6e2a2a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:08.552288 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-73879964-4202-46bd-8113-41efd6e2a2a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041153 Nov 02 23:23:08.552828 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1524/2099] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:08 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:09.563546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8a112975-ac29-4f11-be78-c4ddb2fc6451 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:09.564450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8a112975-ac29-4f11-be78-c4ddb2fc6451 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:09.571385 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a112975-ac29-4f11-be78-c4ddb2fc6451 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:09.571834 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a112975-ac29-4f11-be78-c4ddb2fc6451 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:09.572595 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a112975-ac29-4f11-be78-c4ddb2fc6451 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:09.573026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a112975-ac29-4f11-be78-c4ddb2fc6451 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:09.601766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8a112975-ac29-4f11-be78-c4ddb2fc6451 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041887 Nov 02 23:23:09.602320 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1525/2100] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:09 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:10.613381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5bf03675-a3a9-4c08-a4e1-1d1918139b91 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:10.614345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5bf03675-a3a9-4c08-a4e1-1d1918139b91 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:10.621034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5bf03675-a3a9-4c08-a4e1-1d1918139b91 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:10.621480 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5bf03675-a3a9-4c08-a4e1-1d1918139b91 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:10.622249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5bf03675-a3a9-4c08-a4e1-1d1918139b91 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:10.622684 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5bf03675-a3a9-4c08-a4e1-1d1918139b91 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:10.652194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5bf03675-a3a9-4c08-a4e1-1d1918139b91 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042522 Nov 02 23:23:10.652763 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1526/2101] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:10 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:11.664790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dbc7e4e4-3d2b-4080-9fc2-d68ca9d4cceb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:11.665705 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dbc7e4e4-3d2b-4080-9fc2-d68ca9d4cceb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:11.672075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbc7e4e4-3d2b-4080-9fc2-d68ca9d4cceb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:11.672505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbc7e4e4-3d2b-4080-9fc2-d68ca9d4cceb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:11.673288 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbc7e4e4-3d2b-4080-9fc2-d68ca9d4cceb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:11.673722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbc7e4e4-3d2b-4080-9fc2-d68ca9d4cceb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:11.706547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dbc7e4e4-3d2b-4080-9fc2-d68ca9d4cceb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045938 Nov 02 23:23:11.707693 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1527/2102] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:11 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:12.717421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-af7d5ac8-866e-4fea-845c-e4c42936528d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:12.718346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-af7d5ac8-866e-4fea-845c-e4c42936528d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:12.725426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af7d5ac8-866e-4fea-845c-e4c42936528d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:12.725872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af7d5ac8-866e-4fea-845c-e4c42936528d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:12.726632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af7d5ac8-866e-4fea-845c-e4c42936528d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:12.727094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af7d5ac8-866e-4fea-845c-e4c42936528d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:12.758963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-af7d5ac8-866e-4fea-845c-e4c42936528d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045188 Nov 02 23:23:12.759527 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1528/2103] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:12 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:13.769497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-39f4fbf0-71b3-4a2d-b982-4e0dc4c811bf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:13.770401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-39f4fbf0-71b3-4a2d-b982-4e0dc4c811bf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:13.776779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39f4fbf0-71b3-4a2d-b982-4e0dc4c811bf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:13.777220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39f4fbf0-71b3-4a2d-b982-4e0dc4c811bf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:13.778068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39f4fbf0-71b3-4a2d-b982-4e0dc4c811bf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:13.778390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39f4fbf0-71b3-4a2d-b982-4e0dc4c811bf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:13.808075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-39f4fbf0-71b3-4a2d-b982-4e0dc4c811bf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042279 Nov 02 23:23:13.808778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1529/2104] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:13 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:14.819102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-af512996-931d-4f8e-81a4-ae37bb77f65a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:14.820262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-af512996-931d-4f8e-81a4-ae37bb77f65a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:14.826325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af512996-931d-4f8e-81a4-ae37bb77f65a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:14.826773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af512996-931d-4f8e-81a4-ae37bb77f65a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:14.827580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af512996-931d-4f8e-81a4-ae37bb77f65a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:14.828018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af512996-931d-4f8e-81a4-ae37bb77f65a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:14.861562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-af512996-931d-4f8e-81a4-ae37bb77f65a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046125 Nov 02 23:23:14.862332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1530/2105] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:14 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:15.873522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ad553a29-07fd-48cc-97ba-bbc94879215b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:15.874427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ad553a29-07fd-48cc-97ba-bbc94879215b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:15.881231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad553a29-07fd-48cc-97ba-bbc94879215b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:15.881680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad553a29-07fd-48cc-97ba-bbc94879215b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:15.882452 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad553a29-07fd-48cc-97ba-bbc94879215b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:15.882882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad553a29-07fd-48cc-97ba-bbc94879215b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:15.916281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ad553a29-07fd-48cc-97ba-bbc94879215b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046396 Nov 02 23:23:15.916954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1531/2106] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:15 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:16.928796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-66da1894-398f-499e-bcdd-5eba5315e591 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:16.929732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-66da1894-398f-499e-bcdd-5eba5315e591 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:16.935939 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66da1894-398f-499e-bcdd-5eba5315e591 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:16.936388 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66da1894-398f-499e-bcdd-5eba5315e591 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:16.937162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66da1894-398f-499e-bcdd-5eba5315e591 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:16.937590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66da1894-398f-499e-bcdd-5eba5315e591 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:16.968587 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-66da1894-398f-499e-bcdd-5eba5315e591 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043610 Nov 02 23:23:16.969148 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1532/2107] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:16 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:17.980267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2f94cd8f-4d27-4e80-ab27-9a506c8f4053 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:17.981174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2f94cd8f-4d27-4e80-ab27-9a506c8f4053 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:17.987555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2f94cd8f-4d27-4e80-ab27-9a506c8f4053 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:17.987972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2f94cd8f-4d27-4e80-ab27-9a506c8f4053 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:17.988744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2f94cd8f-4d27-4e80-ab27-9a506c8f4053 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:17.989172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2f94cd8f-4d27-4e80-ab27-9a506c8f4053 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:18.020117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2f94cd8f-4d27-4e80-ab27-9a506c8f4053 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043536 Nov 02 23:23:18.020841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1533/2108] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:17 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:19.031910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-14e59183-64bc-4755-85e5-0e68c0a640fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:19.032804 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-14e59183-64bc-4755-85e5-0e68c0a640fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:19.040235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14e59183-64bc-4755-85e5-0e68c0a640fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:19.040680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14e59183-64bc-4755-85e5-0e68c0a640fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:19.041451 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14e59183-64bc-4755-85e5-0e68c0a640fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:19.041880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14e59183-64bc-4755-85e5-0e68c0a640fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:19.072391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-14e59183-64bc-4755-85e5-0e68c0a640fe tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044187 Nov 02 23:23:19.072949 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1534/2109] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:19 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:20.082569 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-eac63b06-003c-4e24-a37d-a8305c4469d1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:20.083506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-eac63b06-003c-4e24-a37d-a8305c4469d1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:20.089682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eac63b06-003c-4e24-a37d-a8305c4469d1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:20.090132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eac63b06-003c-4e24-a37d-a8305c4469d1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:20.090931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eac63b06-003c-4e24-a37d-a8305c4469d1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:20.091367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eac63b06-003c-4e24-a37d-a8305c4469d1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:20.122443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-eac63b06-003c-4e24-a37d-a8305c4469d1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043540 Nov 02 23:23:20.123060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1535/2110] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:20 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:21.133891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a55bf9f6-22f7-4cf5-a457-90f62c12f1e1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:21.134797 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a55bf9f6-22f7-4cf5-a457-90f62c12f1e1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:21.141160 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a55bf9f6-22f7-4cf5-a457-90f62c12f1e1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:21.141604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a55bf9f6-22f7-4cf5-a457-90f62c12f1e1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:21.142380 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a55bf9f6-22f7-4cf5-a457-90f62c12f1e1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:21.142810 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a55bf9f6-22f7-4cf5-a457-90f62c12f1e1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:21.176484 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a55bf9f6-22f7-4cf5-a457-90f62c12f1e1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046894 Nov 02 23:23:21.177247 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1536/2111] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:21 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:22.188226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d65f624e-b6b4-4e7a-994f-e8949b0bf728 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:22.189127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d65f624e-b6b4-4e7a-994f-e8949b0bf728 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:22.196058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d65f624e-b6b4-4e7a-994f-e8949b0bf728 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:22.196509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d65f624e-b6b4-4e7a-994f-e8949b0bf728 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:22.197274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d65f624e-b6b4-4e7a-994f-e8949b0bf728 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:22.197708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d65f624e-b6b4-4e7a-994f-e8949b0bf728 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:22.230792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d65f624e-b6b4-4e7a-994f-e8949b0bf728 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046255 Nov 02 23:23:22.231604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1537/2112] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:22 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:23.242046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3502f14d-8bf3-4567-9367-6e9a2c3fa7af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:23.242996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3502f14d-8bf3-4567-9367-6e9a2c3fa7af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:23.249931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3502f14d-8bf3-4567-9367-6e9a2c3fa7af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:23.250376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3502f14d-8bf3-4567-9367-6e9a2c3fa7af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:23.251271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3502f14d-8bf3-4567-9367-6e9a2c3fa7af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:23.251700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3502f14d-8bf3-4567-9367-6e9a2c3fa7af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:23.284901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3502f14d-8bf3-4567-9367-6e9a2c3fa7af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047110 Nov 02 23:23:23.285662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1538/2113] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:23 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:24.296844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3e5f6901-d77f-4c98-9c35-4828203adb3b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:24.297740 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3e5f6901-d77f-4c98-9c35-4828203adb3b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:24.304440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e5f6901-d77f-4c98-9c35-4828203adb3b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:24.304883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e5f6901-d77f-4c98-9c35-4828203adb3b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:24.305653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e5f6901-d77f-4c98-9c35-4828203adb3b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:24.306081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e5f6901-d77f-4c98-9c35-4828203adb3b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:24.336583 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3e5f6901-d77f-4c98-9c35-4828203adb3b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043460 Nov 02 23:23:24.337138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1539/2114] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:24 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:25.347437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0755afb9-25c4-4007-8362-3276169acab4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:25.348345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0755afb9-25c4-4007-8362-3276169acab4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:25.354639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0755afb9-25c4-4007-8362-3276169acab4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:25.355124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0755afb9-25c4-4007-8362-3276169acab4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:25.355898 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0755afb9-25c4-4007-8362-3276169acab4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:25.356326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0755afb9-25c4-4007-8362-3276169acab4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:25.386516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0755afb9-25c4-4007-8362-3276169acab4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042799 Nov 02 23:23:25.387139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1540/2115] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:25 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:26.398149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fd2610ef-850a-49b4-a28f-d14d2acefb11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:26.399112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fd2610ef-850a-49b4-a28f-d14d2acefb11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:26.406264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd2610ef-850a-49b4-a28f-d14d2acefb11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:26.406710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd2610ef-850a-49b4-a28f-d14d2acefb11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:26.407528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd2610ef-850a-49b4-a28f-d14d2acefb11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:26.407978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd2610ef-850a-49b4-a28f-d14d2acefb11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:26.441191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fd2610ef-850a-49b4-a28f-d14d2acefb11 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047203 Nov 02 23:23:26.441837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1541/2116] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:26 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:27.452619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7b4669dd-0938-4ec3-b279-35b88c26c5aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:27.453649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7b4669dd-0938-4ec3-b279-35b88c26c5aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:27.459814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7b4669dd-0938-4ec3-b279-35b88c26c5aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:27.460196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7b4669dd-0938-4ec3-b279-35b88c26c5aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:27.460971 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7b4669dd-0938-4ec3-b279-35b88c26c5aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:27.461405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7b4669dd-0938-4ec3-b279-35b88c26c5aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:27.493679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7b4669dd-0938-4ec3-b279-35b88c26c5aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044485 Nov 02 23:23:27.494068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1542/2117] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:27 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:28.504528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-904a9eeb-2eb5-4a26-9ede-f7a741d2cfd1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:28.505431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-904a9eeb-2eb5-4a26-9ede-f7a741d2cfd1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:28.512363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-904a9eeb-2eb5-4a26-9ede-f7a741d2cfd1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:28.512811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-904a9eeb-2eb5-4a26-9ede-f7a741d2cfd1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:28.513772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-904a9eeb-2eb5-4a26-9ede-f7a741d2cfd1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:28.514208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-904a9eeb-2eb5-4a26-9ede-f7a741d2cfd1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:28.544702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-904a9eeb-2eb5-4a26-9ede-f7a741d2cfd1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043921 Nov 02 23:23:28.545275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1543/2118] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:28 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:29.557529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-88c17534-8b3f-4142-bc57-539a1cda9808 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:29.558438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-88c17534-8b3f-4142-bc57-539a1cda9808 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:29.564667 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88c17534-8b3f-4142-bc57-539a1cda9808 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:29.565017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88c17534-8b3f-4142-bc57-539a1cda9808 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:29.565785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88c17534-8b3f-4142-bc57-539a1cda9808 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:29.566211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88c17534-8b3f-4142-bc57-539a1cda9808 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:29.596604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-88c17534-8b3f-4142-bc57-539a1cda9808 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043287 Nov 02 23:23:29.597177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1544/2119] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:29 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:23:30.608221 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e07162e5-1aea-43fe-bd3b-8f708e53f33c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:30.609123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e07162e5-1aea-43fe-bd3b-8f708e53f33c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:30.615652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e07162e5-1aea-43fe-bd3b-8f708e53f33c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:30.616113 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e07162e5-1aea-43fe-bd3b-8f708e53f33c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:30.617085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e07162e5-1aea-43fe-bd3b-8f708e53f33c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:30.617299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e07162e5-1aea-43fe-bd3b-8f708e53f33c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:30.646876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e07162e5-1aea-43fe-bd3b-8f708e53f33c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042448 Nov 02 23:23:30.647479 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1545/2120] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:30 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:31.657420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1a67ac2b-111f-4283-b51c-38c811ad2302 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:31.658336 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1a67ac2b-111f-4283-b51c-38c811ad2302 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:31.665190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a67ac2b-111f-4283-b51c-38c811ad2302 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:31.665645 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a67ac2b-111f-4283-b51c-38c811ad2302 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:31.666422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a67ac2b-111f-4283-b51c-38c811ad2302 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:31.666855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a67ac2b-111f-4283-b51c-38c811ad2302 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:31.697388 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1a67ac2b-111f-4283-b51c-38c811ad2302 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043720 Nov 02 23:23:31.701128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1546/2121] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:31 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:32.711847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f9cc82f1-31cd-41e9-a1d4-c60c54bb9634 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:32.713254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f9cc82f1-31cd-41e9-a1d4-c60c54bb9634 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:32.722825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f9cc82f1-31cd-41e9-a1d4-c60c54bb9634 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:32.723588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f9cc82f1-31cd-41e9-a1d4-c60c54bb9634 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:32.725399 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f9cc82f1-31cd-41e9-a1d4-c60c54bb9634 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:32.726091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f9cc82f1-31cd-41e9-a1d4-c60c54bb9634 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:32.775489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f9cc82f1-31cd-41e9-a1d4-c60c54bb9634 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069887 Nov 02 23:23:32.776203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1547/2122] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:32 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:23:33.787096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2d69c088-16d3-47f8-875c-08b3a958381e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:33.788684 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2d69c088-16d3-47f8-875c-08b3a958381e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:33.794780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d69c088-16d3-47f8-875c-08b3a958381e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:33.795262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d69c088-16d3-47f8-875c-08b3a958381e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:33.796034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d69c088-16d3-47f8-875c-08b3a958381e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:33.796471 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d69c088-16d3-47f8-875c-08b3a958381e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:33.829907 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2d69c088-16d3-47f8-875c-08b3a958381e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046525 Nov 02 23:23:33.830507 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1548/2123] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:33 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:34.842293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cf6f3e59-dcac-4b79-9f4b-3b72bde4ffaf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:34.843302 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cf6f3e59-dcac-4b79-9f4b-3b72bde4ffaf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:34.849266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf6f3e59-dcac-4b79-9f4b-3b72bde4ffaf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:34.849712 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf6f3e59-dcac-4b79-9f4b-3b72bde4ffaf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:34.851000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf6f3e59-dcac-4b79-9f4b-3b72bde4ffaf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:34.851443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf6f3e59-dcac-4b79-9f4b-3b72bde4ffaf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:34.882322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cf6f3e59-dcac-4b79-9f4b-3b72bde4ffaf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043776 Nov 02 23:23:34.882893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1549/2124] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:34 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:35.893405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b63103c1-50e5-4a8a-a920-a49ba9bb86a1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:35.894307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b63103c1-50e5-4a8a-a920-a49ba9bb86a1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:35.901501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b63103c1-50e5-4a8a-a920-a49ba9bb86a1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:35.902367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b63103c1-50e5-4a8a-a920-a49ba9bb86a1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:35.903343 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b63103c1-50e5-4a8a-a920-a49ba9bb86a1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:35.904589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b63103c1-50e5-4a8a-a920-a49ba9bb86a1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:35.936673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b63103c1-50e5-4a8a-a920-a49ba9bb86a1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046945 Nov 02 23:23:35.937248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1550/2125] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:35 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:36.948791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-def3fdf1-81a3-4ad7-aa24-52a4a557b0df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:36.949697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-def3fdf1-81a3-4ad7-aa24-52a4a557b0df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:36.955892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-def3fdf1-81a3-4ad7-aa24-52a4a557b0df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:36.956342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-def3fdf1-81a3-4ad7-aa24-52a4a557b0df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:36.957111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-def3fdf1-81a3-4ad7-aa24-52a4a557b0df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:36.957544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-def3fdf1-81a3-4ad7-aa24-52a4a557b0df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:36.988007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-def3fdf1-81a3-4ad7-aa24-52a4a557b0df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043805 Nov 02 23:23:36.988864 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1551/2126] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:36 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:37.999270 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c0b22e02-0d65-43c3-b72f-c3715e5937e0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:38.000169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c0b22e02-0d65-43c3-b72f-c3715e5937e0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:38.006342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0b22e02-0d65-43c3-b72f-c3715e5937e0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:38.006785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0b22e02-0d65-43c3-b72f-c3715e5937e0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:38.008084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0b22e02-0d65-43c3-b72f-c3715e5937e0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:38.008500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0b22e02-0d65-43c3-b72f-c3715e5937e0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:38.038254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c0b22e02-0d65-43c3-b72f-c3715e5937e0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042684 Nov 02 23:23:38.038837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1552/2127] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:37 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:39.049729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8d61536d-3764-4424-9e7d-aa076bb53550 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:39.050773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8d61536d-3764-4424-9e7d-aa076bb53550 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:39.057615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d61536d-3764-4424-9e7d-aa076bb53550 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:39.058064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d61536d-3764-4424-9e7d-aa076bb53550 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:39.058846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d61536d-3764-4424-9e7d-aa076bb53550 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:39.059301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8d61536d-3764-4424-9e7d-aa076bb53550 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:39.089055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8d61536d-3764-4424-9e7d-aa076bb53550 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043136 Nov 02 23:23:39.089615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1553/2128] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:39 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:40.100389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-255acd74-fe16-4097-9f13-98dbaf226371 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:40.101403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-255acd74-fe16-4097-9f13-98dbaf226371 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:40.107937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-255acd74-fe16-4097-9f13-98dbaf226371 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:40.108389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-255acd74-fe16-4097-9f13-98dbaf226371 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:40.109170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-255acd74-fe16-4097-9f13-98dbaf226371 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:40.109602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-255acd74-fe16-4097-9f13-98dbaf226371 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:40.139372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-255acd74-fe16-4097-9f13-98dbaf226371 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042630 Nov 02 23:23:40.139965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1554/2129] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:40 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:41.150641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-49a952c0-860b-439f-9445-21d21e3983b9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:41.151568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-49a952c0-860b-439f-9445-21d21e3983b9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:41.157797 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-49a952c0-860b-439f-9445-21d21e3983b9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:41.158249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-49a952c0-860b-439f-9445-21d21e3983b9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:41.159037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-49a952c0-860b-439f-9445-21d21e3983b9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:41.159465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-49a952c0-860b-439f-9445-21d21e3983b9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:41.189963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-49a952c0-860b-439f-9445-21d21e3983b9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043067 Nov 02 23:23:41.190517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1555/2130] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:41 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:42.202087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8e63630c-48c9-4f3a-b326-e4af9121dfba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:42.203024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8e63630c-48c9-4f3a-b326-e4af9121dfba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:42.213054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e63630c-48c9-4f3a-b326-e4af9121dfba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:42.213495 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e63630c-48c9-4f3a-b326-e4af9121dfba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:42.214283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e63630c-48c9-4f3a-b326-e4af9121dfba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:42.214714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e63630c-48c9-4f3a-b326-e4af9121dfba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:42.245742 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8e63630c-48c9-4f3a-b326-e4af9121dfba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047205 Nov 02 23:23:42.246309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1556/2131] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:42 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:43.257014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4a57ed81-c9b6-4a6b-ab28-5365ebdbb797 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:43.257911 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4a57ed81-c9b6-4a6b-ab28-5365ebdbb797 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:43.264608 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a57ed81-c9b6-4a6b-ab28-5365ebdbb797 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:43.265054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a57ed81-c9b6-4a6b-ab28-5365ebdbb797 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:43.265822 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a57ed81-c9b6-4a6b-ab28-5365ebdbb797 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:43.266283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a57ed81-c9b6-4a6b-ab28-5365ebdbb797 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:43.295971 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4a57ed81-c9b6-4a6b-ab28-5365ebdbb797 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042648 Nov 02 23:23:43.296441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1557/2132] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:43 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:44.307150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-02f01e1b-108f-47e6-b463-aed9380898b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:44.308267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-02f01e1b-108f-47e6-b463-aed9380898b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:44.314473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-02f01e1b-108f-47e6-b463-aed9380898b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:44.314949 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-02f01e1b-108f-47e6-b463-aed9380898b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:44.315728 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-02f01e1b-108f-47e6-b463-aed9380898b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:44.316155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-02f01e1b-108f-47e6-b463-aed9380898b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:44.346205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-02f01e1b-108f-47e6-b463-aed9380898b8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042687 Nov 02 23:23:44.346610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1558/2133] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:44 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:45.357857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0634b4a7-9749-4a5b-a796-e942b7408148 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:45.358752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0634b4a7-9749-4a5b-a796-e942b7408148 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:45.364985 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0634b4a7-9749-4a5b-a796-e942b7408148 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:45.365426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0634b4a7-9749-4a5b-a796-e942b7408148 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:45.366182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0634b4a7-9749-4a5b-a796-e942b7408148 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:45.366613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0634b4a7-9749-4a5b-a796-e942b7408148 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:45.397014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0634b4a7-9749-4a5b-a796-e942b7408148 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042872 Nov 02 23:23:45.397588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1559/2134] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:45 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:46.408335 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-65d612db-40e3-4d20-ba96-fc9e9e91790a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:46.409278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-65d612db-40e3-4d20-ba96-fc9e9e91790a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:46.415468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-65d612db-40e3-4d20-ba96-fc9e9e91790a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:46.415920 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-65d612db-40e3-4d20-ba96-fc9e9e91790a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:46.416693 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-65d612db-40e3-4d20-ba96-fc9e9e91790a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:46.417129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-65d612db-40e3-4d20-ba96-fc9e9e91790a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:46.452608 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-65d612db-40e3-4d20-ba96-fc9e9e91790a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047921 Nov 02 23:23:46.454571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1560/2135] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:46 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:47.465542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3fc18a37-971c-4194-90a7-f817570c8bdc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:47.466355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3fc18a37-971c-4194-90a7-f817570c8bdc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:47.472572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fc18a37-971c-4194-90a7-f817570c8bdc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:47.473014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fc18a37-971c-4194-90a7-f817570c8bdc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:47.473764 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fc18a37-971c-4194-90a7-f817570c8bdc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:47.474188 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fc18a37-971c-4194-90a7-f817570c8bdc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:47.503848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3fc18a37-971c-4194-90a7-f817570c8bdc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042663 Nov 02 23:23:47.504404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1561/2136] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:47 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:48.515358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-eb915dad-b769-4031-b8a1-b4464a352c6a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:48.516312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-eb915dad-b769-4031-b8a1-b4464a352c6a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:48.522485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb915dad-b769-4031-b8a1-b4464a352c6a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:48.522942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb915dad-b769-4031-b8a1-b4464a352c6a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:48.523705 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb915dad-b769-4031-b8a1-b4464a352c6a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:48.524131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb915dad-b769-4031-b8a1-b4464a352c6a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:48.553339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-eb915dad-b769-4031-b8a1-b4464a352c6a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041739 Nov 02 23:23:48.553891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1562/2137] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:48 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:49.564714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-78b6d4df-c599-4ca6-9325-e5f3194fd181 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:49.565613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-78b6d4df-c599-4ca6-9325-e5f3194fd181 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:49.572948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78b6d4df-c599-4ca6-9325-e5f3194fd181 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:49.573383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78b6d4df-c599-4ca6-9325-e5f3194fd181 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:49.574139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78b6d4df-c599-4ca6-9325-e5f3194fd181 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:49.574572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78b6d4df-c599-4ca6-9325-e5f3194fd181 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:49.603123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-78b6d4df-c599-4ca6-9325-e5f3194fd181 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042020 Nov 02 23:23:49.603685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1563/2138] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:49 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:50.614682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5ae8cb64-9c4b-4d38-84af-cca2808c4b4d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:50.615599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5ae8cb64-9c4b-4d38-84af-cca2808c4b4d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:50.622078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ae8cb64-9c4b-4d38-84af-cca2808c4b4d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:50.622524 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ae8cb64-9c4b-4d38-84af-cca2808c4b4d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:50.623304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ae8cb64-9c4b-4d38-84af-cca2808c4b4d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:50.623907 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ae8cb64-9c4b-4d38-84af-cca2808c4b4d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:50.653951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5ae8cb64-9c4b-4d38-84af-cca2808c4b4d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042999 Nov 02 23:23:50.654514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1564/2139] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:50 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:51.666311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-073c060f-71c8-43ec-bb64-364d4075a3a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:51.667230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-073c060f-71c8-43ec-bb64-364d4075a3a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:51.673566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-073c060f-71c8-43ec-bb64-364d4075a3a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:51.674010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-073c060f-71c8-43ec-bb64-364d4075a3a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:51.674767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-073c060f-71c8-43ec-bb64-364d4075a3a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:51.675233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-073c060f-71c8-43ec-bb64-364d4075a3a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:51.705342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-073c060f-71c8-43ec-bb64-364d4075a3a3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043295 Nov 02 23:23:51.705902 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1565/2140] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:51 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:52.716957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ea46ea88-71d6-41f5-9b46-a9c28f70aa7b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:52.717853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ea46ea88-71d6-41f5-9b46-a9c28f70aa7b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:52.724263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea46ea88-71d6-41f5-9b46-a9c28f70aa7b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:52.725238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea46ea88-71d6-41f5-9b46-a9c28f70aa7b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:52.725443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea46ea88-71d6-41f5-9b46-a9c28f70aa7b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:52.725865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea46ea88-71d6-41f5-9b46-a9c28f70aa7b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:52.755929 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ea46ea88-71d6-41f5-9b46-a9c28f70aa7b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042667 Nov 02 23:23:52.761665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1566/2141] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:52 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:53.768257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9ab38f97-a78b-4eba-8c42-3a8a1601f220 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:53.769161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9ab38f97-a78b-4eba-8c42-3a8a1601f220 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:53.776057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ab38f97-a78b-4eba-8c42-3a8a1601f220 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:53.776504 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ab38f97-a78b-4eba-8c42-3a8a1601f220 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:53.777281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ab38f97-a78b-4eba-8c42-3a8a1601f220 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:53.777711 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ab38f97-a78b-4eba-8c42-3a8a1601f220 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:53.806343 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9ab38f97-a78b-4eba-8c42-3a8a1601f220 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041920 Nov 02 23:23:53.807150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1567/2142] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:53 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:54.817496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d62631ab-fda3-43a0-b8ee-8d83e01f2891 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:54.818324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d62631ab-fda3-43a0-b8ee-8d83e01f2891 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:54.825876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d62631ab-fda3-43a0-b8ee-8d83e01f2891 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:54.826325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d62631ab-fda3-43a0-b8ee-8d83e01f2891 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:54.827138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d62631ab-fda3-43a0-b8ee-8d83e01f2891 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:54.827572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d62631ab-fda3-43a0-b8ee-8d83e01f2891 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:54.855910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d62631ab-fda3-43a0-b8ee-8d83e01f2891 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042129 Nov 02 23:23:54.856458 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1568/2143] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:54 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:23:55.867154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d314c6ec-b8ea-46b4-8f58-bec863b8ca0b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:55.868078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d314c6ec-b8ea-46b4-8f58-bec863b8ca0b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:55.874145 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d314c6ec-b8ea-46b4-8f58-bec863b8ca0b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:55.874586 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d314c6ec-b8ea-46b4-8f58-bec863b8ca0b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:55.875775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d314c6ec-b8ea-46b4-8f58-bec863b8ca0b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:55.876017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d314c6ec-b8ea-46b4-8f58-bec863b8ca0b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:55.905649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d314c6ec-b8ea-46b4-8f58-bec863b8ca0b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042171 Nov 02 23:23:55.906194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1569/2144] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:55 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:56.755539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:23:56.755815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:23:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 23:23:56.917587 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c719450b-f636-4667-9a0e-7fc02422005f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:56.918490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c719450b-f636-4667-9a0e-7fc02422005f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:56.924720 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c719450b-f636-4667-9a0e-7fc02422005f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:56.925170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c719450b-f636-4667-9a0e-7fc02422005f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:56.925937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c719450b-f636-4667-9a0e-7fc02422005f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:56.926369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c719450b-f636-4667-9a0e-7fc02422005f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:56.956894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c719450b-f636-4667-9a0e-7fc02422005f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043576 Nov 02 23:23:56.957457 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1570/2145] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:56 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:57.020411 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e594e8c8-092a-4a30-ba0a-1b3e84b407f0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:57.020904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e594e8c8-092a-4a30-ba0a-1b3e84b407f0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:57.027296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e594e8c8-092a-4a30-ba0a-1b3e84b407f0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:57.027737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e594e8c8-092a-4a30-ba0a-1b3e84b407f0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:57.028532 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e594e8c8-092a-4a30-ba0a-1b3e84b407f0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:57.028959 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e594e8c8-092a-4a30-ba0a-1b3e84b407f0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:57.053203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e594e8c8-092a-4a30-ba0a-1b3e84b407f0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Going to try to terminate instance {{(pid=115800) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 23:23:57.129922 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e594e8c8-092a-4a30-ba0a-1b3e84b407f0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "DELETE /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 204 len: 0 microversion: 2.1 time: 0.112724 Nov 02 23:23:57.130538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1571/2146] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:23:57 2021] DELETE /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 23:23:57.139345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bcd10ed4-3ba3-4a28-9da6-7bc7f0e9a0e3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:57.140042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bcd10ed4-3ba3-4a28-9da6-7bc7f0e9a0e3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:57.146073 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcd10ed4-3ba3-4a28-9da6-7bc7f0e9a0e3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:57.147844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcd10ed4-3ba3-4a28-9da6-7bc7f0e9a0e3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:57.147844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcd10ed4-3ba3-4a28-9da6-7bc7f0e9a0e3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:57.147844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcd10ed4-3ba3-4a28-9da6-7bc7f0e9a0e3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:57.333199 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bcd10ed4-3ba3-4a28-9da6-7bc7f0e9a0e3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:23:57.341608 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bcd10ed4-3ba3-4a28-9da6-7bc7f0e9a0e3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.206445 Nov 02 23:23:57.342246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1572/2147] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:23:57 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:23:57.649087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:23:57.649895 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:23:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 23:23:57.967801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d3da0af4-ffb7-4724-b46e-94474deb061d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:57.968942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d3da0af4-ffb7-4724-b46e-94474deb061d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:57.975256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3da0af4-ffb7-4724-b46e-94474deb061d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:57.975708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3da0af4-ffb7-4724-b46e-94474deb061d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:57.976685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3da0af4-ffb7-4724-b46e-94474deb061d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:57.977126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3da0af4-ffb7-4724-b46e-94474deb061d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:58.007078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d3da0af4-ffb7-4724-b46e-94474deb061d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042954 Nov 02 23:23:58.007635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1573/2148] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:57 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:23:58.363487 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e285fbb0-71ad-4cdf-9039-007762b0481a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:58.364032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e285fbb0-71ad-4cdf-9039-007762b0481a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:58.369838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e285fbb0-71ad-4cdf-9039-007762b0481a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:58.370280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e285fbb0-71ad-4cdf-9039-007762b0481a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:58.371121 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e285fbb0-71ad-4cdf-9039-007762b0481a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:58.371554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e285fbb0-71ad-4cdf-9039-007762b0481a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:58.497784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e285fbb0-71ad-4cdf-9039-007762b0481a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:23:58.505483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e285fbb0-71ad-4cdf-9039-007762b0481a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.145841 Nov 02 23:23:58.506041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1574/2149] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:23:58 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:23:59.018977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-30c09812-35ba-48a0-9186-74f9f72fe5b3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:59.019913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-30c09812-35ba-48a0-9186-74f9f72fe5b3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:59.027460 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30c09812-35ba-48a0-9186-74f9f72fe5b3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:59.027904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30c09812-35ba-48a0-9186-74f9f72fe5b3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:59.028669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30c09812-35ba-48a0-9186-74f9f72fe5b3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:59.029094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30c09812-35ba-48a0-9186-74f9f72fe5b3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:59.059242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-30c09812-35ba-48a0-9186-74f9f72fe5b3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043924 Nov 02 23:23:59.059790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1575/2150] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:23:59 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:23:59.063844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6525f624-06f3-41ba-9db6-988070ae8504 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:59.064322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6525f624-06f3-41ba-9db6-988070ae8504 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:59.069851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6525f624-06f3-41ba-9db6-988070ae8504 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:59.070298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6525f624-06f3-41ba-9db6-988070ae8504 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:59.071580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6525f624-06f3-41ba-9db6-988070ae8504 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:59.072010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6525f624-06f3-41ba-9db6-988070ae8504 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:59.095504 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6525f624-06f3-41ba-9db6-988070ae8504 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Going to try to terminate instance {{(pid=115800) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 23:23:59.176562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6525f624-06f3-41ba-9db6-988070ae8504 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 204 len: 0 microversion: 2.1 time: 0.115415 Nov 02 23:23:59.177295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1576/2151] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:23:59 2021] DELETE /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 23:23:59.186033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1c09f69f-4824-4b72-a8c5-efcbf543b494 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:59.186655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1c09f69f-4824-4b72-a8c5-efcbf543b494 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:59.192432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c09f69f-4824-4b72-a8c5-efcbf543b494 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:59.192868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c09f69f-4824-4b72-a8c5-efcbf543b494 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:59.193629 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c09f69f-4824-4b72-a8c5-efcbf543b494 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:59.194099 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c09f69f-4824-4b72-a8c5-efcbf543b494 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:59.332195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1c09f69f-4824-4b72-a8c5-efcbf543b494 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e66db1e6e4d65a151470af0fd6615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cae71da96545c8b527cdec8f41fdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:23:59.339511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1c09f69f-4824-4b72-a8c5-efcbf543b494 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 200 len: 1555 microversion: 2.1 time: 0.157346 Nov 02 23:23:59.340065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1577/2152] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:23:59 2021] GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:23:59.522606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-eaef1c95-3804-4d3e-8d5f-681a57939220 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:23:59.523264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-eaef1c95-3804-4d3e-8d5f-681a57939220 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:23:59.528967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eaef1c95-3804-4d3e-8d5f-681a57939220 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:59.529412 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eaef1c95-3804-4d3e-8d5f-681a57939220 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:59.530161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eaef1c95-3804-4d3e-8d5f-681a57939220 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:23:59.530588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eaef1c95-3804-4d3e-8d5f-681a57939220 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:23:59.658093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-eaef1c95-3804-4d3e-8d5f-681a57939220 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:23:59.666276 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-eaef1c95-3804-4d3e-8d5f-681a57939220 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.147289 Nov 02 23:23:59.666832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1578/2153] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:23:59 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:00.070736 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c7f1785a-8ea1-427c-ad37-63749a294030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:00.071662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c7f1785a-8ea1-427c-ad37-63749a294030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:00.077424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7f1785a-8ea1-427c-ad37-63749a294030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:00.077859 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7f1785a-8ea1-427c-ad37-63749a294030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:00.078613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7f1785a-8ea1-427c-ad37-63749a294030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:00.079068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7f1785a-8ea1-427c-ad37-63749a294030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:00.108085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c7f1785a-8ea1-427c-ad37-63749a294030 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041476 Nov 02 23:24:00.108619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1579/2154] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:00 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:24:00.356695 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2a7a6e74-4dc5-4efe-b479-38752c360e34 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:00.357300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2a7a6e74-4dc5-4efe-b479-38752c360e34 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:00.363284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a7a6e74-4dc5-4efe-b479-38752c360e34 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:00.363694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a7a6e74-4dc5-4efe-b479-38752c360e34 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:00.364455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a7a6e74-4dc5-4efe-b479-38752c360e34 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:00.364876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a7a6e74-4dc5-4efe-b479-38752c360e34 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:00.495981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2a7a6e74-4dc5-4efe-b479-38752c360e34 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3e66db1e6e4d65a151470af0fd6615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26cae71da96545c8b527cdec8f41fdb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:00.503326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2a7a6e74-4dc5-4efe-b479-38752c360e34 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 200 len: 1555 microversion: 2.1 time: 0.150164 Nov 02 23:24:00.504019 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1580/2155] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:00 2021] GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:00.685065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-747dac20-dcf1-4006-87df-b8e88972d2e8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:00.685897 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-747dac20-dcf1-4006-87df-b8e88972d2e8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:00.694862 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-747dac20-dcf1-4006-87df-b8e88972d2e8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:00.695354 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-747dac20-dcf1-4006-87df-b8e88972d2e8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:00.696795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-747dac20-dcf1-4006-87df-b8e88972d2e8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:00.697230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-747dac20-dcf1-4006-87df-b8e88972d2e8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:00.834208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-747dac20-dcf1-4006-87df-b8e88972d2e8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:00.842312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-747dac20-dcf1-4006-87df-b8e88972d2e8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.162767 Nov 02 23:24:00.842883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1581/2156] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:00 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:00.899565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-cae47798-e586-4f18-82dd-d428c60c31c6 req-9433fb3a-fcce-4601-ae9b-a435399f4b0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd3c0a6-a083-498f-af1d-564f9e455712", "name": "network-vif-deleted", "tag": "1a56d8fd-f9cb-4bd2-adbb-88916a2de5a4"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:24:00.901140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:24:00.901140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:24:00.908211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-cae47798-e586-4f18-82dd-d428c60c31c6 req-9433fb3a-fcce-4601-ae9b-a435399f4b0b service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:00.908648 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-cae47798-e586-4f18-82dd-d428c60c31c6 req-9433fb3a-fcce-4601-ae9b-a435399f4b0b service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:00.919249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-cae47798-e586-4f18-82dd-d428c60c31c6 req-9433fb3a-fcce-4601-ae9b-a435399f4b0b service nova] Creating event network-vif-deleted:1a56d8fd-f9cb-4bd2-adbb-88916a2de5a4 for instance 3cd3c0a6-a083-498f-af1d-564f9e455712 on hv-cinder-81584 Nov 02 23:24:00.924240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-cae47798-e586-4f18-82dd-d428c60c31c6 req-9433fb3a-fcce-4601-ae9b-a435399f4b0b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080144 Nov 02 23:24:00.924998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1582/2157] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:24:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:24:01.120658 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-83e1ef33-2856-44ba-bbd1-27d0ac9b011e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:01.121649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-83e1ef33-2856-44ba-bbd1-27d0ac9b011e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:01.128159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83e1ef33-2856-44ba-bbd1-27d0ac9b011e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:01.128603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83e1ef33-2856-44ba-bbd1-27d0ac9b011e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:01.129400 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83e1ef33-2856-44ba-bbd1-27d0ac9b011e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:01.129839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83e1ef33-2856-44ba-bbd1-27d0ac9b011e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:01.159220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-83e1ef33-2856-44ba-bbd1-27d0ac9b011e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043121 Nov 02 23:24:01.160072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1583/2158] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:01 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:24:01.519979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dbb044c8-d350-4b3c-b6bc-d80af85f8148 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:01.520572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dbb044c8-d350-4b3c-b6bc-d80af85f8148 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] [instance: 3cd3c0a6-a083-498f-af1d-564f9e455712] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:01.526882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbb044c8-d350-4b3c-b6bc-d80af85f8148 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:01.527349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbb044c8-d350-4b3c-b6bc-d80af85f8148 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:01.528100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbb044c8-d350-4b3c-b6bc-d80af85f8148 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:01.528525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbb044c8-d350-4b3c-b6bc-d80af85f8148 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:01.541876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-dbb044c8-d350-4b3c-b6bc-d80af85f8148 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] HTTP exception thrown: Instance 3cd3c0a6-a083-498f-af1d-564f9e455712 could not be found. Nov 02 23:24:01.542455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dbb044c8-d350-4b3c-b6bc-d80af85f8148 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Returning 404 to user: Instance 3cd3c0a6-a083-498f-af1d-564f9e455712 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:24:01.543300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dbb044c8-d350-4b3c-b6bc-d80af85f8148 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712" status: 404 len: 111 microversion: 2.1 time: 0.026884 Nov 02 23:24:01.543818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1584/2159] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:01 2021] GET /compute/v2.1/servers/3cd3c0a6-a083-498f-af1d-564f9e455712 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 23:24:01.551375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8a8570f2-ce71-45ac-baf3-5fbade904522 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] Calling method '.version_select at 0x7fd8583618b0>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:01.571176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8a8570f2-ce71-45ac-baf3-5fbade904522 tempest-TestMinimumBasicScenario-1722770246 tempest-TestMinimumBasicScenario-1722770246-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1720955239" status: 202 len: 0 microversion: 2.1 time: 0.023006 Nov 02 23:24:01.571727 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1585/2160] 10.222.0.41 () {58 vars in 1271 bytes} [Tue Nov 2 23:24:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1720955239 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:24:01.859283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d42e01ef-4537-4232-953f-48b3a6017688 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:01.859807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d42e01ef-4537-4232-953f-48b3a6017688 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:01.865430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d42e01ef-4537-4232-953f-48b3a6017688 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:01.865876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d42e01ef-4537-4232-953f-48b3a6017688 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:01.866636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d42e01ef-4537-4232-953f-48b3a6017688 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:01.867095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d42e01ef-4537-4232-953f-48b3a6017688 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:01.997924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d42e01ef-4537-4232-953f-48b3a6017688 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:02.009759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d42e01ef-4537-4232-953f-48b3a6017688 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.153956 Nov 02 23:24:02.012922 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1586/2161] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:01 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:02.170869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-af74795a-0d79-4446-9b7a-fafd57f211ef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:02.171795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-af74795a-0d79-4446-9b7a-fafd57f211ef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:02.178323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af74795a-0d79-4446-9b7a-fafd57f211ef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:02.178763 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af74795a-0d79-4446-9b7a-fafd57f211ef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:02.179567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af74795a-0d79-4446-9b7a-fafd57f211ef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:02.179992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af74795a-0d79-4446-9b7a-fafd57f211ef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:02.218257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-af74795a-0d79-4446-9b7a-fafd57f211ef tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051088 Nov 02 23:24:02.218863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1587/2162] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:02 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:24:03.027221 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d98b996c-de35-40f8-927b-dbdc1b69c79d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:03.027921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d98b996c-de35-40f8-927b-dbdc1b69c79d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:03.033953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d98b996c-de35-40f8-927b-dbdc1b69c79d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:03.034398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d98b996c-de35-40f8-927b-dbdc1b69c79d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:03.035361 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d98b996c-de35-40f8-927b-dbdc1b69c79d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:03.035677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d98b996c-de35-40f8-927b-dbdc1b69c79d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:03.168203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d98b996c-de35-40f8-927b-dbdc1b69c79d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:03.176100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d98b996c-de35-40f8-927b-dbdc1b69c79d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.153064 Nov 02 23:24:03.176717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1588/2163] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:03 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:03.230165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-52bc2871-ee9b-42b4-9262-17126afe7210 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:03.231191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-52bc2871-ee9b-42b4-9262-17126afe7210 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:03.237544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52bc2871-ee9b-42b4-9262-17126afe7210 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:03.237988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52bc2871-ee9b-42b4-9262-17126afe7210 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:03.238758 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52bc2871-ee9b-42b4-9262-17126afe7210 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:03.239218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52bc2871-ee9b-42b4-9262-17126afe7210 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:03.268184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-52bc2871-ee9b-42b4-9262-17126afe7210 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042411 Nov 02 23:24:03.268745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1589/2164] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:03 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 23:24:04.193455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-346add4b-afb5-4bac-84fa-0ebf3a08848b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:04.195093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-346add4b-afb5-4bac-84fa-0ebf3a08848b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:04.202036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-346add4b-afb5-4bac-84fa-0ebf3a08848b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:04.202699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-346add4b-afb5-4bac-84fa-0ebf3a08848b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:04.203380 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-346add4b-afb5-4bac-84fa-0ebf3a08848b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:04.206476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-346add4b-afb5-4bac-84fa-0ebf3a08848b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:04.465891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-346add4b-afb5-4bac-84fa-0ebf3a08848b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:04.474216 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-346add4b-afb5-4bac-84fa-0ebf3a08848b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.285044 Nov 02 23:24:04.488660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1590/2165] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:04 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:04.499760 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3b03f143-f61d-417e-8e8d-0ca62844905c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:04.501152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3b03f143-f61d-417e-8e8d-0ca62844905c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:04.511034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b03f143-f61d-417e-8e8d-0ca62844905c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:04.511947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b03f143-f61d-417e-8e8d-0ca62844905c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:04.512960 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b03f143-f61d-417e-8e8d-0ca62844905c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:04.513601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b03f143-f61d-417e-8e8d-0ca62844905c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:04.545063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3b03f143-f61d-417e-8e8d-0ca62844905c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054686 Nov 02 23:24:04.546111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1591/2166] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:04 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:05.494868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d79921ac-f821-4b93-ac10-ce0b94d990e0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:05.495606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d79921ac-f821-4b93-ac10-ce0b94d990e0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:05.501778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d79921ac-f821-4b93-ac10-ce0b94d990e0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:05.502220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d79921ac-f821-4b93-ac10-ce0b94d990e0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:05.503010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d79921ac-f821-4b93-ac10-ce0b94d990e0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:05.503438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d79921ac-f821-4b93-ac10-ce0b94d990e0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:05.720732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d79921ac-f821-4b93-ac10-ce0b94d990e0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:05.730318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d79921ac-f821-4b93-ac10-ce0b94d990e0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.239004 Nov 02 23:24:05.731189 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1592/2167] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:05 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:05.736187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6aaa9cd1-c4cf-41bc-a8d6-dbff6f0d890a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:05.737092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6aaa9cd1-c4cf-41bc-a8d6-dbff6f0d890a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:05.743052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6aaa9cd1-c4cf-41bc-a8d6-dbff6f0d890a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:05.743497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6aaa9cd1-c4cf-41bc-a8d6-dbff6f0d890a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:05.744476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6aaa9cd1-c4cf-41bc-a8d6-dbff6f0d890a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:05.744912 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6aaa9cd1-c4cf-41bc-a8d6-dbff6f0d890a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:05.781443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6aaa9cd1-c4cf-41bc-a8d6-dbff6f0d890a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048886 Nov 02 23:24:05.782373 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1593/2168] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:05 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:06.752644 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7761d640-f4e3-4b45-be13-4466ae28fe90 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:06.752644 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7761d640-f4e3-4b45-be13-4466ae28fe90 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:06.754561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7761d640-f4e3-4b45-be13-4466ae28fe90 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:06.755037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7761d640-f4e3-4b45-be13-4466ae28fe90 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:06.755802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7761d640-f4e3-4b45-be13-4466ae28fe90 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:06.756225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7761d640-f4e3-4b45-be13-4466ae28fe90 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:07.027548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7761d640-f4e3-4b45-be13-4466ae28fe90 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:07.035881 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7761d640-f4e3-4b45-be13-4466ae28fe90 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.292303 Nov 02 23:24:07.036749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1594/2169] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:06 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:07.042842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3b4d84d9-a5a4-467c-b489-a83ea6eaedd1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:07.043906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3b4d84d9-a5a4-467c-b489-a83ea6eaedd1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:07.049916 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b4d84d9-a5a4-467c-b489-a83ea6eaedd1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:07.050367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b4d84d9-a5a4-467c-b489-a83ea6eaedd1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:07.051201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b4d84d9-a5a4-467c-b489-a83ea6eaedd1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:07.051758 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b4d84d9-a5a4-467c-b489-a83ea6eaedd1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:07.082989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3b4d84d9-a5a4-467c-b489-a83ea6eaedd1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044412 Nov 02 23:24:07.083554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1595/2170] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:07 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:08.056451 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ba8cc7bc-7d76-4a13-929e-8c51c8b97f9b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:08.057211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ba8cc7bc-7d76-4a13-929e-8c51c8b97f9b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:08.063782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ba8cc7bc-7d76-4a13-929e-8c51c8b97f9b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:08.064229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ba8cc7bc-7d76-4a13-929e-8c51c8b97f9b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:08.065273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ba8cc7bc-7d76-4a13-929e-8c51c8b97f9b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:08.065715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ba8cc7bc-7d76-4a13-929e-8c51c8b97f9b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:08.216337 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ba8cc7bc-7d76-4a13-929e-8c51c8b97f9b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:08.224319 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ba8cc7bc-7d76-4a13-929e-8c51c8b97f9b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.172093 Nov 02 23:24:08.224913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1596/2171] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:08 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:24:08.230184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2ee5799b-7ecf-4d4a-b113-120dac4f6459 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:08.231117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2ee5799b-7ecf-4d4a-b113-120dac4f6459 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:08.237328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ee5799b-7ecf-4d4a-b113-120dac4f6459 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:08.238018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ee5799b-7ecf-4d4a-b113-120dac4f6459 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:08.238994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ee5799b-7ecf-4d4a-b113-120dac4f6459 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:08.239574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ee5799b-7ecf-4d4a-b113-120dac4f6459 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:08.270387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2ee5799b-7ecf-4d4a-b113-120dac4f6459 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044225 Nov 02 23:24:08.271168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1597/2172] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:08 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:09.246958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3a9674be-d904-4d64-815c-5265d8175c54 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:09.247727 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3a9674be-d904-4d64-815c-5265d8175c54 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:09.258895 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a9674be-d904-4d64-815c-5265d8175c54 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:09.259379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a9674be-d904-4d64-815c-5265d8175c54 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:09.260147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a9674be-d904-4d64-815c-5265d8175c54 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:09.260571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a9674be-d904-4d64-815c-5265d8175c54 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:09.404177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3a9674be-d904-4d64-815c-5265d8175c54 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:09.413237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3a9674be-d904-4d64-815c-5265d8175c54 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.170753 Nov 02 23:24:09.423095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1598/2173] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:09 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:09.423095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-48589ec7-2e32-44c1-bd6a-d001de234e5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:09.423095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-48589ec7-2e32-44c1-bd6a-d001de234e5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:09.431698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48589ec7-2e32-44c1-bd6a-d001de234e5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:09.432688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48589ec7-2e32-44c1-bd6a-d001de234e5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:09.433937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48589ec7-2e32-44c1-bd6a-d001de234e5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:09.434506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48589ec7-2e32-44c1-bd6a-d001de234e5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:09.472993 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-48589ec7-2e32-44c1-bd6a-d001de234e5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056718 Nov 02 23:24:09.473782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1599/2174] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:09 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:10.431222 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-15c513f2-8b45-473c-9797-0d0f7016879f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:10.431857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-15c513f2-8b45-473c-9797-0d0f7016879f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:10.438014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15c513f2-8b45-473c-9797-0d0f7016879f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:10.438457 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15c513f2-8b45-473c-9797-0d0f7016879f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:10.439244 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15c513f2-8b45-473c-9797-0d0f7016879f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:10.439672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15c513f2-8b45-473c-9797-0d0f7016879f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:10.579445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-15c513f2-8b45-473c-9797-0d0f7016879f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:10.587183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-15c513f2-8b45-473c-9797-0d0f7016879f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.160100 Nov 02 23:24:10.587825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1600/2175] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:10 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:10.592187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7148371c-3c74-4cbb-9555-2c2e7efa67e4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:10.593146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7148371c-3c74-4cbb-9555-2c2e7efa67e4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:10.599151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7148371c-3c74-4cbb-9555-2c2e7efa67e4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:10.599911 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7148371c-3c74-4cbb-9555-2c2e7efa67e4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:10.600585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7148371c-3c74-4cbb-9555-2c2e7efa67e4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:10.601255 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7148371c-3c74-4cbb-9555-2c2e7efa67e4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:10.630779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7148371c-3c74-4cbb-9555-2c2e7efa67e4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041891 Nov 02 23:24:10.631566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1601/2176] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:10 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:11.604990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-14cb90d6-5d78-4f50-a276-dbb078fdb9c8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:11.605659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-14cb90d6-5d78-4f50-a276-dbb078fdb9c8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:11.611805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14cb90d6-5d78-4f50-a276-dbb078fdb9c8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:11.612242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14cb90d6-5d78-4f50-a276-dbb078fdb9c8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:11.612991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14cb90d6-5d78-4f50-a276-dbb078fdb9c8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:11.613454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14cb90d6-5d78-4f50-a276-dbb078fdb9c8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:11.749566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-14cb90d6-5d78-4f50-a276-dbb078fdb9c8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:11.757292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-14cb90d6-5d78-4f50-a276-dbb078fdb9c8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.156672 Nov 02 23:24:11.757856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1602/2177] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:11 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:11.762155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cc6a0a84-2e69-4594-aff8-6b313eae0d06 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:11.763093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cc6a0a84-2e69-4594-aff8-6b313eae0d06 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:11.768493 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc6a0a84-2e69-4594-aff8-6b313eae0d06 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:11.768937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc6a0a84-2e69-4594-aff8-6b313eae0d06 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:11.769682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc6a0a84-2e69-4594-aff8-6b313eae0d06 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:11.770103 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc6a0a84-2e69-4594-aff8-6b313eae0d06 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:11.798317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cc6a0a84-2e69-4594-aff8-6b313eae0d06 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039488 Nov 02 23:24:11.798855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1603/2178] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:11 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:12.774160 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-67f8d521-4ea5-4fd1-8e39-df811dfac5a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:12.774831 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-67f8d521-4ea5-4fd1-8e39-df811dfac5a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:12.781157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67f8d521-4ea5-4fd1-8e39-df811dfac5a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:12.781594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67f8d521-4ea5-4fd1-8e39-df811dfac5a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:12.782372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67f8d521-4ea5-4fd1-8e39-df811dfac5a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:12.782806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67f8d521-4ea5-4fd1-8e39-df811dfac5a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:12.912546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-67f8d521-4ea5-4fd1-8e39-df811dfac5a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:12.920708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-67f8d521-4ea5-4fd1-8e39-df811dfac5a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.151023 Nov 02 23:24:12.921284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1604/2179] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:12 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:12.925775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c3d0413a-c48b-4d1e-948e-dcc2c163db44 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:12.926685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c3d0413a-c48b-4d1e-948e-dcc2c163db44 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:12.933155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3d0413a-c48b-4d1e-948e-dcc2c163db44 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:12.933600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3d0413a-c48b-4d1e-948e-dcc2c163db44 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:12.934416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3d0413a-c48b-4d1e-948e-dcc2c163db44 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:12.934803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3d0413a-c48b-4d1e-948e-dcc2c163db44 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:12.964798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c3d0413a-c48b-4d1e-948e-dcc2c163db44 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042490 Nov 02 23:24:12.965355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1605/2180] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:12 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:13.937793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dea57bf7-02cf-43f0-b9ea-7b3c51a16082 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:13.938422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dea57bf7-02cf-43f0-b9ea-7b3c51a16082 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:13.945182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dea57bf7-02cf-43f0-b9ea-7b3c51a16082 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:13.946170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dea57bf7-02cf-43f0-b9ea-7b3c51a16082 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:13.947062 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dea57bf7-02cf-43f0-b9ea-7b3c51a16082 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:13.947419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dea57bf7-02cf-43f0-b9ea-7b3c51a16082 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:14.079766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dea57bf7-02cf-43f0-b9ea-7b3c51a16082 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:14.088087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dea57bf7-02cf-43f0-b9ea-7b3c51a16082 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.153852 Nov 02 23:24:14.088664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1606/2181] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:13 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:14.093078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b8e2cde5-bead-46ee-b860-a6c1adf9c58d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:14.093979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b8e2cde5-bead-46ee-b860-a6c1adf9c58d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:14.099795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b8e2cde5-bead-46ee-b860-a6c1adf9c58d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:14.100308 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b8e2cde5-bead-46ee-b860-a6c1adf9c58d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:14.101146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b8e2cde5-bead-46ee-b860-a6c1adf9c58d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:14.101746 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b8e2cde5-bead-46ee-b860-a6c1adf9c58d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:14.131087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b8e2cde5-bead-46ee-b860-a6c1adf9c58d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041323 Nov 02 23:24:14.131662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1607/2182] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:14 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:15.105679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ad7d41fa-4e80-4209-9554-4ccd185afb79 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:15.106368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ad7d41fa-4e80-4209-9554-4ccd185afb79 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:15.112904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad7d41fa-4e80-4209-9554-4ccd185afb79 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:15.113351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad7d41fa-4e80-4209-9554-4ccd185afb79 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:15.114139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad7d41fa-4e80-4209-9554-4ccd185afb79 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:15.114572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad7d41fa-4e80-4209-9554-4ccd185afb79 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:15.254752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ad7d41fa-4e80-4209-9554-4ccd185afb79 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:15.263423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ad7d41fa-4e80-4209-9554-4ccd185afb79 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.161973 Nov 02 23:24:15.263995 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1608/2183] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:15 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:15.268479 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-32cf477a-8981-493a-9e90-b44845ed7949 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:15.269364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-32cf477a-8981-493a-9e90-b44845ed7949 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:15.275540 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-32cf477a-8981-493a-9e90-b44845ed7949 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:15.275988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-32cf477a-8981-493a-9e90-b44845ed7949 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:15.276736 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-32cf477a-8981-493a-9e90-b44845ed7949 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:15.277156 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-32cf477a-8981-493a-9e90-b44845ed7949 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:15.306837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-32cf477a-8981-493a-9e90-b44845ed7949 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041811 Nov 02 23:24:15.307423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1609/2184] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:15 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:16.280152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0a17a5d3-5588-475a-9292-6c4484329033 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:16.280851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0a17a5d3-5588-475a-9292-6c4484329033 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:16.287151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0a17a5d3-5588-475a-9292-6c4484329033 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:16.287593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0a17a5d3-5588-475a-9292-6c4484329033 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:16.288352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0a17a5d3-5588-475a-9292-6c4484329033 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:16.288777 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0a17a5d3-5588-475a-9292-6c4484329033 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:16.418776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0a17a5d3-5588-475a-9292-6c4484329033 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:16.426619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0a17a5d3-5588-475a-9292-6c4484329033 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.150097 Nov 02 23:24:16.427208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1610/2185] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:16 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:16.432309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8a97ce41-70cb-41b1-beac-e42e1c4527c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:16.433191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8a97ce41-70cb-41b1-beac-e42e1c4527c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:16.438652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a97ce41-70cb-41b1-beac-e42e1c4527c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:16.439127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a97ce41-70cb-41b1-beac-e42e1c4527c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:16.439881 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a97ce41-70cb-41b1-beac-e42e1c4527c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:16.440308 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a97ce41-70cb-41b1-beac-e42e1c4527c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:16.470086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8a97ce41-70cb-41b1-beac-e42e1c4527c2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041778 Nov 02 23:24:16.470652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1611/2186] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:16 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:17.444193 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-322a09a4-16c9-47b3-b2dd-226d528d0dbc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:17.445064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-322a09a4-16c9-47b3-b2dd-226d528d0dbc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:17.451210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-322a09a4-16c9-47b3-b2dd-226d528d0dbc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:17.451661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-322a09a4-16c9-47b3-b2dd-226d528d0dbc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:17.452437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-322a09a4-16c9-47b3-b2dd-226d528d0dbc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:17.452870 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-322a09a4-16c9-47b3-b2dd-226d528d0dbc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:17.592234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-322a09a4-16c9-47b3-b2dd-226d528d0dbc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:17.600220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-322a09a4-16c9-47b3-b2dd-226d528d0dbc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.159894 Nov 02 23:24:17.600792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1612/2187] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:17 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:17.605228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-28292974-cf58-4818-a54c-4f30be4fa3d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:17.606118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-28292974-cf58-4818-a54c-4f30be4fa3d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:17.612001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-28292974-cf58-4818-a54c-4f30be4fa3d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:17.612446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-28292974-cf58-4818-a54c-4f30be4fa3d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:17.613217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-28292974-cf58-4818-a54c-4f30be4fa3d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:17.613650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-28292974-cf58-4818-a54c-4f30be4fa3d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:17.642633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-28292974-cf58-4818-a54c-4f30be4fa3d8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040816 Nov 02 23:24:17.643224 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1613/2188] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:17 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:18.617400 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-372ff0ac-16d5-415c-bb8f-6d9883197b9f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:18.618069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-372ff0ac-16d5-415c-bb8f-6d9883197b9f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:18.624191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-372ff0ac-16d5-415c-bb8f-6d9883197b9f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:18.624628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-372ff0ac-16d5-415c-bb8f-6d9883197b9f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:18.625378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-372ff0ac-16d5-415c-bb8f-6d9883197b9f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:18.625803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-372ff0ac-16d5-415c-bb8f-6d9883197b9f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:18.755086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-372ff0ac-16d5-415c-bb8f-6d9883197b9f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:18.763506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-372ff0ac-16d5-415c-bb8f-6d9883197b9f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.149726 Nov 02 23:24:18.764094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1614/2189] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:18 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:18.768483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-582f734a-6f11-4792-b30a-4e637de0946d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:18.769373 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-582f734a-6f11-4792-b30a-4e637de0946d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:18.775091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-582f734a-6f11-4792-b30a-4e637de0946d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:18.775534 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-582f734a-6f11-4792-b30a-4e637de0946d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:18.776307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-582f734a-6f11-4792-b30a-4e637de0946d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:18.776731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-582f734a-6f11-4792-b30a-4e637de0946d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:18.806142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-582f734a-6f11-4792-b30a-4e637de0946d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041023 Nov 02 23:24:18.806884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1615/2190] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:18 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:19.780579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5d920440-4bf4-4994-8684-508b3a8ba920 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:19.781226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5d920440-4bf4-4994-8684-508b3a8ba920 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:19.787392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d920440-4bf4-4994-8684-508b3a8ba920 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:19.787829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d920440-4bf4-4994-8684-508b3a8ba920 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:19.788592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d920440-4bf4-4994-8684-508b3a8ba920 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:19.789526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d920440-4bf4-4994-8684-508b3a8ba920 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:19.920251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5d920440-4bf4-4994-8684-508b3a8ba920 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:19.927866 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5d920440-4bf4-4994-8684-508b3a8ba920 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.151161 Nov 02 23:24:19.928422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1616/2191] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:19 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:19.933247 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ace30a18-d3e5-4e4b-b27d-5b27ee009167 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:19.934121 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ace30a18-d3e5-4e4b-b27d-5b27ee009167 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:19.939746 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ace30a18-d3e5-4e4b-b27d-5b27ee009167 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:19.940223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ace30a18-d3e5-4e4b-b27d-5b27ee009167 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:19.940988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ace30a18-d3e5-4e4b-b27d-5b27ee009167 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:19.941424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ace30a18-d3e5-4e4b-b27d-5b27ee009167 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:19.969712 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ace30a18-d3e5-4e4b-b27d-5b27ee009167 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040313 Nov 02 23:24:19.970264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1617/2192] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:19 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:20.946592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-beadb343-8616-463f-a8d8-743aa1af0f8a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:20.948187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-beadb343-8616-463f-a8d8-743aa1af0f8a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:20.954193 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-beadb343-8616-463f-a8d8-743aa1af0f8a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:20.954638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-beadb343-8616-463f-a8d8-743aa1af0f8a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:20.955483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-beadb343-8616-463f-a8d8-743aa1af0f8a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:20.955917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-beadb343-8616-463f-a8d8-743aa1af0f8a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:21.100167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-beadb343-8616-463f-a8d8-743aa1af0f8a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:21.108704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-beadb343-8616-463f-a8d8-743aa1af0f8a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.166923 Nov 02 23:24:21.109303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1618/2193] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:20 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:21.114077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-594231fd-a321-4bdf-90c7-e5a3677c8f0a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:21.115035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-594231fd-a321-4bdf-90c7-e5a3677c8f0a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:21.122212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-594231fd-a321-4bdf-90c7-e5a3677c8f0a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:21.122654 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-594231fd-a321-4bdf-90c7-e5a3677c8f0a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:21.123469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-594231fd-a321-4bdf-90c7-e5a3677c8f0a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:21.123899 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-594231fd-a321-4bdf-90c7-e5a3677c8f0a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:21.154108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-594231fd-a321-4bdf-90c7-e5a3677c8f0a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043759 Nov 02 23:24:21.154660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1619/2194] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:21 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:22.126723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2a1958d0-eb55-4e24-a425-5592124d570d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:22.127445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2a1958d0-eb55-4e24-a425-5592124d570d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:22.134256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a1958d0-eb55-4e24-a425-5592124d570d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:22.134696 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a1958d0-eb55-4e24-a425-5592124d570d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:22.135489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a1958d0-eb55-4e24-a425-5592124d570d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:22.135916 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a1958d0-eb55-4e24-a425-5592124d570d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:22.268858 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2a1958d0-eb55-4e24-a425-5592124d570d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:22.277111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2a1958d0-eb55-4e24-a425-5592124d570d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.153986 Nov 02 23:24:22.277670 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1620/2195] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:22 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:22.281992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bcf24d1f-d96e-46e4-98b1-ed0b352ef631 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:22.282866 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bcf24d1f-d96e-46e4-98b1-ed0b352ef631 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:22.288416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcf24d1f-d96e-46e4-98b1-ed0b352ef631 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:22.288858 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcf24d1f-d96e-46e4-98b1-ed0b352ef631 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:22.289641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcf24d1f-d96e-46e4-98b1-ed0b352ef631 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:22.290066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcf24d1f-d96e-46e4-98b1-ed0b352ef631 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:22.318203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bcf24d1f-d96e-46e4-98b1-ed0b352ef631 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039526 Nov 02 23:24:22.318748 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1621/2196] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:22 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:23.293544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6025d127-8739-4d6b-92a2-6b7087cace96 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:23.294216 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6025d127-8739-4d6b-92a2-6b7087cace96 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:23.300515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6025d127-8739-4d6b-92a2-6b7087cace96 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:23.301019 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6025d127-8739-4d6b-92a2-6b7087cace96 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:23.301753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6025d127-8739-4d6b-92a2-6b7087cace96 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:23.302185 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6025d127-8739-4d6b-92a2-6b7087cace96 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:23.450160 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6025d127-8739-4d6b-92a2-6b7087cace96 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:23.462673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6025d127-8739-4d6b-92a2-6b7087cace96 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.172277 Nov 02 23:24:23.463682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1622/2197] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:23 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:23.475011 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b47cd047-50df-426f-914a-7af58e1d9d6e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:23.475920 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b47cd047-50df-426f-914a-7af58e1d9d6e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:23.481913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b47cd047-50df-426f-914a-7af58e1d9d6e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:23.482360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b47cd047-50df-426f-914a-7af58e1d9d6e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:23.483184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b47cd047-50df-426f-914a-7af58e1d9d6e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:23.483626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b47cd047-50df-426f-914a-7af58e1d9d6e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:23.514851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b47cd047-50df-426f-914a-7af58e1d9d6e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049696 Nov 02 23:24:23.515472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1623/2198] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:23 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:24.481360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-487bfb92-d3ef-4a8b-b4cc-6801881ce42b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:24.482027 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-487bfb92-d3ef-4a8b-b4cc-6801881ce42b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:24.487993 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-487bfb92-d3ef-4a8b-b4cc-6801881ce42b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:24.488432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-487bfb92-d3ef-4a8b-b4cc-6801881ce42b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:24.489206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-487bfb92-d3ef-4a8b-b4cc-6801881ce42b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:24.489638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-487bfb92-d3ef-4a8b-b4cc-6801881ce42b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:24.622719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-487bfb92-d3ef-4a8b-b4cc-6801881ce42b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:24.630743 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-487bfb92-d3ef-4a8b-b4cc-6801881ce42b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.152865 Nov 02 23:24:24.631346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1624/2199] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:24 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:24.635811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f83b460a-1e51-464d-858e-e58878a0e3e2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:24.636706 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f83b460a-1e51-464d-858e-e58878a0e3e2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:24.642548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f83b460a-1e51-464d-858e-e58878a0e3e2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:24.643148 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f83b460a-1e51-464d-858e-e58878a0e3e2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:24.644066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f83b460a-1e51-464d-858e-e58878a0e3e2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:24.644497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f83b460a-1e51-464d-858e-e58878a0e3e2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:24.674555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f83b460a-1e51-464d-858e-e58878a0e3e2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042163 Nov 02 23:24:24.675155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1625/2200] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:24 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:25.647672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-56f3357b-93a6-4923-b379-ea463c537874 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:25.648390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-56f3357b-93a6-4923-b379-ea463c537874 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:25.654720 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56f3357b-93a6-4923-b379-ea463c537874 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:25.655201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56f3357b-93a6-4923-b379-ea463c537874 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:25.655989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56f3357b-93a6-4923-b379-ea463c537874 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:25.656423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56f3357b-93a6-4923-b379-ea463c537874 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:25.802651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-56f3357b-93a6-4923-b379-ea463c537874 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:25.811883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-56f3357b-93a6-4923-b379-ea463c537874 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.167886 Nov 02 23:24:25.812454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1626/2201] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:25 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:25.817313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-94a48a4b-c7ee-4f6d-8999-b461f81d99a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:25.822871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-94a48a4b-c7ee-4f6d-8999-b461f81d99a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:25.828907 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94a48a4b-c7ee-4f6d-8999-b461f81d99a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:25.829351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94a48a4b-c7ee-4f6d-8999-b461f81d99a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:25.830115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94a48a4b-c7ee-4f6d-8999-b461f81d99a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:25.830536 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94a48a4b-c7ee-4f6d-8999-b461f81d99a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:25.860630 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-94a48a4b-c7ee-4f6d-8999-b461f81d99a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047129 Nov 02 23:24:25.862077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1627/2202] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:25 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:26.829378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ab4fd042-3567-4ebf-9929-115d57d25ce1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:26.830246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ab4fd042-3567-4ebf-9929-115d57d25ce1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:26.837005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ab4fd042-3567-4ebf-9929-115d57d25ce1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:26.837498 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ab4fd042-3567-4ebf-9929-115d57d25ce1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:26.838305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ab4fd042-3567-4ebf-9929-115d57d25ce1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:26.838770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ab4fd042-3567-4ebf-9929-115d57d25ce1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:26.983473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ab4fd042-3567-4ebf-9929-115d57d25ce1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:26.991480 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ab4fd042-3567-4ebf-9929-115d57d25ce1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.165671 Nov 02 23:24:26.992570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1628/2203] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:26 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:26.997209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0945afe7-1dea-4a33-b55c-3e36c6c2d869 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:26.998105 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0945afe7-1dea-4a33-b55c-3e36c6c2d869 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:27.004288 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0945afe7-1dea-4a33-b55c-3e36c6c2d869 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:27.004722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0945afe7-1dea-4a33-b55c-3e36c6c2d869 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:27.005489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0945afe7-1dea-4a33-b55c-3e36c6c2d869 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:27.005913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0945afe7-1dea-4a33-b55c-3e36c6c2d869 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:27.036544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0945afe7-1dea-4a33-b55c-3e36c6c2d869 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042835 Nov 02 23:24:27.037122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1629/2204] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:26 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:28.010712 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fb7ab80b-cc8b-4dec-ab7c-f8206fc28883 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:28.011368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fb7ab80b-cc8b-4dec-ab7c-f8206fc28883 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:28.017824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fb7ab80b-cc8b-4dec-ab7c-f8206fc28883 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:28.018280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fb7ab80b-cc8b-4dec-ab7c-f8206fc28883 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:28.019094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fb7ab80b-cc8b-4dec-ab7c-f8206fc28883 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:28.019528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fb7ab80b-cc8b-4dec-ab7c-f8206fc28883 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:28.153914 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fb7ab80b-cc8b-4dec-ab7c-f8206fc28883 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:28.161638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fb7ab80b-cc8b-4dec-ab7c-f8206fc28883 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.154896 Nov 02 23:24:28.162205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1630/2205] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:28 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:28.167217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5ee8bc94-479f-4624-9140-3d9f8fbcfc69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:28.168099 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5ee8bc94-479f-4624-9140-3d9f8fbcfc69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:28.173907 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ee8bc94-479f-4624-9140-3d9f8fbcfc69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:28.174343 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ee8bc94-479f-4624-9140-3d9f8fbcfc69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:28.175137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ee8bc94-479f-4624-9140-3d9f8fbcfc69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:28.175565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ee8bc94-479f-4624-9140-3d9f8fbcfc69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:28.207003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5ee8bc94-479f-4624-9140-3d9f8fbcfc69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043716 Nov 02 23:24:28.207594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1631/2206] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:28 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:29.178897 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-12b0bca1-d009-4f20-a406-0a43bcf56ddd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:29.180129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-12b0bca1-d009-4f20-a406-0a43bcf56ddd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:29.186254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-12b0bca1-d009-4f20-a406-0a43bcf56ddd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:29.186692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-12b0bca1-d009-4f20-a406-0a43bcf56ddd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:29.187489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-12b0bca1-d009-4f20-a406-0a43bcf56ddd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:29.187920 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-12b0bca1-d009-4f20-a406-0a43bcf56ddd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:29.323744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-12b0bca1-d009-4f20-a406-0a43bcf56ddd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:29.331537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-12b0bca1-d009-4f20-a406-0a43bcf56ddd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.156316 Nov 02 23:24:29.332113 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1632/2207] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:29 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:29.337126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a7f9bc8a-ccdb-4698-bb99-2fb6c0198db5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:29.338017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a7f9bc8a-ccdb-4698-bb99-2fb6c0198db5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:29.343989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a7f9bc8a-ccdb-4698-bb99-2fb6c0198db5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:29.344436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a7f9bc8a-ccdb-4698-bb99-2fb6c0198db5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:29.345238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a7f9bc8a-ccdb-4698-bb99-2fb6c0198db5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:29.345667 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a7f9bc8a-ccdb-4698-bb99-2fb6c0198db5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:29.374897 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a7f9bc8a-ccdb-4698-bb99-2fb6c0198db5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041745 Nov 02 23:24:29.375500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1633/2208] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:29 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:30.348473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-691a0185-7506-4056-ab22-6fb8e4923ffc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:30.349117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-691a0185-7506-4056-ab22-6fb8e4923ffc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:30.354942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-691a0185-7506-4056-ab22-6fb8e4923ffc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:30.355403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-691a0185-7506-4056-ab22-6fb8e4923ffc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:30.356162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-691a0185-7506-4056-ab22-6fb8e4923ffc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:30.356597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-691a0185-7506-4056-ab22-6fb8e4923ffc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:30.482434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-691a0185-7506-4056-ab22-6fb8e4923ffc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:30.490388 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-691a0185-7506-4056-ab22-6fb8e4923ffc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.145691 Nov 02 23:24:30.490977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1634/2209] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:30 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:30.495346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cd7814e2-ddb1-4ca0-a71b-a72f44b352ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:30.496233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cd7814e2-ddb1-4ca0-a71b-a72f44b352ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:30.501768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd7814e2-ddb1-4ca0-a71b-a72f44b352ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:30.502215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd7814e2-ddb1-4ca0-a71b-a72f44b352ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:30.503055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd7814e2-ddb1-4ca0-a71b-a72f44b352ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:30.503495 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd7814e2-ddb1-4ca0-a71b-a72f44b352ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:30.532636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cd7814e2-ddb1-4ca0-a71b-a72f44b352ed tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040650 Nov 02 23:24:30.533190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1635/2210] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:30 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:31.508549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9ce6bd78-0698-4442-93e6-a7ad8ecba31c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:31.509838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9ce6bd78-0698-4442-93e6-a7ad8ecba31c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:31.518113 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ce6bd78-0698-4442-93e6-a7ad8ecba31c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:31.518933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ce6bd78-0698-4442-93e6-a7ad8ecba31c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:31.520360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ce6bd78-0698-4442-93e6-a7ad8ecba31c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:31.521157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ce6bd78-0698-4442-93e6-a7ad8ecba31c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:31.676428 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9ce6bd78-0698-4442-93e6-a7ad8ecba31c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:31.684595 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9ce6bd78-0698-4442-93e6-a7ad8ecba31c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.180773 Nov 02 23:24:31.685193 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1636/2211] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:31 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:31.690032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3dea8656-dff3-48c7-8907-c187839fe61e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:31.690952 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3dea8656-dff3-48c7-8907-c187839fe61e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:31.697089 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dea8656-dff3-48c7-8907-c187839fe61e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:31.697538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dea8656-dff3-48c7-8907-c187839fe61e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:31.698321 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dea8656-dff3-48c7-8907-c187839fe61e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:31.698749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3dea8656-dff3-48c7-8907-c187839fe61e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:31.730379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3dea8656-dff3-48c7-8907-c187839fe61e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044124 Nov 02 23:24:31.730967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1637/2212] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:31 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:32.701873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-21e97f84-1101-4859-9dc7-fcd90a26835f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:32.702559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-21e97f84-1101-4859-9dc7-fcd90a26835f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:32.709013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21e97f84-1101-4859-9dc7-fcd90a26835f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:32.709452 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21e97f84-1101-4859-9dc7-fcd90a26835f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:32.710221 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21e97f84-1101-4859-9dc7-fcd90a26835f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:32.711237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21e97f84-1101-4859-9dc7-fcd90a26835f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:32.843943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-21e97f84-1101-4859-9dc7-fcd90a26835f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:32.852035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-21e97f84-1101-4859-9dc7-fcd90a26835f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.153753 Nov 02 23:24:32.852614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1638/2213] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:32 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:32.857117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-588d8aaf-0dc8-421c-aa33-f5a1395ad861 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:32.858014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-588d8aaf-0dc8-421c-aa33-f5a1395ad861 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:32.863937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-588d8aaf-0dc8-421c-aa33-f5a1395ad861 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:32.864376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-588d8aaf-0dc8-421c-aa33-f5a1395ad861 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:32.865143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-588d8aaf-0dc8-421c-aa33-f5a1395ad861 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:32.865565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-588d8aaf-0dc8-421c-aa33-f5a1395ad861 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:32.895743 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-588d8aaf-0dc8-421c-aa33-f5a1395ad861 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042077 Nov 02 23:24:32.896512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1639/2214] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:32 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:33.868954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-29560a1f-0772-49c1-b0f4-0a4d5ffd2f57 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:33.869626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-29560a1f-0772-49c1-b0f4-0a4d5ffd2f57 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:33.875775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-29560a1f-0772-49c1-b0f4-0a4d5ffd2f57 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:33.876218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-29560a1f-0772-49c1-b0f4-0a4d5ffd2f57 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:33.876984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-29560a1f-0772-49c1-b0f4-0a4d5ffd2f57 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:33.877413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-29560a1f-0772-49c1-b0f4-0a4d5ffd2f57 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:34.009866 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-29560a1f-0772-49c1-b0f4-0a4d5ffd2f57 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:34.017616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-29560a1f-0772-49c1-b0f4-0a4d5ffd2f57 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.152392 Nov 02 23:24:34.018185 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1640/2215] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:33 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:34.022509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f27c9efb-dff5-4e4e-98a7-e54fd16fb77d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:34.023921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f27c9efb-dff5-4e4e-98a7-e54fd16fb77d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:34.032890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f27c9efb-dff5-4e4e-98a7-e54fd16fb77d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:34.033332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f27c9efb-dff5-4e4e-98a7-e54fd16fb77d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:34.034093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f27c9efb-dff5-4e4e-98a7-e54fd16fb77d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:34.034520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f27c9efb-dff5-4e4e-98a7-e54fd16fb77d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:34.063874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f27c9efb-dff5-4e4e-98a7-e54fd16fb77d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044650 Nov 02 23:24:34.064430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1641/2216] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:34 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:35.035033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-db5cece1-6a67-4ebc-94dd-46262a62f47a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:35.035644 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-db5cece1-6a67-4ebc-94dd-46262a62f47a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:35.042474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db5cece1-6a67-4ebc-94dd-46262a62f47a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:35.042930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db5cece1-6a67-4ebc-94dd-46262a62f47a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:35.043699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db5cece1-6a67-4ebc-94dd-46262a62f47a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:35.044123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db5cece1-6a67-4ebc-94dd-46262a62f47a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:35.176481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-db5cece1-6a67-4ebc-94dd-46262a62f47a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:35.184755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-db5cece1-6a67-4ebc-94dd-46262a62f47a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.153487 Nov 02 23:24:35.185318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1642/2217] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:35 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:35.189893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-96dd0502-3a27-4859-823e-12dbe285ee3f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:35.190787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-96dd0502-3a27-4859-823e-12dbe285ee3f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:35.196925 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-96dd0502-3a27-4859-823e-12dbe285ee3f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:35.197367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-96dd0502-3a27-4859-823e-12dbe285ee3f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:35.198127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-96dd0502-3a27-4859-823e-12dbe285ee3f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:35.198556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-96dd0502-3a27-4859-823e-12dbe285ee3f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:35.228865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-96dd0502-3a27-4859-823e-12dbe285ee3f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042513 Nov 02 23:24:35.229430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1643/2218] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:35 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:36.201952 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4e7cded5-7cf5-4d82-bc37-4d250746f355 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:36.202652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4e7cded5-7cf5-4d82-bc37-4d250746f355 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:36.209026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e7cded5-7cf5-4d82-bc37-4d250746f355 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:36.209790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e7cded5-7cf5-4d82-bc37-4d250746f355 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:36.210238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e7cded5-7cf5-4d82-bc37-4d250746f355 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:36.210722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e7cded5-7cf5-4d82-bc37-4d250746f355 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:36.343312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4e7cded5-7cf5-4d82-bc37-4d250746f355 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:36.351139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4e7cded5-7cf5-4d82-bc37-4d250746f355 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.152848 Nov 02 23:24:36.351707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1644/2219] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:36 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:36.356395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-91ad34da-054f-45c6-a778-c0610a5f9a2e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:36.357332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-91ad34da-054f-45c6-a778-c0610a5f9a2e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:36.363602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-91ad34da-054f-45c6-a778-c0610a5f9a2e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:36.364047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-91ad34da-054f-45c6-a778-c0610a5f9a2e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:36.364835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-91ad34da-054f-45c6-a778-c0610a5f9a2e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:36.365264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-91ad34da-054f-45c6-a778-c0610a5f9a2e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:36.397888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-91ad34da-054f-45c6-a778-c0610a5f9a2e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045014 Nov 02 23:24:36.399085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1645/2220] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:36 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:37.369082 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-42123bdb-4e6f-4ae3-b4a6-5ab85c8c3161 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:37.369726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-42123bdb-4e6f-4ae3-b4a6-5ab85c8c3161 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:37.375820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42123bdb-4e6f-4ae3-b4a6-5ab85c8c3161 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:37.376222 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42123bdb-4e6f-4ae3-b4a6-5ab85c8c3161 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:37.377416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42123bdb-4e6f-4ae3-b4a6-5ab85c8c3161 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:37.377416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42123bdb-4e6f-4ae3-b4a6-5ab85c8c3161 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:37.526009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-42123bdb-4e6f-4ae3-b4a6-5ab85c8c3161 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:37.534854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-42123bdb-4e6f-4ae3-b4a6-5ab85c8c3161 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.169437 Nov 02 23:24:37.535485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1646/2221] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:37 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:37.539909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5b92d746-ac12-4d71-859c-281ebec3e19e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:37.540811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5b92d746-ac12-4d71-859c-281ebec3e19e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:37.546754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b92d746-ac12-4d71-859c-281ebec3e19e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:37.547229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b92d746-ac12-4d71-859c-281ebec3e19e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:37.547998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b92d746-ac12-4d71-859c-281ebec3e19e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:37.548422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b92d746-ac12-4d71-859c-281ebec3e19e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:37.581689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5b92d746-ac12-4d71-859c-281ebec3e19e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045162 Nov 02 23:24:37.582258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1647/2222] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:37 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:38.553485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f342ddf0-d191-4254-bc39-8c8850833fd9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:38.554174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f342ddf0-d191-4254-bc39-8c8850833fd9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:38.560438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f342ddf0-d191-4254-bc39-8c8850833fd9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:38.560917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f342ddf0-d191-4254-bc39-8c8850833fd9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:38.561694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f342ddf0-d191-4254-bc39-8c8850833fd9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:38.562132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f342ddf0-d191-4254-bc39-8c8850833fd9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:38.694218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f342ddf0-d191-4254-bc39-8c8850833fd9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:38.704221 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f342ddf0-d191-4254-bc39-8c8850833fd9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.154403 Nov 02 23:24:38.704792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1648/2223] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:38 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:38.709151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6df51577-0c3e-402d-97b2-a9e071b2fa43 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:38.710025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6df51577-0c3e-402d-97b2-a9e071b2fa43 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:38.716830 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6df51577-0c3e-402d-97b2-a9e071b2fa43 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:38.717275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6df51577-0c3e-402d-97b2-a9e071b2fa43 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:38.718037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6df51577-0c3e-402d-97b2-a9e071b2fa43 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:38.718465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6df51577-0c3e-402d-97b2-a9e071b2fa43 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:38.748421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6df51577-0c3e-402d-97b2-a9e071b2fa43 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042508 Nov 02 23:24:38.748903 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1649/2224] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:38 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:39.721385 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ac4b7f31-ec62-4ad6-985a-d05185b67179 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:39.722070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ac4b7f31-ec62-4ad6-985a-d05185b67179 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:39.728905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac4b7f31-ec62-4ad6-985a-d05185b67179 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:39.729351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac4b7f31-ec62-4ad6-985a-d05185b67179 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:39.730115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac4b7f31-ec62-4ad6-985a-d05185b67179 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:39.730546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac4b7f31-ec62-4ad6-985a-d05185b67179 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:39.863332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ac4b7f31-ec62-4ad6-985a-d05185b67179 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:39.871696 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ac4b7f31-ec62-4ad6-985a-d05185b67179 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.153919 Nov 02 23:24:39.872234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1650/2225] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:39 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:39.876554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f6c72f6b-3cf3-4f33-a0f5-09703790847e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:39.877463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f6c72f6b-3cf3-4f33-a0f5-09703790847e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:39.883767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f6c72f6b-3cf3-4f33-a0f5-09703790847e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:39.884193 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f6c72f6b-3cf3-4f33-a0f5-09703790847e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:39.884956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f6c72f6b-3cf3-4f33-a0f5-09703790847e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:39.885387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f6c72f6b-3cf3-4f33-a0f5-09703790847e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:39.915229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f6c72f6b-3cf3-4f33-a0f5-09703790847e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041957 Nov 02 23:24:39.915787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1651/2226] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 2 23:24:39 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:24:40.889068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-067b6e66-a137-44d2-bc3c-082708414656 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:40.889771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-067b6e66-a137-44d2-bc3c-082708414656 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:40.895977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-067b6e66-a137-44d2-bc3c-082708414656 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:40.896425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-067b6e66-a137-44d2-bc3c-082708414656 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:40.897194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-067b6e66-a137-44d2-bc3c-082708414656 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:40.897635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-067b6e66-a137-44d2-bc3c-082708414656 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:41.026162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-067b6e66-a137-44d2-bc3c-082708414656 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:41.034143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-067b6e66-a137-44d2-bc3c-082708414656 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.148799 Nov 02 23:24:41.034744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1652/2227] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:40 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:41.039402 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9174c0e3-d7d9-4eb6-93cc-3e8d53ab5a7b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:24:41.040286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9174c0e3-d7d9-4eb6-93cc-3e8d53ab5a7b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:41.046080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9174c0e3-d7d9-4eb6-93cc-3e8d53ab5a7b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:41.046679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9174c0e3-d7d9-4eb6-93cc-3e8d53ab5a7b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:41.047489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9174c0e3-d7d9-4eb6-93cc-3e8d53ab5a7b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:41.047915 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9174c0e3-d7d9-4eb6-93cc-3e8d53ab5a7b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:41.071687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-9174c0e3-d7d9-4eb6-93cc-3e8d53ab5a7b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] HTTP exception thrown: Instance 15750fff-dec6-4bcc-a69c-0f9576f7970e is not ready Nov 02 23:24:41.072273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9174c0e3-d7d9-4eb6-93cc-3e8d53ab5a7b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Returning 409 to user: Instance 15750fff-dec6-4bcc-a69c-0f9576f7970e is not ready {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:24:41.073080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9174c0e3-d7d9-4eb6-93cc-3e8d53ab5a7b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action" status: 409 len: 110 microversion: 2.20 time: 0.037295 Nov 02 23:24:41.073616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1653/2228] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:24:41 2021] POST /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e/action => generated 110 bytes in 38 msecs (HTTP/1.1 409) 9 headers in 380 bytes (1 switches on core 0) Nov 02 23:24:42.050802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4c7dd16f-c1eb-4a18-9381-12f3f249b01b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:42.051621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4c7dd16f-c1eb-4a18-9381-12f3f249b01b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:42.058649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4c7dd16f-c1eb-4a18-9381-12f3f249b01b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:42.059136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4c7dd16f-c1eb-4a18-9381-12f3f249b01b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:42.059908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4c7dd16f-c1eb-4a18-9381-12f3f249b01b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:42.060339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4c7dd16f-c1eb-4a18-9381-12f3f249b01b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:42.193174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4c7dd16f-c1eb-4a18-9381-12f3f249b01b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:42.202366 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4c7dd16f-c1eb-4a18-9381-12f3f249b01b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.155190 Nov 02 23:24:42.202978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1654/2229] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:42 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:43.219486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1448c315-51f1-41eb-a749-8afc4fd5de2d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:43.220098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1448c315-51f1-41eb-a749-8afc4fd5de2d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:43.226731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1448c315-51f1-41eb-a749-8afc4fd5de2d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:43.227213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1448c315-51f1-41eb-a749-8afc4fd5de2d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:43.227987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1448c315-51f1-41eb-a749-8afc4fd5de2d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:43.228420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1448c315-51f1-41eb-a749-8afc4fd5de2d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:43.360204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1448c315-51f1-41eb-a749-8afc4fd5de2d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:43.368594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1448c315-51f1-41eb-a749-8afc4fd5de2d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.152709 Nov 02 23:24:43.369163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1655/2230] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:43 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:44.385841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d03af706-34e9-4e37-aa22-71fff9a53b47 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:44.386515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d03af706-34e9-4e37-aa22-71fff9a53b47 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:44.392720 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d03af706-34e9-4e37-aa22-71fff9a53b47 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:44.393199 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d03af706-34e9-4e37-aa22-71fff9a53b47 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:44.393966 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d03af706-34e9-4e37-aa22-71fff9a53b47 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:44.394396 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d03af706-34e9-4e37-aa22-71fff9a53b47 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:44.523187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d03af706-34e9-4e37-aa22-71fff9a53b47 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:44.530846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d03af706-34e9-4e37-aa22-71fff9a53b47 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.149207 Nov 02 23:24:44.531445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1656/2231] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:44 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:45.548092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-66205c66-2cfa-46ec-ac9a-847b0b35763c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:45.548715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-66205c66-2cfa-46ec-ac9a-847b0b35763c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:45.554825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66205c66-2cfa-46ec-ac9a-847b0b35763c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:45.555306 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66205c66-2cfa-46ec-ac9a-847b0b35763c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:45.556762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66205c66-2cfa-46ec-ac9a-847b0b35763c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:45.556762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66205c66-2cfa-46ec-ac9a-847b0b35763c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:45.689525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-66205c66-2cfa-46ec-ac9a-847b0b35763c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:45.698653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-66205c66-2cfa-46ec-ac9a-847b0b35763c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.154134 Nov 02 23:24:45.699340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1657/2232] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:45 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:46.715514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2b4e8cf8-89ba-4e84-a27f-b44eca4e9cda tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:46.716189 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2b4e8cf8-89ba-4e84-a27f-b44eca4e9cda tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:46.722390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b4e8cf8-89ba-4e84-a27f-b44eca4e9cda tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:46.722852 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b4e8cf8-89ba-4e84-a27f-b44eca4e9cda tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:46.723672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b4e8cf8-89ba-4e84-a27f-b44eca4e9cda tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:46.724110 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b4e8cf8-89ba-4e84-a27f-b44eca4e9cda tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:46.853450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2b4e8cf8-89ba-4e84-a27f-b44eca4e9cda tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:46.861330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2b4e8cf8-89ba-4e84-a27f-b44eca4e9cda tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.149427 Nov 02 23:24:46.861950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1658/2233] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:46 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:47.879058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c7799711-259f-47e9-a471-f0bc534f97e2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:47.879721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c7799711-259f-47e9-a471-f0bc534f97e2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:47.886264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7799711-259f-47e9-a471-f0bc534f97e2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:47.886700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7799711-259f-47e9-a471-f0bc534f97e2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:47.887494 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7799711-259f-47e9-a471-f0bc534f97e2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:47.887920 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7799711-259f-47e9-a471-f0bc534f97e2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:48.019800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c7799711-259f-47e9-a471-f0bc534f97e2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:48.028117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c7799711-259f-47e9-a471-f0bc534f97e2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.152770 Nov 02 23:24:48.028704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1659/2234] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:47 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:49.045286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-68f32d9b-4243-46de-b825-da358930b989 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:49.045945 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-68f32d9b-4243-46de-b825-da358930b989 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:49.052401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-68f32d9b-4243-46de-b825-da358930b989 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:49.052842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-68f32d9b-4243-46de-b825-da358930b989 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:49.053739 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-68f32d9b-4243-46de-b825-da358930b989 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:49.054170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-68f32d9b-4243-46de-b825-da358930b989 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:49.183357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-68f32d9b-4243-46de-b825-da358930b989 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:49.191005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-68f32d9b-4243-46de-b825-da358930b989 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.149426 Nov 02 23:24:49.191601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1660/2235] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:49 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:50.207906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-14a097d4-0e68-472c-8329-8bccc3b6e74b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:50.208622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-14a097d4-0e68-472c-8329-8bccc3b6e74b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:50.215340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14a097d4-0e68-472c-8329-8bccc3b6e74b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:50.215784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14a097d4-0e68-472c-8329-8bccc3b6e74b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:50.216553 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14a097d4-0e68-472c-8329-8bccc3b6e74b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:50.216984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14a097d4-0e68-472c-8329-8bccc3b6e74b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:50.352381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-14a097d4-0e68-472c-8329-8bccc3b6e74b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:50.360113 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-14a097d4-0e68-472c-8329-8bccc3b6e74b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.155968 Nov 02 23:24:50.360706 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1661/2236] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:50 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:51.376957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bf818959-20b8-47c6-afc4-340b184d3042 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:51.377668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bf818959-20b8-47c6-afc4-340b184d3042 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:51.384530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf818959-20b8-47c6-afc4-340b184d3042 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:51.384974 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf818959-20b8-47c6-afc4-340b184d3042 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:51.385734 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf818959-20b8-47c6-afc4-340b184d3042 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:51.386159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf818959-20b8-47c6-afc4-340b184d3042 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:51.516564 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bf818959-20b8-47c6-afc4-340b184d3042 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:51.524504 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bf818959-20b8-47c6-afc4-340b184d3042 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.151240 Nov 02 23:24:51.525062 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1662/2237] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:51 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:24:52.541434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a5320dd2-c46a-4021-b99e-a713bab70e67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:52.541998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a5320dd2-c46a-4021-b99e-a713bab70e67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:52.548206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5320dd2-c46a-4021-b99e-a713bab70e67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:52.548704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5320dd2-c46a-4021-b99e-a713bab70e67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:52.549417 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5320dd2-c46a-4021-b99e-a713bab70e67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:52.549850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5320dd2-c46a-4021-b99e-a713bab70e67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:52.684060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a5320dd2-c46a-4021-b99e-a713bab70e67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:52.691990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a5320dd2-c46a-4021-b99e-a713bab70e67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.154404 Nov 02 23:24:52.692707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1663/2238] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:52 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:53.708579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4f7bc2a6-f731-49b4-bddb-4a90c0e574f8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:53.709251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4f7bc2a6-f731-49b4-bddb-4a90c0e574f8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:53.715701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f7bc2a6-f731-49b4-bddb-4a90c0e574f8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:53.716140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f7bc2a6-f731-49b4-bddb-4a90c0e574f8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:53.716906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f7bc2a6-f731-49b4-bddb-4a90c0e574f8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:53.717331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f7bc2a6-f731-49b4-bddb-4a90c0e574f8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:53.852936 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4f7bc2a6-f731-49b4-bddb-4a90c0e574f8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:53.860666 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4f7bc2a6-f731-49b4-bddb-4a90c0e574f8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.155590 Nov 02 23:24:53.861226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1664/2239] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:53 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:54.877621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-630fbf76-7bd9-4e72-8c51-45780cb73575 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:54.878255 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-630fbf76-7bd9-4e72-8c51-45780cb73575 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:54.884339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-630fbf76-7bd9-4e72-8c51-45780cb73575 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:54.884782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-630fbf76-7bd9-4e72-8c51-45780cb73575 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:54.885533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-630fbf76-7bd9-4e72-8c51-45780cb73575 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:54.885957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-630fbf76-7bd9-4e72-8c51-45780cb73575 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:55.019888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-630fbf76-7bd9-4e72-8c51-45780cb73575 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:55.027606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-630fbf76-7bd9-4e72-8c51-45780cb73575 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.153670 Nov 02 23:24:55.028174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1665/2240] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:54 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:56.049331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e4b0027f-bcdb-4b6a-b43f-70cc47af87c3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:56.050359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e4b0027f-bcdb-4b6a-b43f-70cc47af87c3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:56.061004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4b0027f-bcdb-4b6a-b43f-70cc47af87c3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:56.061791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4b0027f-bcdb-4b6a-b43f-70cc47af87c3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:56.063191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4b0027f-bcdb-4b6a-b43f-70cc47af87c3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:56.063966 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4b0027f-bcdb-4b6a-b43f-70cc47af87c3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:56.231289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e4b0027f-bcdb-4b6a-b43f-70cc47af87c3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:56.240529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e4b0027f-bcdb-4b6a-b43f-70cc47af87c3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.197880 Nov 02 23:24:56.241319 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1666/2241] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:56 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:24:57.258061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7266ff37-d7c7-4382-8a32-a3fa7201b4a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:57.258764 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7266ff37-d7c7-4382-8a32-a3fa7201b4a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:57.265601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7266ff37-d7c7-4382-8a32-a3fa7201b4a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:57.266049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7266ff37-d7c7-4382-8a32-a3fa7201b4a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:57.266838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7266ff37-d7c7-4382-8a32-a3fa7201b4a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:57.267305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7266ff37-d7c7-4382-8a32-a3fa7201b4a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:57.451594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7266ff37-d7c7-4382-8a32-a3fa7201b4a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:57.460066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7266ff37-d7c7-4382-8a32-a3fa7201b4a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.206057 Nov 02 23:24:57.460810 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1667/2242] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:57 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:24:58.481599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3abb682f-0b36-498e-8402-740df4bfd109 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:58.482697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3abb682f-0b36-498e-8402-740df4bfd109 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:58.493046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3abb682f-0b36-498e-8402-740df4bfd109 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:58.493777 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3abb682f-0b36-498e-8402-740df4bfd109 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:58.495089 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3abb682f-0b36-498e-8402-740df4bfd109 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:58.495819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3abb682f-0b36-498e-8402-740df4bfd109 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:58.637476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3abb682f-0b36-498e-8402-740df4bfd109 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:58.645420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3abb682f-0b36-498e-8402-740df4bfd109 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.170607 Nov 02 23:24:58.646010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1668/2243] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:58 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:24:59.663351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c0b7c8b8-d2bc-42a9-9b91-8209c89f5c6f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:24:59.664146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c0b7c8b8-d2bc-42a9-9b91-8209c89f5c6f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:24:59.670365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0b7c8b8-d2bc-42a9-9b91-8209c89f5c6f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:59.670808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0b7c8b8-d2bc-42a9-9b91-8209c89f5c6f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:59.671607 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0b7c8b8-d2bc-42a9-9b91-8209c89f5c6f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:24:59.672036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0b7c8b8-d2bc-42a9-9b91-8209c89f5c6f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:24:59.818973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c0b7c8b8-d2bc-42a9-9b91-8209c89f5c6f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:24:59.828015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c0b7c8b8-d2bc-42a9-9b91-8209c89f5c6f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.168293 Nov 02 23:24:59.828597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1669/2244] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:24:59 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:00.845539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c7301f62-d3e7-4adb-a0b3-12e6c0f7945c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:00.846315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c7301f62-d3e7-4adb-a0b3-12e6c0f7945c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:00.853276 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7301f62-d3e7-4adb-a0b3-12e6c0f7945c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:00.853718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7301f62-d3e7-4adb-a0b3-12e6c0f7945c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:00.854498 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7301f62-d3e7-4adb-a0b3-12e6c0f7945c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:00.854942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7301f62-d3e7-4adb-a0b3-12e6c0f7945c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:01.007170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c7301f62-d3e7-4adb-a0b3-12e6c0f7945c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:01.015889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c7301f62-d3e7-4adb-a0b3-12e6c0f7945c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.174014 Nov 02 23:25:01.016805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1670/2245] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:00 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:02.033961 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7f8fa164-32ca-45dd-8362-6c767e72c0e2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:02.034722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7f8fa164-32ca-45dd-8362-6c767e72c0e2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:02.041914 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f8fa164-32ca-45dd-8362-6c767e72c0e2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:02.042518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f8fa164-32ca-45dd-8362-6c767e72c0e2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:02.043452 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f8fa164-32ca-45dd-8362-6c767e72c0e2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:02.043944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f8fa164-32ca-45dd-8362-6c767e72c0e2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:02.218579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7f8fa164-32ca-45dd-8362-6c767e72c0e2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:02.228669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7f8fa164-32ca-45dd-8362-6c767e72c0e2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.198203 Nov 02 23:25:02.229259 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1671/2246] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:02 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:03.250035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-35a7f022-dfcf-40e3-b8b8-01ae077eab36 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:03.251131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-35a7f022-dfcf-40e3-b8b8-01ae077eab36 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:03.259066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-35a7f022-dfcf-40e3-b8b8-01ae077eab36 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:03.259746 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-35a7f022-dfcf-40e3-b8b8-01ae077eab36 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:03.260790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-35a7f022-dfcf-40e3-b8b8-01ae077eab36 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:03.261295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-35a7f022-dfcf-40e3-b8b8-01ae077eab36 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:03.434652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-35a7f022-dfcf-40e3-b8b8-01ae077eab36 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:03.443883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-35a7f022-dfcf-40e3-b8b8-01ae077eab36 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.197358 Nov 02 23:25:03.444579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1672/2247] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:03 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:04.462205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1ea63211-f9bc-4ebb-8552-55cee5b6e10a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:04.463080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1ea63211-f9bc-4ebb-8552-55cee5b6e10a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:04.470163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ea63211-f9bc-4ebb-8552-55cee5b6e10a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:04.470714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ea63211-f9bc-4ebb-8552-55cee5b6e10a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:04.471660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ea63211-f9bc-4ebb-8552-55cee5b6e10a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:04.472167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ea63211-f9bc-4ebb-8552-55cee5b6e10a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:04.660747 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1ea63211-f9bc-4ebb-8552-55cee5b6e10a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:04.670525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1ea63211-f9bc-4ebb-8552-55cee5b6e10a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.212471 Nov 02 23:25:04.671174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1673/2248] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:04 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:05.690575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-674d4a98-4b9b-4b2e-be6b-0535dbbceac7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:05.691695 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-674d4a98-4b9b-4b2e-be6b-0535dbbceac7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:05.702669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-674d4a98-4b9b-4b2e-be6b-0535dbbceac7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:05.703703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-674d4a98-4b9b-4b2e-be6b-0535dbbceac7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:05.704634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-674d4a98-4b9b-4b2e-be6b-0535dbbceac7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:05.705243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-674d4a98-4b9b-4b2e-be6b-0535dbbceac7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:05.851879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-674d4a98-4b9b-4b2e-be6b-0535dbbceac7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:05.860697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-674d4a98-4b9b-4b2e-be6b-0535dbbceac7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.174520 Nov 02 23:25:05.861312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1674/2249] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:05 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:06.879638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-950657c8-821a-4f3c-a855-d7d88c5251fd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:06.880934 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-950657c8-821a-4f3c-a855-d7d88c5251fd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:06.888137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-950657c8-821a-4f3c-a855-d7d88c5251fd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:06.888574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-950657c8-821a-4f3c-a855-d7d88c5251fd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:06.889356 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-950657c8-821a-4f3c-a855-d7d88c5251fd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:06.889783 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-950657c8-821a-4f3c-a855-d7d88c5251fd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:07.062586 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-950657c8-821a-4f3c-a855-d7d88c5251fd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:07.071908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-950657c8-821a-4f3c-a855-d7d88c5251fd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.196074 Nov 02 23:25:07.072498 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1675/2250] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:06 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:08.097862 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-081b5111-c680-4a7b-8023-d9cf9d0ef459 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:08.098910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-081b5111-c680-4a7b-8023-d9cf9d0ef459 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:08.106503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-081b5111-c680-4a7b-8023-d9cf9d0ef459 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:08.107051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-081b5111-c680-4a7b-8023-d9cf9d0ef459 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:08.107930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-081b5111-c680-4a7b-8023-d9cf9d0ef459 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:08.108405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-081b5111-c680-4a7b-8023-d9cf9d0ef459 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:08.274211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-081b5111-c680-4a7b-8023-d9cf9d0ef459 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:08.283394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-081b5111-c680-4a7b-8023-d9cf9d0ef459 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.189294 Nov 02 23:25:08.284210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1676/2251] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:08 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:09.304979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-97e8feff-c90f-4ae3-9286-f1ba6a77534f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:09.305699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-97e8feff-c90f-4ae3-9286-f1ba6a77534f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:09.312578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-97e8feff-c90f-4ae3-9286-f1ba6a77534f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:09.313027 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-97e8feff-c90f-4ae3-9286-f1ba6a77534f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:09.313832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-97e8feff-c90f-4ae3-9286-f1ba6a77534f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:09.314274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-97e8feff-c90f-4ae3-9286-f1ba6a77534f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:09.502365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-97e8feff-c90f-4ae3-9286-f1ba6a77534f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:09.510673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-97e8feff-c90f-4ae3-9286-f1ba6a77534f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.209976 Nov 02 23:25:09.511304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1677/2252] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:09 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:10.530287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-41ed71db-ba53-488f-9e2c-89c3f414af93 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:10.531481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-41ed71db-ba53-488f-9e2c-89c3f414af93 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:10.538776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-41ed71db-ba53-488f-9e2c-89c3f414af93 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:10.539302 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-41ed71db-ba53-488f-9e2c-89c3f414af93 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:10.540109 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-41ed71db-ba53-488f-9e2c-89c3f414af93 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:10.540576 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-41ed71db-ba53-488f-9e2c-89c3f414af93 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:10.694199 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-41ed71db-ba53-488f-9e2c-89c3f414af93 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:10.702718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-41ed71db-ba53-488f-9e2c-89c3f414af93 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.177382 Nov 02 23:25:10.703383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1678/2253] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:10 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:25:11.721677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-be6f7957-d007-4ce1-88dd-d4dc2a222f31 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:11.722421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-be6f7957-d007-4ce1-88dd-d4dc2a222f31 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:11.731260 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be6f7957-d007-4ce1-88dd-d4dc2a222f31 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:11.731743 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be6f7957-d007-4ce1-88dd-d4dc2a222f31 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:11.732689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be6f7957-d007-4ce1-88dd-d4dc2a222f31 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:11.733191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be6f7957-d007-4ce1-88dd-d4dc2a222f31 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:11.907071 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-be6f7957-d007-4ce1-88dd-d4dc2a222f31 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:11.917069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-be6f7957-d007-4ce1-88dd-d4dc2a222f31 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.199434 Nov 02 23:25:11.917791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1679/2254] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:11 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:12.936196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5ad1c7df-c368-493a-b280-d7dbdc226274 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:12.936966 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5ad1c7df-c368-493a-b280-d7dbdc226274 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:12.947375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ad1c7df-c368-493a-b280-d7dbdc226274 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:12.948182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ad1c7df-c368-493a-b280-d7dbdc226274 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:12.949590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ad1c7df-c368-493a-b280-d7dbdc226274 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:12.950416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ad1c7df-c368-493a-b280-d7dbdc226274 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:13.105052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5ad1c7df-c368-493a-b280-d7dbdc226274 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:13.113821 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5ad1c7df-c368-493a-b280-d7dbdc226274 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.182795 Nov 02 23:25:13.114503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1680/2255] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:12 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:14.132369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c3b469af-2105-4e22-b9bf-5b88eea2d2db tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:14.133228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c3b469af-2105-4e22-b9bf-5b88eea2d2db tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:14.140203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3b469af-2105-4e22-b9bf-5b88eea2d2db tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:14.140615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3b469af-2105-4e22-b9bf-5b88eea2d2db tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:14.141456 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3b469af-2105-4e22-b9bf-5b88eea2d2db tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:14.141895 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3b469af-2105-4e22-b9bf-5b88eea2d2db tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:14.295137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c3b469af-2105-4e22-b9bf-5b88eea2d2db tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:14.304309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c3b469af-2105-4e22-b9bf-5b88eea2d2db tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.176305 Nov 02 23:25:14.304915 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1681/2256] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:14 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:15.322449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-59e67530-9745-4ae0-95f2-f339ccd9ee08 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:15.323255 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-59e67530-9745-4ae0-95f2-f339ccd9ee08 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:15.329883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59e67530-9745-4ae0-95f2-f339ccd9ee08 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:15.330337 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59e67530-9745-4ae0-95f2-f339ccd9ee08 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:15.331170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59e67530-9745-4ae0-95f2-f339ccd9ee08 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:15.331608 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59e67530-9745-4ae0-95f2-f339ccd9ee08 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:15.491965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-59e67530-9745-4ae0-95f2-f339ccd9ee08 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:15.502395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-59e67530-9745-4ae0-95f2-f339ccd9ee08 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.184630 Nov 02 23:25:15.503243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1682/2257] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:15 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:16.521435 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b28f0fc0-5faa-41e1-80a1-f62e2f83a975 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:16.522669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b28f0fc0-5faa-41e1-80a1-f62e2f83a975 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:16.529688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b28f0fc0-5faa-41e1-80a1-f62e2f83a975 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:16.530139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b28f0fc0-5faa-41e1-80a1-f62e2f83a975 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:16.530955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b28f0fc0-5faa-41e1-80a1-f62e2f83a975 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:16.531407 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b28f0fc0-5faa-41e1-80a1-f62e2f83a975 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:16.687723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b28f0fc0-5faa-41e1-80a1-f62e2f83a975 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:16.697067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b28f0fc0-5faa-41e1-80a1-f62e2f83a975 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.179243 Nov 02 23:25:16.697789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1683/2258] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:16 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:17.714755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7f243647-27fe-4401-8479-fa7c2e8e3083 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:17.715550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7f243647-27fe-4401-8479-fa7c2e8e3083 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:17.722138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f243647-27fe-4401-8479-fa7c2e8e3083 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:17.722583 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f243647-27fe-4401-8479-fa7c2e8e3083 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:17.723417 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f243647-27fe-4401-8479-fa7c2e8e3083 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:17.723849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f243647-27fe-4401-8479-fa7c2e8e3083 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:17.889096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7f243647-27fe-4401-8479-fa7c2e8e3083 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:17.900317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7f243647-27fe-4401-8479-fa7c2e8e3083 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.188821 Nov 02 23:25:17.901398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1684/2259] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:17 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:18.926208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c41e5758-cfb3-4a62-b3d5-dc97572a8148 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:18.927346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c41e5758-cfb3-4a62-b3d5-dc97572a8148 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:18.939546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c41e5758-cfb3-4a62-b3d5-dc97572a8148 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:18.940309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c41e5758-cfb3-4a62-b3d5-dc97572a8148 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:18.941706 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c41e5758-cfb3-4a62-b3d5-dc97572a8148 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:18.942488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c41e5758-cfb3-4a62-b3d5-dc97572a8148 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:19.149405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c41e5758-cfb3-4a62-b3d5-dc97572a8148 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:19.158723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c41e5758-cfb3-4a62-b3d5-dc97572a8148 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.240435 Nov 02 23:25:19.160293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1685/2260] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:18 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:20.176756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cda0c887-f246-4c43-9ba1-1ce73451a561 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:20.178476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cda0c887-f246-4c43-9ba1-1ce73451a561 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:20.184901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cda0c887-f246-4c43-9ba1-1ce73451a561 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:20.185348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cda0c887-f246-4c43-9ba1-1ce73451a561 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:20.186138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cda0c887-f246-4c43-9ba1-1ce73451a561 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:20.186572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cda0c887-f246-4c43-9ba1-1ce73451a561 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:20.359007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cda0c887-f246-4c43-9ba1-1ce73451a561 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:20.368335 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cda0c887-f246-4c43-9ba1-1ce73451a561 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.195235 Nov 02 23:25:20.368990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1686/2261] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:20 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:21.394487 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ff1b3689-89c2-4bcd-8ab1-236ae90e9a85 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:21.395295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ff1b3689-89c2-4bcd-8ab1-236ae90e9a85 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:21.403064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff1b3689-89c2-4bcd-8ab1-236ae90e9a85 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:21.403811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff1b3689-89c2-4bcd-8ab1-236ae90e9a85 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:21.404763 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff1b3689-89c2-4bcd-8ab1-236ae90e9a85 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:21.405308 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff1b3689-89c2-4bcd-8ab1-236ae90e9a85 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:21.590390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ff1b3689-89c2-4bcd-8ab1-236ae90e9a85 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:21.598899 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ff1b3689-89c2-4bcd-8ab1-236ae90e9a85 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.208120 Nov 02 23:25:21.599530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1687/2262] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:21 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:22.617290 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a0b7bd0a-97bb-4794-8602-a421b323935a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:22.618150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a0b7bd0a-97bb-4794-8602-a421b323935a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:22.626235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0b7bd0a-97bb-4794-8602-a421b323935a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:22.626780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0b7bd0a-97bb-4794-8602-a421b323935a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:22.627816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0b7bd0a-97bb-4794-8602-a421b323935a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:22.628447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0b7bd0a-97bb-4794-8602-a421b323935a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:22.782638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a0b7bd0a-97bb-4794-8602-a421b323935a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:22.791223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a0b7bd0a-97bb-4794-8602-a421b323935a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.177778 Nov 02 23:25:22.791844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1688/2263] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:22 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:23.809077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bf1aae36-0983-43bf-91a4-50b7eee20f5f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:23.809854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bf1aae36-0983-43bf-91a4-50b7eee20f5f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:23.816775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf1aae36-0983-43bf-91a4-50b7eee20f5f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:23.817224 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf1aae36-0983-43bf-91a4-50b7eee20f5f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:23.818400 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf1aae36-0983-43bf-91a4-50b7eee20f5f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:23.819411 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf1aae36-0983-43bf-91a4-50b7eee20f5f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:24.003389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bf1aae36-0983-43bf-91a4-50b7eee20f5f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:24.011784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bf1aae36-0983-43bf-91a4-50b7eee20f5f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.206448 Nov 02 23:25:24.012390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1689/2264] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:23 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:25.035015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fc582317-6393-404e-a15b-86a8ca0779a0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:25.037483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fc582317-6393-404e-a15b-86a8ca0779a0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:25.048786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc582317-6393-404e-a15b-86a8ca0779a0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:25.049538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc582317-6393-404e-a15b-86a8ca0779a0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:25.050965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc582317-6393-404e-a15b-86a8ca0779a0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:25.052108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc582317-6393-404e-a15b-86a8ca0779a0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:25.211213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fc582317-6393-404e-a15b-86a8ca0779a0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:25.220004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fc582317-6393-404e-a15b-86a8ca0779a0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.193532 Nov 02 23:25:25.220753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1690/2265] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:25 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:26.240673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ca1954ba-86ad-432c-8ddd-7cfad19ac667 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:26.241589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ca1954ba-86ad-432c-8ddd-7cfad19ac667 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:26.248878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ca1954ba-86ad-432c-8ddd-7cfad19ac667 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:26.249403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ca1954ba-86ad-432c-8ddd-7cfad19ac667 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:26.250328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ca1954ba-86ad-432c-8ddd-7cfad19ac667 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:26.250908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ca1954ba-86ad-432c-8ddd-7cfad19ac667 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:26.405980 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ca1954ba-86ad-432c-8ddd-7cfad19ac667 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:26.414964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ca1954ba-86ad-432c-8ddd-7cfad19ac667 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.178220 Nov 02 23:25:26.415567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1691/2266] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:26 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:27.433175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ac2046a6-13b3-4944-9adf-8a5aecf28c5d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:27.433911 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ac2046a6-13b3-4944-9adf-8a5aecf28c5d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:27.440601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac2046a6-13b3-4944-9adf-8a5aecf28c5d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:27.441051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac2046a6-13b3-4944-9adf-8a5aecf28c5d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:27.442010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac2046a6-13b3-4944-9adf-8a5aecf28c5d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:27.442398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac2046a6-13b3-4944-9adf-8a5aecf28c5d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:27.599126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ac2046a6-13b3-4944-9adf-8a5aecf28c5d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:27.608092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ac2046a6-13b3-4944-9adf-8a5aecf28c5d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.178588 Nov 02 23:25:27.608698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1692/2267] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:27 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:28.626659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d6debc2e-ee1e-4c28-8df8-72d1df304bac tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:28.627467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d6debc2e-ee1e-4c28-8df8-72d1df304bac tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:28.638734 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6debc2e-ee1e-4c28-8df8-72d1df304bac tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:28.639239 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6debc2e-ee1e-4c28-8df8-72d1df304bac tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:28.640051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6debc2e-ee1e-4c28-8df8-72d1df304bac tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:28.640485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6debc2e-ee1e-4c28-8df8-72d1df304bac tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:28.825191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d6debc2e-ee1e-4c28-8df8-72d1df304bac tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:28.834853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d6debc2e-ee1e-4c28-8df8-72d1df304bac tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.211180 Nov 02 23:25:28.835501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1693/2268] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:28 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:29.853209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bbff15b6-467c-4477-9aaf-468210d164f1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:29.853913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bbff15b6-467c-4477-9aaf-468210d164f1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:29.860307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bbff15b6-467c-4477-9aaf-468210d164f1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:29.860750 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bbff15b6-467c-4477-9aaf-468210d164f1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:29.861546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bbff15b6-467c-4477-9aaf-468210d164f1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:29.861976 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bbff15b6-467c-4477-9aaf-468210d164f1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:30.014584 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bbff15b6-467c-4477-9aaf-468210d164f1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:30.023905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bbff15b6-467c-4477-9aaf-468210d164f1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.175028 Nov 02 23:25:30.024654 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1694/2269] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:29 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:31.041424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-250eade0-332e-45c1-b3ac-cc955fee8582 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:31.042103 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-250eade0-332e-45c1-b3ac-cc955fee8582 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:31.049095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-250eade0-332e-45c1-b3ac-cc955fee8582 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:31.049542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-250eade0-332e-45c1-b3ac-cc955fee8582 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:31.050350 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-250eade0-332e-45c1-b3ac-cc955fee8582 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:31.050909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-250eade0-332e-45c1-b3ac-cc955fee8582 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:31.230523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-250eade0-332e-45c1-b3ac-cc955fee8582 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:31.240552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-250eade0-332e-45c1-b3ac-cc955fee8582 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.202691 Nov 02 23:25:31.241372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1695/2270] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:31 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:32.261367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ff8edc06-0b9b-4645-ae39-e2071926da85 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:32.262124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ff8edc06-0b9b-4645-ae39-e2071926da85 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:32.269094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff8edc06-0b9b-4645-ae39-e2071926da85 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:32.269699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff8edc06-0b9b-4645-ae39-e2071926da85 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:32.270490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff8edc06-0b9b-4645-ae39-e2071926da85 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:32.270953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff8edc06-0b9b-4645-ae39-e2071926da85 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:32.422202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ff8edc06-0b9b-4645-ae39-e2071926da85 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:32.430574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ff8edc06-0b9b-4645-ae39-e2071926da85 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.174893 Nov 02 23:25:32.431224 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1696/2271] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:32 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:25:33.457820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-044146ac-cd18-4df8-8c3e-8f3be4e71648 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:33.459574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-044146ac-cd18-4df8-8c3e-8f3be4e71648 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:33.471225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-044146ac-cd18-4df8-8c3e-8f3be4e71648 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:33.471985 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-044146ac-cd18-4df8-8c3e-8f3be4e71648 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:33.473403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-044146ac-cd18-4df8-8c3e-8f3be4e71648 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:33.474169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-044146ac-cd18-4df8-8c3e-8f3be4e71648 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:33.637479 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-044146ac-cd18-4df8-8c3e-8f3be4e71648 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:33.647126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-044146ac-cd18-4df8-8c3e-8f3be4e71648 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.195861 Nov 02 23:25:33.647813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1697/2272] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:33 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:34.665924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-119f1ea2-5e27-4940-acb6-68aa24dc9a80 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:34.666669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-119f1ea2-5e27-4940-acb6-68aa24dc9a80 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:34.673996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-119f1ea2-5e27-4940-acb6-68aa24dc9a80 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:34.674441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-119f1ea2-5e27-4940-acb6-68aa24dc9a80 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:34.675280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-119f1ea2-5e27-4940-acb6-68aa24dc9a80 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:34.675783 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-119f1ea2-5e27-4940-acb6-68aa24dc9a80 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:34.838788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-119f1ea2-5e27-4940-acb6-68aa24dc9a80 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:34.847164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-119f1ea2-5e27-4940-acb6-68aa24dc9a80 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.185454 Nov 02 23:25:34.847767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1698/2273] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:34 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:35.872231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6eddac57-cbfc-4d75-8e0d-8837b78623f8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:35.873283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6eddac57-cbfc-4d75-8e0d-8837b78623f8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:35.879775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6eddac57-cbfc-4d75-8e0d-8837b78623f8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:35.880105 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6eddac57-cbfc-4d75-8e0d-8837b78623f8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:35.881487 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6eddac57-cbfc-4d75-8e0d-8837b78623f8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:35.881924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6eddac57-cbfc-4d75-8e0d-8837b78623f8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:36.048287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6eddac57-cbfc-4d75-8e0d-8837b78623f8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:36.058327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6eddac57-cbfc-4d75-8e0d-8837b78623f8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.189758 Nov 02 23:25:36.059076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1699/2274] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:35 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:37.076358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bd5fd3a6-8958-46ac-ae08-b55a0ddf1dca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:37.077416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bd5fd3a6-8958-46ac-ae08-b55a0ddf1dca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:37.084071 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bd5fd3a6-8958-46ac-ae08-b55a0ddf1dca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:37.084596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bd5fd3a6-8958-46ac-ae08-b55a0ddf1dca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:37.085447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bd5fd3a6-8958-46ac-ae08-b55a0ddf1dca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:37.085890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bd5fd3a6-8958-46ac-ae08-b55a0ddf1dca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:37.244531 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bd5fd3a6-8958-46ac-ae08-b55a0ddf1dca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:37.254054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bd5fd3a6-8958-46ac-ae08-b55a0ddf1dca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.181239 Nov 02 23:25:37.254660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1700/2275] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:37 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:38.280688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-64b68bd9-e1c5-49a3-950e-7b51712bc432 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:38.281425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-64b68bd9-e1c5-49a3-950e-7b51712bc432 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:38.288764 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-64b68bd9-e1c5-49a3-950e-7b51712bc432 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:38.289271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-64b68bd9-e1c5-49a3-950e-7b51712bc432 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:38.290114 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-64b68bd9-e1c5-49a3-950e-7b51712bc432 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:38.290578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-64b68bd9-e1c5-49a3-950e-7b51712bc432 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:38.446605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-64b68bd9-e1c5-49a3-950e-7b51712bc432 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:38.455613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-64b68bd9-e1c5-49a3-950e-7b51712bc432 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.178637 Nov 02 23:25:38.456217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1701/2276] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:38 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:39.473702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8e8fbc2d-30a4-4472-80d5-6b8f7945dd2b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:39.475098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8e8fbc2d-30a4-4472-80d5-6b8f7945dd2b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:39.482166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e8fbc2d-30a4-4472-80d5-6b8f7945dd2b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:39.482606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e8fbc2d-30a4-4472-80d5-6b8f7945dd2b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:39.483437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e8fbc2d-30a4-4472-80d5-6b8f7945dd2b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:39.483862 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e8fbc2d-30a4-4472-80d5-6b8f7945dd2b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:39.634570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8e8fbc2d-30a4-4472-80d5-6b8f7945dd2b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:39.649758 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8e8fbc2d-30a4-4472-80d5-6b8f7945dd2b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.180006 Nov 02 23:25:39.650943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1702/2277] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:39 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:40.677362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9c6ec2ab-a36b-4f17-acbf-a689deff7835 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:40.678111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9c6ec2ab-a36b-4f17-acbf-a689deff7835 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:40.684652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c6ec2ab-a36b-4f17-acbf-a689deff7835 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:40.685088 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c6ec2ab-a36b-4f17-acbf-a689deff7835 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:40.685909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c6ec2ab-a36b-4f17-acbf-a689deff7835 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:40.686303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c6ec2ab-a36b-4f17-acbf-a689deff7835 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:40.826108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9c6ec2ab-a36b-4f17-acbf-a689deff7835 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:40.834539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9c6ec2ab-a36b-4f17-acbf-a689deff7835 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.161871 Nov 02 23:25:40.835173 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1703/2278] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:40 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:25:41.853089 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-270cdadf-dfba-4410-b92c-dd1773fda396 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:41.853865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-270cdadf-dfba-4410-b92c-dd1773fda396 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:41.861255 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-270cdadf-dfba-4410-b92c-dd1773fda396 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:41.861748 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-270cdadf-dfba-4410-b92c-dd1773fda396 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:41.862550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-270cdadf-dfba-4410-b92c-dd1773fda396 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:41.863068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-270cdadf-dfba-4410-b92c-dd1773fda396 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:42.028932 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-270cdadf-dfba-4410-b92c-dd1773fda396 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:42.037011 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-270cdadf-dfba-4410-b92c-dd1773fda396 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.188776 Nov 02 23:25:42.037601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1704/2279] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:41 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:43.055863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8c4703d4-0ea4-4975-b2e1-9aa5f028a75f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:43.056580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8c4703d4-0ea4-4975-b2e1-9aa5f028a75f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:43.064044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c4703d4-0ea4-4975-b2e1-9aa5f028a75f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:43.064557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c4703d4-0ea4-4975-b2e1-9aa5f028a75f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:43.065462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c4703d4-0ea4-4975-b2e1-9aa5f028a75f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:43.065893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c4703d4-0ea4-4975-b2e1-9aa5f028a75f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:43.233846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8c4703d4-0ea4-4975-b2e1-9aa5f028a75f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:43.243219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8c4703d4-0ea4-4975-b2e1-9aa5f028a75f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.192174 Nov 02 23:25:43.243808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1705/2280] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:43 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:43.271332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ac79317d-6cc7-4cbf-81a8-d6b3787008f6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:43.271968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ac79317d-6cc7-4cbf-81a8-d6b3787008f6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:43.278501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac79317d-6cc7-4cbf-81a8-d6b3787008f6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:43.278984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac79317d-6cc7-4cbf-81a8-d6b3787008f6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:43.279778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac79317d-6cc7-4cbf-81a8-d6b3787008f6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:43.280211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac79317d-6cc7-4cbf-81a8-d6b3787008f6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:43.310326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ac79317d-6cc7-4cbf-81a8-d6b3787008f6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Going to try to terminate instance {{(pid=115800) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 23:25:43.400503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ac79317d-6cc7-4cbf-81a8-d6b3787008f6 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "DELETE /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651" status: 204 len: 0 microversion: 2.1 time: 0.132971 Nov 02 23:25:43.401468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1706/2281] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:25:43 2021] DELETE /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 23:25:43.410666 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-db0fa3aa-8a49-4ff6-9e6b-e045fb9bda87 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:43.411403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-db0fa3aa-8a49-4ff6-9e6b-e045fb9bda87 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:43.419225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db0fa3aa-8a49-4ff6-9e6b-e045fb9bda87 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:43.419710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db0fa3aa-8a49-4ff6-9e6b-e045fb9bda87 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:43.420461 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db0fa3aa-8a49-4ff6-9e6b-e045fb9bda87 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:43.420889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db0fa3aa-8a49-4ff6-9e6b-e045fb9bda87 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:43.565474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-db0fa3aa-8a49-4ff6-9e6b-e045fb9bda87 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:43.573815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-db0fa3aa-8a49-4ff6-9e6b-e045fb9bda87 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651" status: 200 len: 1674 microversion: 2.1 time: 0.167180 Nov 02 23:25:43.574412 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1707/2282] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:43 2021] GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651 => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:44.269131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b6ffbb50-78cb-45f8-a5ee-27deb876c3b5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:44.269947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b6ffbb50-78cb-45f8-a5ee-27deb876c3b5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:44.277942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6ffbb50-78cb-45f8-a5ee-27deb876c3b5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:44.278560 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6ffbb50-78cb-45f8-a5ee-27deb876c3b5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:44.279575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6ffbb50-78cb-45f8-a5ee-27deb876c3b5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:44.280112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6ffbb50-78cb-45f8-a5ee-27deb876c3b5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:44.443703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b6ffbb50-78cb-45f8-a5ee-27deb876c3b5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:44.451957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b6ffbb50-78cb-45f8-a5ee-27deb876c3b5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.187351 Nov 02 23:25:44.452562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1708/2283] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:44 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:44.596395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0b50b112-41e9-4bce-b6ef-aed47dfb3351 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:44.597063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0b50b112-41e9-4bce-b6ef-aed47dfb3351 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:44.605248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b50b112-41e9-4bce-b6ef-aed47dfb3351 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:44.606000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b50b112-41e9-4bce-b6ef-aed47dfb3351 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:44.607230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b50b112-41e9-4bce-b6ef-aed47dfb3351 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:44.607975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b50b112-41e9-4bce-b6ef-aed47dfb3351 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:44.753392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0b50b112-41e9-4bce-b6ef-aed47dfb3351 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:44.761529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0b50b112-41e9-4bce-b6ef-aed47dfb3351 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651" status: 200 len: 1674 microversion: 2.1 time: 0.171843 Nov 02 23:25:44.762222 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1709/2284] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:44 2021] GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651 => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:45.367941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-18ec3963-5980-4dcc-9e0c-15a9ee67c46a req-0871a7b1-6fef-4452-8206-8576ee593c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91317c10-28a4-413c-ae6d-2021c9ed1651", "name": "network-vif-deleted", "tag": "fff599b7-42ec-4525-81ff-f6549fc87633"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:25:45.372059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:25:45.372059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:25:45.385901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-18ec3963-5980-4dcc-9e0c-15a9ee67c46a req-0871a7b1-6fef-4452-8206-8576ee593c42 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:45.386682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-18ec3963-5980-4dcc-9e0c-15a9ee67c46a req-0871a7b1-6fef-4452-8206-8576ee593c42 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:45.411423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-18ec3963-5980-4dcc-9e0c-15a9ee67c46a req-0871a7b1-6fef-4452-8206-8576ee593c42 service nova] Creating event network-vif-deleted:fff599b7-42ec-4525-81ff-f6549fc87633 for instance 91317c10-28a4-413c-ae6d-2021c9ed1651 on hv-cinder-81584 Nov 02 23:25:45.421358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-18ec3963-5980-4dcc-9e0c-15a9ee67c46a req-0871a7b1-6fef-4452-8206-8576ee593c42 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061584 Nov 02 23:25:45.423444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1710/2285] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:25:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:25:45.474900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dc3ef67d-be25-42f1-82fa-3c687d6cb402 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:45.476569 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dc3ef67d-be25-42f1-82fa-3c687d6cb402 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:45.487022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dc3ef67d-be25-42f1-82fa-3c687d6cb402 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:45.487485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dc3ef67d-be25-42f1-82fa-3c687d6cb402 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:45.488281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dc3ef67d-be25-42f1-82fa-3c687d6cb402 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:45.488716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dc3ef67d-be25-42f1-82fa-3c687d6cb402 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:45.683785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dc3ef67d-be25-42f1-82fa-3c687d6cb402 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:45.701542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dc3ef67d-be25-42f1-82fa-3c687d6cb402 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.232756 Nov 02 23:25:45.708946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1711/2286] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:45 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:25:45.780889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1ed1c589-1eed-4e29-ba9b-03334034620c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:45.781555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1ed1c589-1eed-4e29-ba9b-03334034620c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:45.790556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ed1c589-1eed-4e29-ba9b-03334034620c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:45.791382 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ed1c589-1eed-4e29-ba9b-03334034620c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:45.792205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ed1c589-1eed-4e29-ba9b-03334034620c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:45.792738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ed1c589-1eed-4e29-ba9b-03334034620c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:45.839315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ed1c589-1eed-4e29-ba9b-03334034620c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:45.839772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ed1c589-1eed-4e29-ba9b-03334034620c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:45.840236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.objects.instance [None req-1ed1c589-1eed-4e29-ba9b-03334034620c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lazy-loading 'fault' on Instance uuid 91317c10-28a4-413c-ae6d-2021c9ed1651 {{(pid=115800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 23:25:45.894873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1ed1c589-1eed-4e29-ba9b-03334034620c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b6bd01b54d492f9d37414393e9aec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f208bd920d437bb32e5caebf9eb2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:45.906562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1ed1c589-1eed-4e29-ba9b-03334034620c tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651" status: 200 len: 1327 microversion: 2.1 time: 0.131080 Nov 02 23:25:45.907383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1712/2287] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:45 2021] GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651 => generated 1327 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:46.730268 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d5274c86-d483-42cb-a081-0611b97a782b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:46.731071 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d5274c86-d483-42cb-a081-0611b97a782b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:46.737959 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d5274c86-d483-42cb-a081-0611b97a782b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:46.738407 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d5274c86-d483-42cb-a081-0611b97a782b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:46.739236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d5274c86-d483-42cb-a081-0611b97a782b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:46.740299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d5274c86-d483-42cb-a081-0611b97a782b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:46.897327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d5274c86-d483-42cb-a081-0611b97a782b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:46.906440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d5274c86-d483-42cb-a081-0611b97a782b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.180699 Nov 02 23:25:46.907102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1713/2288] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:46 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:46.930732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2f2eab0b-9b27-4a9f-b5fe-02888c778b44 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:46.931819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2f2eab0b-9b27-4a9f-b5fe-02888c778b44 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:46.941733 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2f2eab0b-9b27-4a9f-b5fe-02888c778b44 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:46.942459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2f2eab0b-9b27-4a9f-b5fe-02888c778b44 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:46.944757 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2f2eab0b-9b27-4a9f-b5fe-02888c778b44 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:46.945554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2f2eab0b-9b27-4a9f-b5fe-02888c778b44 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:46.972003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-2f2eab0b-9b27-4a9f-b5fe-02888c778b44 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] HTTP exception thrown: Instance 91317c10-28a4-413c-ae6d-2021c9ed1651 could not be found. Nov 02 23:25:46.973069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2f2eab0b-9b27-4a9f-b5fe-02888c778b44 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Returning 404 to user: Instance 91317c10-28a4-413c-ae6d-2021c9ed1651 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:25:46.974487 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2f2eab0b-9b27-4a9f-b5fe-02888c778b44 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651" status: 404 len: 111 microversion: 2.1 time: 0.050994 Nov 02 23:25:46.975460 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1714/2289] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:46 2021] GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 23:25:46.989057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7ac7e71f-e247-43e9-840b-a662d68e886f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '.version_select at 0x7fd8581f6d30>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:47.020368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7ac7e71f-e247-43e9-840b-a662d68e886f tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-870691422" status: 202 len: 0 microversion: 2.1 time: 0.037889 Nov 02 23:25:47.021037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1715/2290] 10.222.0.41 () {58 vars in 1217 bytes} [Tue Nov 2 23:25:46 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-870691422 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:25:47.928660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b6ff8e8b-221c-49e8-906d-360414bee59c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:47.929791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b6ff8e8b-221c-49e8-906d-360414bee59c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:47.947299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6ff8e8b-221c-49e8-906d-360414bee59c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:47.947299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6ff8e8b-221c-49e8-906d-360414bee59c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:47.947299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6ff8e8b-221c-49e8-906d-360414bee59c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:47.947299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6ff8e8b-221c-49e8-906d-360414bee59c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:48.107147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b6ff8e8b-221c-49e8-906d-360414bee59c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:48.116473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b6ff8e8b-221c-49e8-906d-360414bee59c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.195454 Nov 02 23:25:48.117071 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1716/2291] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:47 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:25:49.141638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-57864ebe-4b32-489f-9f2c-ed234ce6e28e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:49.142333 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-57864ebe-4b32-489f-9f2c-ed234ce6e28e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:49.149392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-57864ebe-4b32-489f-9f2c-ed234ce6e28e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:49.149842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-57864ebe-4b32-489f-9f2c-ed234ce6e28e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:49.150628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-57864ebe-4b32-489f-9f2c-ed234ce6e28e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:49.151099 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-57864ebe-4b32-489f-9f2c-ed234ce6e28e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:49.332561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-57864ebe-4b32-489f-9f2c-ed234ce6e28e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:49.341251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-57864ebe-4b32-489f-9f2c-ed234ce6e28e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.203314 Nov 02 23:25:49.341872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1717/2292] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:49 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:50.359090 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c8070b7c-b158-48df-93c9-5abd3950794e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:50.360153 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c8070b7c-b158-48df-93c9-5abd3950794e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:50.368007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8070b7c-b158-48df-93c9-5abd3950794e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:50.368508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8070b7c-b158-48df-93c9-5abd3950794e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:50.369446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8070b7c-b158-48df-93c9-5abd3950794e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:50.370035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8070b7c-b158-48df-93c9-5abd3950794e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:50.514393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c8070b7c-b158-48df-93c9-5abd3950794e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:50.525063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c8070b7c-b158-48df-93c9-5abd3950794e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.169799 Nov 02 23:25:50.525941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1718/2293] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:50 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:25:51.550103 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b266f212-0cf3-4eaf-ae3b-e26d666d2d37 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:51.550852 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b266f212-0cf3-4eaf-ae3b-e26d666d2d37 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:51.557989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b266f212-0cf3-4eaf-ae3b-e26d666d2d37 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:51.558433 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b266f212-0cf3-4eaf-ae3b-e26d666d2d37 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:51.559315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b266f212-0cf3-4eaf-ae3b-e26d666d2d37 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:51.559743 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b266f212-0cf3-4eaf-ae3b-e26d666d2d37 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:51.733832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b266f212-0cf3-4eaf-ae3b-e26d666d2d37 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:51.742808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b266f212-0cf3-4eaf-ae3b-e26d666d2d37 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.196329 Nov 02 23:25:51.743451 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1719/2294] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:51 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:52.760205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-90445ee2-6f22-4c77-9136-c11132998bf6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:52.761089 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-90445ee2-6f22-4c77-9136-c11132998bf6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:52.768283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-90445ee2-6f22-4c77-9136-c11132998bf6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:52.768766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-90445ee2-6f22-4c77-9136-c11132998bf6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:52.769632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-90445ee2-6f22-4c77-9136-c11132998bf6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:52.770074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-90445ee2-6f22-4c77-9136-c11132998bf6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:52.931806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-90445ee2-6f22-4c77-9136-c11132998bf6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:52.940528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-90445ee2-6f22-4c77-9136-c11132998bf6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.184057 Nov 02 23:25:52.941128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1720/2295] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:52 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:53.960104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-723df171-9e1b-4224-9909-962829da7472 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:53.960867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-723df171-9e1b-4224-9909-962829da7472 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:53.968139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-723df171-9e1b-4224-9909-962829da7472 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:53.968588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-723df171-9e1b-4224-9909-962829da7472 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:53.969667 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-723df171-9e1b-4224-9909-962829da7472 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:53.970114 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-723df171-9e1b-4224-9909-962829da7472 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:54.134224 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-723df171-9e1b-4224-9909-962829da7472 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:54.143434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-723df171-9e1b-4224-9909-962829da7472 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.187815 Nov 02 23:25:54.144183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1721/2296] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:53 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:55.161645 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-74ae436b-d246-4b1a-9ad9-b9395ca32011 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:55.162369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-74ae436b-d246-4b1a-9ad9-b9395ca32011 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:55.169836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74ae436b-d246-4b1a-9ad9-b9395ca32011 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:55.170425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74ae436b-d246-4b1a-9ad9-b9395ca32011 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:55.171584 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74ae436b-d246-4b1a-9ad9-b9395ca32011 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:55.172181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74ae436b-d246-4b1a-9ad9-b9395ca32011 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:55.323432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-74ae436b-d246-4b1a-9ad9-b9395ca32011 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:55.331665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-74ae436b-d246-4b1a-9ad9-b9395ca32011 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.173936 Nov 02 23:25:55.332254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1722/2297] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:55 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:56.349867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bb3794c5-6351-4e63-b8ac-53928e582f6c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:56.350643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bb3794c5-6351-4e63-b8ac-53928e582f6c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:56.357086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bb3794c5-6351-4e63-b8ac-53928e582f6c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:56.357526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bb3794c5-6351-4e63-b8ac-53928e582f6c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:56.358305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bb3794c5-6351-4e63-b8ac-53928e582f6c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:56.358731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bb3794c5-6351-4e63-b8ac-53928e582f6c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:56.501906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bb3794c5-6351-4e63-b8ac-53928e582f6c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:56.510213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bb3794c5-6351-4e63-b8ac-53928e582f6c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.164489 Nov 02 23:25:56.510800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1723/2298] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:56 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:57.528313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-559774fa-fafc-4640-bdce-57987f85dd16 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:57.529060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-559774fa-fafc-4640-bdce-57987f85dd16 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:57.537835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-559774fa-fafc-4640-bdce-57987f85dd16 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:57.538571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-559774fa-fafc-4640-bdce-57987f85dd16 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:57.540317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-559774fa-fafc-4640-bdce-57987f85dd16 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:57.541139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-559774fa-fafc-4640-bdce-57987f85dd16 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:57.687744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-559774fa-fafc-4640-bdce-57987f85dd16 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:57.698394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-559774fa-fafc-4640-bdce-57987f85dd16 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.173649 Nov 02 23:25:57.699016 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1724/2299] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:57 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:58.715462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b9d71176-1e69-4b1b-83af-c8cf648d1d12 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:58.716539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b9d71176-1e69-4b1b-83af-c8cf648d1d12 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:58.722496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9d71176-1e69-4b1b-83af-c8cf648d1d12 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:58.722964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9d71176-1e69-4b1b-83af-c8cf648d1d12 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:58.724320 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9d71176-1e69-4b1b-83af-c8cf648d1d12 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:58.724740 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9d71176-1e69-4b1b-83af-c8cf648d1d12 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:58.898331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b9d71176-1e69-4b1b-83af-c8cf648d1d12 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:25:58.906793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b9d71176-1e69-4b1b-83af-c8cf648d1d12 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.194942 Nov 02 23:25:58.907435 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1725/2300] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:58 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:25:59.924790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b685a46c-dbf2-49b0-b57a-3513fd2072ca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:25:59.925851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b685a46c-dbf2-49b0-b57a-3513fd2072ca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:25:59.932370 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b685a46c-dbf2-49b0-b57a-3513fd2072ca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:59.932826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b685a46c-dbf2-49b0-b57a-3513fd2072ca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:25:59.933611 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b685a46c-dbf2-49b0-b57a-3513fd2072ca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:25:59.934047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b685a46c-dbf2-49b0-b57a-3513fd2072ca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:00.084299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b685a46c-dbf2-49b0-b57a-3513fd2072ca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:00.092513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b685a46c-dbf2-49b0-b57a-3513fd2072ca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.171637 Nov 02 23:26:00.093130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1726/2301] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:25:59 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:01.110700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e2066d10-2bdb-4def-a8c3-7ecb2e6ff7ff tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:01.111548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e2066d10-2bdb-4def-a8c3-7ecb2e6ff7ff tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:01.118310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e2066d10-2bdb-4def-a8c3-7ecb2e6ff7ff tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:01.118861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e2066d10-2bdb-4def-a8c3-7ecb2e6ff7ff tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:01.119741 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e2066d10-2bdb-4def-a8c3-7ecb2e6ff7ff tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:01.120227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e2066d10-2bdb-4def-a8c3-7ecb2e6ff7ff tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:01.265413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e2066d10-2bdb-4def-a8c3-7ecb2e6ff7ff tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:01.274044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e2066d10-2bdb-4def-a8c3-7ecb2e6ff7ff tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.167121 Nov 02 23:26:01.274626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1727/2302] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:01 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:02.291296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c1a76c6f-eb6f-4ae4-bc2f-e3ca8435c173 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:02.291981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c1a76c6f-eb6f-4ae4-bc2f-e3ca8435c173 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:02.302286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c1a76c6f-eb6f-4ae4-bc2f-e3ca8435c173 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:02.302733 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c1a76c6f-eb6f-4ae4-bc2f-e3ca8435c173 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:02.303557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c1a76c6f-eb6f-4ae4-bc2f-e3ca8435c173 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:02.303993 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c1a76c6f-eb6f-4ae4-bc2f-e3ca8435c173 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:02.447371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c1a76c6f-eb6f-4ae4-bc2f-e3ca8435c173 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:02.455517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c1a76c6f-eb6f-4ae4-bc2f-e3ca8435c173 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.168068 Nov 02 23:26:02.456108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1728/2303] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:02 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:03.473006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-81d50fb1-8b70-41ef-9fea-85d96b9c8078 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:03.473678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-81d50fb1-8b70-41ef-9fea-85d96b9c8078 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:03.480142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81d50fb1-8b70-41ef-9fea-85d96b9c8078 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:03.480588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81d50fb1-8b70-41ef-9fea-85d96b9c8078 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:03.481374 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81d50fb1-8b70-41ef-9fea-85d96b9c8078 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:03.481807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81d50fb1-8b70-41ef-9fea-85d96b9c8078 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:03.630357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-81d50fb1-8b70-41ef-9fea-85d96b9c8078 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:03.638774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-81d50fb1-8b70-41ef-9fea-85d96b9c8078 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.169434 Nov 02 23:26:03.639413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1729/2304] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:03 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:04.656413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ffc7c319-a77a-433b-86ed-0ba60dbf1acc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:04.657159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ffc7c319-a77a-433b-86ed-0ba60dbf1acc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:04.664139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ffc7c319-a77a-433b-86ed-0ba60dbf1acc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:04.664592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ffc7c319-a77a-433b-86ed-0ba60dbf1acc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:04.665391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ffc7c319-a77a-433b-86ed-0ba60dbf1acc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:04.665829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ffc7c319-a77a-433b-86ed-0ba60dbf1acc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:04.818507 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ffc7c319-a77a-433b-86ed-0ba60dbf1acc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:04.826845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ffc7c319-a77a-433b-86ed-0ba60dbf1acc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.174572 Nov 02 23:26:04.827469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1730/2305] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:04 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:05.844829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-39097dca-03b0-476c-b5f9-ed4b1068de77 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:05.845570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-39097dca-03b0-476c-b5f9-ed4b1068de77 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:05.853109 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39097dca-03b0-476c-b5f9-ed4b1068de77 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:05.853565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39097dca-03b0-476c-b5f9-ed4b1068de77 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:05.854357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39097dca-03b0-476c-b5f9-ed4b1068de77 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:05.854791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39097dca-03b0-476c-b5f9-ed4b1068de77 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:06.025932 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-39097dca-03b0-476c-b5f9-ed4b1068de77 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:06.034457 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-39097dca-03b0-476c-b5f9-ed4b1068de77 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.193317 Nov 02 23:26:06.035074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1731/2306] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:05 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:07.063142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-90bd8731-3386-458f-b677-78b026236f91 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:07.064135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-90bd8731-3386-458f-b677-78b026236f91 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:07.075154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-90bd8731-3386-458f-b677-78b026236f91 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:07.075888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-90bd8731-3386-458f-b677-78b026236f91 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:07.077145 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-90bd8731-3386-458f-b677-78b026236f91 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:07.077841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-90bd8731-3386-458f-b677-78b026236f91 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:07.228806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-90bd8731-3386-458f-b677-78b026236f91 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:07.241684 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-90bd8731-3386-458f-b677-78b026236f91 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.184984 Nov 02 23:26:07.242400 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1732/2307] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:07 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:08.262480 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1dcc3f8c-ed59-4748-89c0-647850ed16af tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:08.263717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1dcc3f8c-ed59-4748-89c0-647850ed16af tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:08.274541 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1dcc3f8c-ed59-4748-89c0-647850ed16af tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:08.275362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1dcc3f8c-ed59-4748-89c0-647850ed16af tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:08.276793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1dcc3f8c-ed59-4748-89c0-647850ed16af tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:08.277566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1dcc3f8c-ed59-4748-89c0-647850ed16af tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:08.445355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1dcc3f8c-ed59-4748-89c0-647850ed16af tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:08.453358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1dcc3f8c-ed59-4748-89c0-647850ed16af tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.197684 Nov 02 23:26:08.453940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1733/2308] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:08 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:09.470861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cb59c8eb-3cc6-4c68-96ca-dc283ef764a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:09.471648 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cb59c8eb-3cc6-4c68-96ca-dc283ef764a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:09.478262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cb59c8eb-3cc6-4c68-96ca-dc283ef764a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:09.478704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cb59c8eb-3cc6-4c68-96ca-dc283ef764a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:09.479519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cb59c8eb-3cc6-4c68-96ca-dc283ef764a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:09.479945 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cb59c8eb-3cc6-4c68-96ca-dc283ef764a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:09.636214 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cb59c8eb-3cc6-4c68-96ca-dc283ef764a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:09.645495 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cb59c8eb-3cc6-4c68-96ca-dc283ef764a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.178313 Nov 02 23:26:09.646396 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1734/2309] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:09 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:10.666890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-72718884-c658-4d6b-8fda-17370f1bd3c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:10.667926 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-72718884-c658-4d6b-8fda-17370f1bd3c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:10.674766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72718884-c658-4d6b-8fda-17370f1bd3c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:10.675256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72718884-c658-4d6b-8fda-17370f1bd3c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:10.676076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72718884-c658-4d6b-8fda-17370f1bd3c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:10.677075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72718884-c658-4d6b-8fda-17370f1bd3c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:10.827450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-72718884-c658-4d6b-8fda-17370f1bd3c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:10.836470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-72718884-c658-4d6b-8fda-17370f1bd3c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.176450 Nov 02 23:26:10.837050 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1735/2310] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:10 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:11.853698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4d5fa3db-55ee-46bd-80f8-8626f6d5cc79 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:11.854386 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4d5fa3db-55ee-46bd-80f8-8626f6d5cc79 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:11.860730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d5fa3db-55ee-46bd-80f8-8626f6d5cc79 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:11.861217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d5fa3db-55ee-46bd-80f8-8626f6d5cc79 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:11.862031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d5fa3db-55ee-46bd-80f8-8626f6d5cc79 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:11.862469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d5fa3db-55ee-46bd-80f8-8626f6d5cc79 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:12.000642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4d5fa3db-55ee-46bd-80f8-8626f6d5cc79 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:12.009153 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4d5fa3db-55ee-46bd-80f8-8626f6d5cc79 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.159191 Nov 02 23:26:12.009738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1736/2311] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:11 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:13.027619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-731a6044-7986-49d9-9cde-f78ec528e2fe tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:13.028368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-731a6044-7986-49d9-9cde-f78ec528e2fe tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:13.035231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-731a6044-7986-49d9-9cde-f78ec528e2fe tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:13.035679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-731a6044-7986-49d9-9cde-f78ec528e2fe tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:13.036460 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-731a6044-7986-49d9-9cde-f78ec528e2fe tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:13.036899 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-731a6044-7986-49d9-9cde-f78ec528e2fe tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:13.177968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-731a6044-7986-49d9-9cde-f78ec528e2fe tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:13.185890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-731a6044-7986-49d9-9cde-f78ec528e2fe tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.162301 Nov 02 23:26:13.186473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1737/2312] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:13 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:14.203940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-574e8e4f-d5f4-40dd-b20d-c9465116667e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:14.204671 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-574e8e4f-d5f4-40dd-b20d-c9465116667e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:14.212005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-574e8e4f-d5f4-40dd-b20d-c9465116667e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:14.213197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-574e8e4f-d5f4-40dd-b20d-c9465116667e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:14.214006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-574e8e4f-d5f4-40dd-b20d-c9465116667e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:14.214629 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-574e8e4f-d5f4-40dd-b20d-c9465116667e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:14.358683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-574e8e4f-d5f4-40dd-b20d-c9465116667e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:14.373087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-574e8e4f-d5f4-40dd-b20d-c9465116667e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.172456 Nov 02 23:26:14.374164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1738/2313] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:14 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:15.390875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-989a32a2-796c-456e-9097-117cda4489aa tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:15.391676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-989a32a2-796c-456e-9097-117cda4489aa tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:15.398580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-989a32a2-796c-456e-9097-117cda4489aa tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:15.399078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-989a32a2-796c-456e-9097-117cda4489aa tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:15.399879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-989a32a2-796c-456e-9097-117cda4489aa tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:15.400310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-989a32a2-796c-456e-9097-117cda4489aa tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:15.548550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-989a32a2-796c-456e-9097-117cda4489aa tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:15.557287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-989a32a2-796c-456e-9097-117cda4489aa tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.170258 Nov 02 23:26:15.557996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1739/2314] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:15 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:16.576706 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-801056c6-df98-4bea-aaa5-fc4ac45d6bd9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:16.577577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-801056c6-df98-4bea-aaa5-fc4ac45d6bd9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:16.587119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-801056c6-df98-4bea-aaa5-fc4ac45d6bd9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:16.587718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-801056c6-df98-4bea-aaa5-fc4ac45d6bd9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:16.588709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-801056c6-df98-4bea-aaa5-fc4ac45d6bd9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:16.589250 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-801056c6-df98-4bea-aaa5-fc4ac45d6bd9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:16.749148 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-801056c6-df98-4bea-aaa5-fc4ac45d6bd9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:16.759419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-801056c6-df98-4bea-aaa5-fc4ac45d6bd9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.186116 Nov 02 23:26:16.760581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1740/2315] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:16 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:17.787289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c7fa95ff-33b4-4699-a293-abe7d1d72108 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:17.788398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c7fa95ff-33b4-4699-a293-abe7d1d72108 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:17.799180 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7fa95ff-33b4-4699-a293-abe7d1d72108 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:17.799974 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7fa95ff-33b4-4699-a293-abe7d1d72108 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:17.801859 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7fa95ff-33b4-4699-a293-abe7d1d72108 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:17.802658 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7fa95ff-33b4-4699-a293-abe7d1d72108 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:17.999150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c7fa95ff-33b4-4699-a293-abe7d1d72108 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:18.008096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c7fa95ff-33b4-4699-a293-abe7d1d72108 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.227653 Nov 02 23:26:18.008724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1741/2316] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:17 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:26:19.025564 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-729e6f7a-b879-421b-957e-9cf81efd5708 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:19.026187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-729e6f7a-b879-421b-957e-9cf81efd5708 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:19.032683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-729e6f7a-b879-421b-957e-9cf81efd5708 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:19.033125 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-729e6f7a-b879-421b-957e-9cf81efd5708 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:19.033903 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-729e6f7a-b879-421b-957e-9cf81efd5708 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:19.034331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-729e6f7a-b879-421b-957e-9cf81efd5708 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:19.174758 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-729e6f7a-b879-421b-957e-9cf81efd5708 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:19.189226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-729e6f7a-b879-421b-957e-9cf81efd5708 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.167046 Nov 02 23:26:19.190286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1742/2317] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:19 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:20.207026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-54a6ace1-4161-4720-b2af-cffc5df4b669 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:20.207808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-54a6ace1-4161-4720-b2af-cffc5df4b669 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:20.214154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-54a6ace1-4161-4720-b2af-cffc5df4b669 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:20.214599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-54a6ace1-4161-4720-b2af-cffc5df4b669 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:20.215410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-54a6ace1-4161-4720-b2af-cffc5df4b669 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:20.215842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-54a6ace1-4161-4720-b2af-cffc5df4b669 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:20.355904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-54a6ace1-4161-4720-b2af-cffc5df4b669 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:20.364311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-54a6ace1-4161-4720-b2af-cffc5df4b669 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.160386 Nov 02 23:26:20.364888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1743/2318] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:20 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:21.381637 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a1fc82a1-af19-4420-9390-1d63f3116179 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:21.382398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a1fc82a1-af19-4420-9390-1d63f3116179 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:21.395505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a1fc82a1-af19-4420-9390-1d63f3116179 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:21.395948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a1fc82a1-af19-4420-9390-1d63f3116179 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:21.396719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a1fc82a1-af19-4420-9390-1d63f3116179 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:21.397146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a1fc82a1-af19-4420-9390-1d63f3116179 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:21.556459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a1fc82a1-af19-4420-9390-1d63f3116179 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:21.564688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a1fc82a1-af19-4420-9390-1d63f3116179 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.186779 Nov 02 23:26:21.565285 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1744/2319] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:21 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:22.586352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-371e431a-8231-44bf-88af-5a5be7780aba tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:22.587572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-371e431a-8231-44bf-88af-5a5be7780aba tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:22.598297 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-371e431a-8231-44bf-88af-5a5be7780aba tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:22.599137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-371e431a-8231-44bf-88af-5a5be7780aba tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:22.600553 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-371e431a-8231-44bf-88af-5a5be7780aba tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:22.601345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-371e431a-8231-44bf-88af-5a5be7780aba tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:22.756969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-371e431a-8231-44bf-88af-5a5be7780aba tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:22.772059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-371e431a-8231-44bf-88af-5a5be7780aba tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.192346 Nov 02 23:26:22.773192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1745/2320] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:22 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:23.790261 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0f3ad1b1-c920-42d0-893d-31d879deea58 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:23.791094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0f3ad1b1-c920-42d0-893d-31d879deea58 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:23.798004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0f3ad1b1-c920-42d0-893d-31d879deea58 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:23.798491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0f3ad1b1-c920-42d0-893d-31d879deea58 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:23.799374 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0f3ad1b1-c920-42d0-893d-31d879deea58 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:23.799917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0f3ad1b1-c920-42d0-893d-31d879deea58 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:23.950292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0f3ad1b1-c920-42d0-893d-31d879deea58 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:23.958655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0f3ad1b1-c920-42d0-893d-31d879deea58 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.172231 Nov 02 23:26:23.959285 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1746/2321] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:23 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:24.977397 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dbfb1900-853a-46e5-9aae-3ec00b869518 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:24.978103 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dbfb1900-853a-46e5-9aae-3ec00b869518 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:24.984574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbfb1900-853a-46e5-9aae-3ec00b869518 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:24.985080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbfb1900-853a-46e5-9aae-3ec00b869518 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:24.985905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbfb1900-853a-46e5-9aae-3ec00b869518 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:24.986422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbfb1900-853a-46e5-9aae-3ec00b869518 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:25.182499 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dbfb1900-853a-46e5-9aae-3ec00b869518 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:25.192735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dbfb1900-853a-46e5-9aae-3ec00b869518 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.218195 Nov 02 23:26:25.193339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1747/2322] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:24 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:26.209929 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-29151da3-7a5d-409c-b20b-59a6430049c0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:26.211218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-29151da3-7a5d-409c-b20b-59a6430049c0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:26.217417 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-29151da3-7a5d-409c-b20b-59a6430049c0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:26.217939 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-29151da3-7a5d-409c-b20b-59a6430049c0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:26.218830 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-29151da3-7a5d-409c-b20b-59a6430049c0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:26.219392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-29151da3-7a5d-409c-b20b-59a6430049c0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:26.369334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-29151da3-7a5d-409c-b20b-59a6430049c0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:26.378700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-29151da3-7a5d-409c-b20b-59a6430049c0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.172572 Nov 02 23:26:26.379418 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1748/2323] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:26 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:27.396551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e5e97c9a-a40b-4c37-944a-72493ad02fb3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:27.397280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e5e97c9a-a40b-4c37-944a-72493ad02fb3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:27.405132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e5e97c9a-a40b-4c37-944a-72493ad02fb3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:27.405674 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e5e97c9a-a40b-4c37-944a-72493ad02fb3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:27.406983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e5e97c9a-a40b-4c37-944a-72493ad02fb3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:27.407861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e5e97c9a-a40b-4c37-944a-72493ad02fb3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:27.573593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e5e97c9a-a40b-4c37-944a-72493ad02fb3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:27.582182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e5e97c9a-a40b-4c37-944a-72493ad02fb3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.189449 Nov 02 23:26:27.582688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1749/2324] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:27 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:28.599826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-300a2cb9-b7e6-4207-9150-e67b482e0a67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:28.600610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-300a2cb9-b7e6-4207-9150-e67b482e0a67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:28.607665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-300a2cb9-b7e6-4207-9150-e67b482e0a67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:28.608104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-300a2cb9-b7e6-4207-9150-e67b482e0a67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:28.608893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-300a2cb9-b7e6-4207-9150-e67b482e0a67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:28.609320 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-300a2cb9-b7e6-4207-9150-e67b482e0a67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:28.773801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-300a2cb9-b7e6-4207-9150-e67b482e0a67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:28.782225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-300a2cb9-b7e6-4207-9150-e67b482e0a67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.186156 Nov 02 23:26:28.782823 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1750/2325] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:28 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:29.799837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-03b61b61-5a46-47ac-8609-93c2daa999c9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:29.801355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-03b61b61-5a46-47ac-8609-93c2daa999c9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:29.808925 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03b61b61-5a46-47ac-8609-93c2daa999c9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:29.809513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03b61b61-5a46-47ac-8609-93c2daa999c9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:29.810437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03b61b61-5a46-47ac-8609-93c2daa999c9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:29.811161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03b61b61-5a46-47ac-8609-93c2daa999c9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:29.972528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-03b61b61-5a46-47ac-8609-93c2daa999c9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:29.981790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-03b61b61-5a46-47ac-8609-93c2daa999c9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.186540 Nov 02 23:26:29.982409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1751/2326] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:29 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:26:31.005385 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-07201afb-0330-4949-9296-4c4d62eec712 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:31.006368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-07201afb-0330-4949-9296-4c4d62eec712 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:31.017438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-07201afb-0330-4949-9296-4c4d62eec712 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:31.018128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-07201afb-0330-4949-9296-4c4d62eec712 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:31.019712 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-07201afb-0330-4949-9296-4c4d62eec712 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:31.020478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-07201afb-0330-4949-9296-4c4d62eec712 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:31.214100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-07201afb-0330-4949-9296-4c4d62eec712 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:31.228945 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-07201afb-0330-4949-9296-4c4d62eec712 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.230135 Nov 02 23:26:31.229996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1752/2327] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:30 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:26:32.257225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0d17383c-5aef-4e18-bb88-49e7e12b4b02 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:32.258273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0d17383c-5aef-4e18-bb88-49e7e12b4b02 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:32.265202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d17383c-5aef-4e18-bb88-49e7e12b4b02 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:32.265653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d17383c-5aef-4e18-bb88-49e7e12b4b02 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:32.266456 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d17383c-5aef-4e18-bb88-49e7e12b4b02 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:32.266887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d17383c-5aef-4e18-bb88-49e7e12b4b02 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:32.459154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0d17383c-5aef-4e18-bb88-49e7e12b4b02 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:32.467954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0d17383c-5aef-4e18-bb88-49e7e12b4b02 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.215158 Nov 02 23:26:32.468565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1753/2328] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:32 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:33.489123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-79cea0cb-b091-4c6b-8a73-9e389c77144b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:33.490245 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-79cea0cb-b091-4c6b-8a73-9e389c77144b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:33.501590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79cea0cb-b091-4c6b-8a73-9e389c77144b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:33.502376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79cea0cb-b091-4c6b-8a73-9e389c77144b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:33.504439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79cea0cb-b091-4c6b-8a73-9e389c77144b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:33.505149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79cea0cb-b091-4c6b-8a73-9e389c77144b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:33.662080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-79cea0cb-b091-4c6b-8a73-9e389c77144b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:33.671074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-79cea0cb-b091-4c6b-8a73-9e389c77144b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.188447 Nov 02 23:26:33.671681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1754/2329] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:33 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:26:34.691767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6e92fa51-ef26-4383-abff-8f838a630a62 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:34.693068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6e92fa51-ef26-4383-abff-8f838a630a62 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:34.702487 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e92fa51-ef26-4383-abff-8f838a630a62 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:34.703138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e92fa51-ef26-4383-abff-8f838a630a62 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:34.704234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e92fa51-ef26-4383-abff-8f838a630a62 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:34.704860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e92fa51-ef26-4383-abff-8f838a630a62 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:34.912789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6e92fa51-ef26-4383-abff-8f838a630a62 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:34.928023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6e92fa51-ef26-4383-abff-8f838a630a62 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.240487 Nov 02 23:26:34.934570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1755/2330] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:34 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:35.955557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0cd65240-4cbe-4c7c-bc0e-52d41f115239 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:35.956625 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0cd65240-4cbe-4c7c-bc0e-52d41f115239 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:35.964777 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0cd65240-4cbe-4c7c-bc0e-52d41f115239 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:35.965287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0cd65240-4cbe-4c7c-bc0e-52d41f115239 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:35.966175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0cd65240-4cbe-4c7c-bc0e-52d41f115239 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:35.966613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0cd65240-4cbe-4c7c-bc0e-52d41f115239 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:36.172884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0cd65240-4cbe-4c7c-bc0e-52d41f115239 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:36.181841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0cd65240-4cbe-4c7c-bc0e-52d41f115239 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.230236 Nov 02 23:26:36.182431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1756/2331] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:35 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:37.206165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1a01da33-29b6-4bc4-881b-aea82bc98d05 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:37.207740 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1a01da33-29b6-4bc4-881b-aea82bc98d05 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:37.214765 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a01da33-29b6-4bc4-881b-aea82bc98d05 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:37.215222 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a01da33-29b6-4bc4-881b-aea82bc98d05 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:37.216181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a01da33-29b6-4bc4-881b-aea82bc98d05 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:37.216741 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a01da33-29b6-4bc4-881b-aea82bc98d05 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:37.392554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1a01da33-29b6-4bc4-881b-aea82bc98d05 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:37.402001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1a01da33-29b6-4bc4-881b-aea82bc98d05 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.199737 Nov 02 23:26:37.402585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1757/2332] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:37 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:38.425375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9428dd48-5943-47c9-9bd3-0996bcbfd90e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:38.427208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9428dd48-5943-47c9-9bd3-0996bcbfd90e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:38.434638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9428dd48-5943-47c9-9bd3-0996bcbfd90e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:38.435329 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9428dd48-5943-47c9-9bd3-0996bcbfd90e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:38.436241 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9428dd48-5943-47c9-9bd3-0996bcbfd90e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:38.436896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9428dd48-5943-47c9-9bd3-0996bcbfd90e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:38.650592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9428dd48-5943-47c9-9bd3-0996bcbfd90e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:38.660535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9428dd48-5943-47c9-9bd3-0996bcbfd90e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.238682 Nov 02 23:26:38.661192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1758/2333] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:38 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:26:39.678947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cc523a3b-0e3e-4c96-b745-9e3a3cd79e38 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:39.680283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cc523a3b-0e3e-4c96-b745-9e3a3cd79e38 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:39.687744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc523a3b-0e3e-4c96-b745-9e3a3cd79e38 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:39.688433 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc523a3b-0e3e-4c96-b745-9e3a3cd79e38 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:39.689399 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc523a3b-0e3e-4c96-b745-9e3a3cd79e38 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:39.690027 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc523a3b-0e3e-4c96-b745-9e3a3cd79e38 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:39.882055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cc523a3b-0e3e-4c96-b745-9e3a3cd79e38 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:39.890890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cc523a3b-0e3e-4c96-b745-9e3a3cd79e38 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.216709 Nov 02 23:26:39.891829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1759/2334] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:39 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:40.910440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b8227df4-424a-440f-a398-d3040205c0a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:40.911383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b8227df4-424a-440f-a398-d3040205c0a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:40.917976 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b8227df4-424a-440f-a398-d3040205c0a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:40.918422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b8227df4-424a-440f-a398-d3040205c0a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:40.919266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b8227df4-424a-440f-a398-d3040205c0a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:40.919699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b8227df4-424a-440f-a398-d3040205c0a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:41.070191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b8227df4-424a-440f-a398-d3040205c0a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:41.078573 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b8227df4-424a-440f-a398-d3040205c0a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.171952 Nov 02 23:26:41.079229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1760/2335] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:40 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:42.104468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a3fdecaa-d4d7-4d66-a7ba-311c8bf8d173 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:42.105251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a3fdecaa-d4d7-4d66-a7ba-311c8bf8d173 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:42.112031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3fdecaa-d4d7-4d66-a7ba-311c8bf8d173 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:42.112481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3fdecaa-d4d7-4d66-a7ba-311c8bf8d173 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:42.113280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3fdecaa-d4d7-4d66-a7ba-311c8bf8d173 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:42.113722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3fdecaa-d4d7-4d66-a7ba-311c8bf8d173 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:42.288202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a3fdecaa-d4d7-4d66-a7ba-311c8bf8d173 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:42.297377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a3fdecaa-d4d7-4d66-a7ba-311c8bf8d173 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.196605 Nov 02 23:26:42.298014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1761/2336] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:42 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:43.322313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f6ead2da-a327-4968-999e-e447daf00d58 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:43.323424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f6ead2da-a327-4968-999e-e447daf00d58 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:43.329661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f6ead2da-a327-4968-999e-e447daf00d58 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:43.330107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f6ead2da-a327-4968-999e-e447daf00d58 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:43.330887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f6ead2da-a327-4968-999e-e447daf00d58 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:43.331356 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f6ead2da-a327-4968-999e-e447daf00d58 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:43.482423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f6ead2da-a327-4968-999e-e447daf00d58 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:43.490728 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f6ead2da-a327-4968-999e-e447daf00d58 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.172330 Nov 02 23:26:43.491372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1762/2337] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:43 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:26:44.507822 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a374a17b-1ea7-4fe1-80ad-0f0ac2b1525e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:44.508509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a374a17b-1ea7-4fe1-80ad-0f0ac2b1525e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:44.514978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a374a17b-1ea7-4fe1-80ad-0f0ac2b1525e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:44.515423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a374a17b-1ea7-4fe1-80ad-0f0ac2b1525e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:44.516198 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a374a17b-1ea7-4fe1-80ad-0f0ac2b1525e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:44.516621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a374a17b-1ea7-4fe1-80ad-0f0ac2b1525e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:44.671200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a374a17b-1ea7-4fe1-80ad-0f0ac2b1525e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:44.679782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a374a17b-1ea7-4fe1-80ad-0f0ac2b1525e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.175570 Nov 02 23:26:44.680389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1763/2338] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:44 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:45.698250 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3a36e01a-0ccd-443c-840f-b307aacb222d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:45.699070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3a36e01a-0ccd-443c-840f-b307aacb222d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:45.706287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a36e01a-0ccd-443c-840f-b307aacb222d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:45.706796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a36e01a-0ccd-443c-840f-b307aacb222d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:45.707545 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a36e01a-0ccd-443c-840f-b307aacb222d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:45.708038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a36e01a-0ccd-443c-840f-b307aacb222d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:45.893768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3a36e01a-0ccd-443c-840f-b307aacb222d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:45.903009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3a36e01a-0ccd-443c-840f-b307aacb222d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.208493 Nov 02 23:26:45.903913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1764/2339] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:45 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:46.920630 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1cbc5bba-ed51-4f8c-8d34-54f4fcf0e58a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:46.921381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1cbc5bba-ed51-4f8c-8d34-54f4fcf0e58a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:46.929543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1cbc5bba-ed51-4f8c-8d34-54f4fcf0e58a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:46.930007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1cbc5bba-ed51-4f8c-8d34-54f4fcf0e58a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:46.930896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1cbc5bba-ed51-4f8c-8d34-54f4fcf0e58a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:46.931453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1cbc5bba-ed51-4f8c-8d34-54f4fcf0e58a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:47.079820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1cbc5bba-ed51-4f8c-8d34-54f4fcf0e58a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:47.087676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1cbc5bba-ed51-4f8c-8d34-54f4fcf0e58a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.170901 Nov 02 23:26:47.088251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1765/2340] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:46 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:48.104070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b3d6486c-82e4-43d6-8f4a-f8b1b0e13a4d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:48.104778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b3d6486c-82e4-43d6-8f4a-f8b1b0e13a4d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:48.111252 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3d6486c-82e4-43d6-8f4a-f8b1b0e13a4d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:48.111705 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3d6486c-82e4-43d6-8f4a-f8b1b0e13a4d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:48.112494 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3d6486c-82e4-43d6-8f4a-f8b1b0e13a4d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:48.112931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3d6486c-82e4-43d6-8f4a-f8b1b0e13a4d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:48.256814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b3d6486c-82e4-43d6-8f4a-f8b1b0e13a4d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:48.270651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b3d6486c-82e4-43d6-8f4a-f8b1b0e13a4d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.169889 Nov 02 23:26:48.271672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1766/2341] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:48 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:49.293404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-81f0f88b-08d9-4e01-82a5-0fbb0208b4a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:49.294088 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-81f0f88b-08d9-4e01-82a5-0fbb0208b4a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:49.300565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81f0f88b-08d9-4e01-82a5-0fbb0208b4a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:49.301011 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81f0f88b-08d9-4e01-82a5-0fbb0208b4a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:49.301786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81f0f88b-08d9-4e01-82a5-0fbb0208b4a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:49.302220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81f0f88b-08d9-4e01-82a5-0fbb0208b4a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:49.444625 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-81f0f88b-08d9-4e01-82a5-0fbb0208b4a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:49.452943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-81f0f88b-08d9-4e01-82a5-0fbb0208b4a3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.163400 Nov 02 23:26:49.453536 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1767/2342] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:49 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:50.471075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f77b06e2-d48d-4184-b54a-5af9119ad0d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:50.471841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f77b06e2-d48d-4184-b54a-5af9119ad0d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:50.478747 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f77b06e2-d48d-4184-b54a-5af9119ad0d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:50.479235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f77b06e2-d48d-4184-b54a-5af9119ad0d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:50.480053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f77b06e2-d48d-4184-b54a-5af9119ad0d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:50.480490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f77b06e2-d48d-4184-b54a-5af9119ad0d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:50.625796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f77b06e2-d48d-4184-b54a-5af9119ad0d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:50.634249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f77b06e2-d48d-4184-b54a-5af9119ad0d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.166881 Nov 02 23:26:50.634845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1768/2343] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:50 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:51.652417 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e3e4c5d8-2cd4-4ed4-863d-8cdf93b2729f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:51.653131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e3e4c5d8-2cd4-4ed4-863d-8cdf93b2729f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:51.659970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3e4c5d8-2cd4-4ed4-863d-8cdf93b2729f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:51.660426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3e4c5d8-2cd4-4ed4-863d-8cdf93b2729f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:51.661236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3e4c5d8-2cd4-4ed4-863d-8cdf93b2729f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:51.661673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e3e4c5d8-2cd4-4ed4-863d-8cdf93b2729f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:51.811774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e3e4c5d8-2cd4-4ed4-863d-8cdf93b2729f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:51.821336 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e3e4c5d8-2cd4-4ed4-863d-8cdf93b2729f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.172861 Nov 02 23:26:51.822441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1769/2344] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:51 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:26:52.845740 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-39b0f533-6b0f-4797-862e-f3482518c785 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:52.846567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-39b0f533-6b0f-4797-862e-f3482518c785 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:52.853593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39b0f533-6b0f-4797-862e-f3482518c785 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:52.854048 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39b0f533-6b0f-4797-862e-f3482518c785 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:52.854837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39b0f533-6b0f-4797-862e-f3482518c785 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:52.855308 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39b0f533-6b0f-4797-862e-f3482518c785 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:53.026339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-39b0f533-6b0f-4797-862e-f3482518c785 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:53.035096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-39b0f533-6b0f-4797-862e-f3482518c785 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.193057 Nov 02 23:26:53.036606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1770/2345] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:52 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:54.062952 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1f8567dd-ed6e-4c17-99ce-707f48c7dcbc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:54.063891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1f8567dd-ed6e-4c17-99ce-707f48c7dcbc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:54.073818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f8567dd-ed6e-4c17-99ce-707f48c7dcbc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:54.074404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f8567dd-ed6e-4c17-99ce-707f48c7dcbc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:54.075673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f8567dd-ed6e-4c17-99ce-707f48c7dcbc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:54.076250 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f8567dd-ed6e-4c17-99ce-707f48c7dcbc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:54.221142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1f8567dd-ed6e-4c17-99ce-707f48c7dcbc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:54.230096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1f8567dd-ed6e-4c17-99ce-707f48c7dcbc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.173046 Nov 02 23:26:54.231280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1771/2346] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:54 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:55.249566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e13db0e2-de1a-4792-ae25-c5e116018ca5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:55.250219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e13db0e2-de1a-4792-ae25-c5e116018ca5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:55.256636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e13db0e2-de1a-4792-ae25-c5e116018ca5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:55.257077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e13db0e2-de1a-4792-ae25-c5e116018ca5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:55.257840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e13db0e2-de1a-4792-ae25-c5e116018ca5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:55.258271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e13db0e2-de1a-4792-ae25-c5e116018ca5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:55.400089 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e13db0e2-de1a-4792-ae25-c5e116018ca5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:55.415356 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e13db0e2-de1a-4792-ae25-c5e116018ca5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.168947 Nov 02 23:26:55.416462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1772/2347] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:55 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:56.434598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7072d5ca-1e53-4734-a0ca-ddaa8e3a2356 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:56.435393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7072d5ca-1e53-4734-a0ca-ddaa8e3a2356 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:56.443702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7072d5ca-1e53-4734-a0ca-ddaa8e3a2356 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:56.444489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7072d5ca-1e53-4734-a0ca-ddaa8e3a2356 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:56.446073 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7072d5ca-1e53-4734-a0ca-ddaa8e3a2356 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:56.446672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7072d5ca-1e53-4734-a0ca-ddaa8e3a2356 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:56.613105 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7072d5ca-1e53-4734-a0ca-ddaa8e3a2356 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:56.621263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7072d5ca-1e53-4734-a0ca-ddaa8e3a2356 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.190353 Nov 02 23:26:56.621846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1773/2348] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:56 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:57.639245 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-92d942a0-333c-4af3-ac69-8c624493da15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:57.639994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-92d942a0-333c-4af3-ac69-8c624493da15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:57.646979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92d942a0-333c-4af3-ac69-8c624493da15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:57.647430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92d942a0-333c-4af3-ac69-8c624493da15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:57.648252 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92d942a0-333c-4af3-ac69-8c624493da15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:57.648687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92d942a0-333c-4af3-ac69-8c624493da15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:57.817492 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-92d942a0-333c-4af3-ac69-8c624493da15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:57.825968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-92d942a0-333c-4af3-ac69-8c624493da15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.190663 Nov 02 23:26:57.826611 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1774/2349] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:57 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:26:58.844126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0d0ade25-fb9a-4094-98ac-d11b8b74c36e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:26:58.844781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0d0ade25-fb9a-4094-98ac-d11b8b74c36e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:26:58.851150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d0ade25-fb9a-4094-98ac-d11b8b74c36e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:58.851602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d0ade25-fb9a-4094-98ac-d11b8b74c36e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:58.852414 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d0ade25-fb9a-4094-98ac-d11b8b74c36e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:26:58.852876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d0ade25-fb9a-4094-98ac-d11b8b74c36e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:26:58.997743 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0d0ade25-fb9a-4094-98ac-d11b8b74c36e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:26:59.007944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0d0ade25-fb9a-4094-98ac-d11b8b74c36e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.167581 Nov 02 23:26:59.008582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1775/2350] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:26:58 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:00.025966 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9f20ae0d-0621-4d51-baf4-2e3dc55f55d0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:00.026943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9f20ae0d-0621-4d51-baf4-2e3dc55f55d0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:00.032881 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f20ae0d-0621-4d51-baf4-2e3dc55f55d0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:00.033360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f20ae0d-0621-4d51-baf4-2e3dc55f55d0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:00.034220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f20ae0d-0621-4d51-baf4-2e3dc55f55d0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:00.034654 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f20ae0d-0621-4d51-baf4-2e3dc55f55d0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:00.166161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9f20ae0d-0621-4d51-baf4-2e3dc55f55d0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:00.174211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9f20ae0d-0621-4d51-baf4-2e3dc55f55d0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.152018 Nov 02 23:27:00.174808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1776/2351] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:00 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:01.192889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6dc2520a-655c-4977-bd86-48dd40036b5e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:01.193578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6dc2520a-655c-4977-bd86-48dd40036b5e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:01.199887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6dc2520a-655c-4977-bd86-48dd40036b5e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:01.200331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6dc2520a-655c-4977-bd86-48dd40036b5e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:01.201091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6dc2520a-655c-4977-bd86-48dd40036b5e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:01.201518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6dc2520a-655c-4977-bd86-48dd40036b5e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:01.340851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6dc2520a-655c-4977-bd86-48dd40036b5e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:01.349348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6dc2520a-655c-4977-bd86-48dd40036b5e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.160544 Nov 02 23:27:01.349918 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1777/2352] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:01 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:02.366180 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b88aa008-f478-461a-802a-e27f60cee2a9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:02.366801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b88aa008-f478-461a-802a-e27f60cee2a9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:02.373306 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b88aa008-f478-461a-802a-e27f60cee2a9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:02.373745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b88aa008-f478-461a-802a-e27f60cee2a9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:02.374520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b88aa008-f478-461a-802a-e27f60cee2a9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:02.375339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b88aa008-f478-461a-802a-e27f60cee2a9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:02.511501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b88aa008-f478-461a-802a-e27f60cee2a9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:02.519489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b88aa008-f478-461a-802a-e27f60cee2a9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.157645 Nov 02 23:27:02.520096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1778/2353] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:02 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:03.536229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6f6b0646-9396-4459-bf32-74177095af24 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:03.536968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6f6b0646-9396-4459-bf32-74177095af24 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:03.543293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f6b0646-9396-4459-bf32-74177095af24 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:03.543737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f6b0646-9396-4459-bf32-74177095af24 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:03.544514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f6b0646-9396-4459-bf32-74177095af24 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:03.544938 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f6b0646-9396-4459-bf32-74177095af24 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:03.678798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6f6b0646-9396-4459-bf32-74177095af24 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:03.687541 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6f6b0646-9396-4459-bf32-74177095af24 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.154954 Nov 02 23:27:03.688129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1779/2354] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:03 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:04.705495 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-55942cf5-1d36-440c-9805-94ffbd59dd70 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:04.706784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-55942cf5-1d36-440c-9805-94ffbd59dd70 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:04.713333 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55942cf5-1d36-440c-9805-94ffbd59dd70 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:04.713685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55942cf5-1d36-440c-9805-94ffbd59dd70 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:04.714452 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55942cf5-1d36-440c-9805-94ffbd59dd70 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:04.714879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55942cf5-1d36-440c-9805-94ffbd59dd70 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:04.853252 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-55942cf5-1d36-440c-9805-94ffbd59dd70 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:04.861439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-55942cf5-1d36-440c-9805-94ffbd59dd70 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.159524 Nov 02 23:27:04.862012 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1780/2355] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:04 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:05.878972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-253a2964-23f8-4ad8-808d-1e917e734fa9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:05.879655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-253a2964-23f8-4ad8-808d-1e917e734fa9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:05.885916 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-253a2964-23f8-4ad8-808d-1e917e734fa9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:05.886365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-253a2964-23f8-4ad8-808d-1e917e734fa9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:05.887168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-253a2964-23f8-4ad8-808d-1e917e734fa9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:05.887605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-253a2964-23f8-4ad8-808d-1e917e734fa9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:06.023057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-253a2964-23f8-4ad8-808d-1e917e734fa9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:06.030711 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-253a2964-23f8-4ad8-808d-1e917e734fa9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.155620 Nov 02 23:27:06.031316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1781/2356] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:05 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:07.053240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b27aebfa-2684-4874-a4f4-5d5344f3ecb6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:07.053854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b27aebfa-2684-4874-a4f4-5d5344f3ecb6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:07.060195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b27aebfa-2684-4874-a4f4-5d5344f3ecb6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:07.060643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b27aebfa-2684-4874-a4f4-5d5344f3ecb6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:07.061424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b27aebfa-2684-4874-a4f4-5d5344f3ecb6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:07.061852 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b27aebfa-2684-4874-a4f4-5d5344f3ecb6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:07.199036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b27aebfa-2684-4874-a4f4-5d5344f3ecb6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:07.207847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b27aebfa-2684-4874-a4f4-5d5344f3ecb6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.158755 Nov 02 23:27:07.208434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1782/2357] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:07 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:27:08.225249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fc21134a-0bdd-4dbb-93a8-349b08459262 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:08.225901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fc21134a-0bdd-4dbb-93a8-349b08459262 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:08.232526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc21134a-0bdd-4dbb-93a8-349b08459262 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:08.232967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc21134a-0bdd-4dbb-93a8-349b08459262 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:08.233748 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc21134a-0bdd-4dbb-93a8-349b08459262 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:08.234203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc21134a-0bdd-4dbb-93a8-349b08459262 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:08.374686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fc21134a-0bdd-4dbb-93a8-349b08459262 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:08.382813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fc21134a-0bdd-4dbb-93a8-349b08459262 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.161701 Nov 02 23:27:08.383423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1783/2358] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:08 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:09.400115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a33be3af-c668-45f5-bc79-072b8f76408c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:09.400761 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a33be3af-c668-45f5-bc79-072b8f76408c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:09.407256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a33be3af-c668-45f5-bc79-072b8f76408c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:09.407702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a33be3af-c668-45f5-bc79-072b8f76408c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:09.408492 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a33be3af-c668-45f5-bc79-072b8f76408c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:09.408936 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a33be3af-c668-45f5-bc79-072b8f76408c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:09.551009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a33be3af-c668-45f5-bc79-072b8f76408c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:09.559070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a33be3af-c668-45f5-bc79-072b8f76408c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.162680 Nov 02 23:27:09.559664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1784/2359] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:09 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:10.577566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-867d7c3e-afb7-4376-8fba-678bb2147a74 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:10.578292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-867d7c3e-afb7-4376-8fba-678bb2147a74 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:10.585760 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-867d7c3e-afb7-4376-8fba-678bb2147a74 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:10.586201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-867d7c3e-afb7-4376-8fba-678bb2147a74 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:10.587024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-867d7c3e-afb7-4376-8fba-678bb2147a74 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:10.587482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-867d7c3e-afb7-4376-8fba-678bb2147a74 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:10.723653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-867d7c3e-afb7-4376-8fba-678bb2147a74 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:10.731410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-867d7c3e-afb7-4376-8fba-678bb2147a74 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.157416 Nov 02 23:27:10.731995 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1785/2360] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:10 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:11.748917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1f8acc31-ba87-4c53-98d6-07c9c651ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:11.749635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1f8acc31-ba87-4c53-98d6-07c9c651ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:11.756799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f8acc31-ba87-4c53-98d6-07c9c651ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:11.757251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f8acc31-ba87-4c53-98d6-07c9c651ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:11.758028 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f8acc31-ba87-4c53-98d6-07c9c651ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:11.758459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f8acc31-ba87-4c53-98d6-07c9c651ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:11.906602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1f8acc31-ba87-4c53-98d6-07c9c651ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:11.915920 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1f8acc31-ba87-4c53-98d6-07c9c651ffa2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.170708 Nov 02 23:27:11.916488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1786/2361] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:11 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:12.932529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-45baa563-deb5-47fa-b244-6d6c17906b5c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:12.933226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-45baa563-deb5-47fa-b244-6d6c17906b5c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:12.939590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45baa563-deb5-47fa-b244-6d6c17906b5c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:12.939962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45baa563-deb5-47fa-b244-6d6c17906b5c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:12.940740 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45baa563-deb5-47fa-b244-6d6c17906b5c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:12.941172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45baa563-deb5-47fa-b244-6d6c17906b5c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:13.076540 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-45baa563-deb5-47fa-b244-6d6c17906b5c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:13.084785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-45baa563-deb5-47fa-b244-6d6c17906b5c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.155930 Nov 02 23:27:13.085362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1787/2362] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:12 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:27:14.101865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5e263f4f-4b45-4057-9733-3a0e74e5aba7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:14.102512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5e263f4f-4b45-4057-9733-3a0e74e5aba7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:14.108779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5e263f4f-4b45-4057-9733-3a0e74e5aba7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:14.109234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5e263f4f-4b45-4057-9733-3a0e74e5aba7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:14.110006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5e263f4f-4b45-4057-9733-3a0e74e5aba7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:14.110452 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5e263f4f-4b45-4057-9733-3a0e74e5aba7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:14.249197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5e263f4f-4b45-4057-9733-3a0e74e5aba7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:14.257010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5e263f4f-4b45-4057-9733-3a0e74e5aba7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.158991 Nov 02 23:27:14.257573 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1788/2363] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:14 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:15.274369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1ecb9b1c-4dde-4068-9ca3-5476f4eedaec tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:15.275099 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1ecb9b1c-4dde-4068-9ca3-5476f4eedaec tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:15.281390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ecb9b1c-4dde-4068-9ca3-5476f4eedaec tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:15.281840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ecb9b1c-4dde-4068-9ca3-5476f4eedaec tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:15.282612 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ecb9b1c-4dde-4068-9ca3-5476f4eedaec tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:15.283096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1ecb9b1c-4dde-4068-9ca3-5476f4eedaec tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:15.421501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1ecb9b1c-4dde-4068-9ca3-5476f4eedaec tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:15.431536 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1ecb9b1c-4dde-4068-9ca3-5476f4eedaec tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.160724 Nov 02 23:27:15.432127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1789/2364] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:15 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:16.450870 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-91c4b4f1-8e7f-41af-988e-105a8d799206 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:16.451596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-91c4b4f1-8e7f-41af-988e-105a8d799206 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:16.458302 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-91c4b4f1-8e7f-41af-988e-105a8d799206 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:16.458750 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-91c4b4f1-8e7f-41af-988e-105a8d799206 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:16.459603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-91c4b4f1-8e7f-41af-988e-105a8d799206 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:16.460041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-91c4b4f1-8e7f-41af-988e-105a8d799206 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:16.594791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-91c4b4f1-8e7f-41af-988e-105a8d799206 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:16.602969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-91c4b4f1-8e7f-41af-988e-105a8d799206 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.156933 Nov 02 23:27:16.603567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1790/2365] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:16 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:16.772776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:27:16.773098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:27:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 23:27:17.619344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8c4b6987-1ea5-43d5-a973-0c9d15476a46 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:17.619983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8c4b6987-1ea5-43d5-a973-0c9d15476a46 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:17.626107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c4b6987-1ea5-43d5-a973-0c9d15476a46 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:17.626552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c4b6987-1ea5-43d5-a973-0c9d15476a46 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:17.627348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c4b6987-1ea5-43d5-a973-0c9d15476a46 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:17.628428 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c4b6987-1ea5-43d5-a973-0c9d15476a46 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:17.757573 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8c4b6987-1ea5-43d5-a973-0c9d15476a46 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:17.765475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8c4b6987-1ea5-43d5-a973-0c9d15476a46 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.150022 Nov 02 23:27:17.766045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1791/2366] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:17 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:18.782327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6f773696-1d91-4b5a-ad0f-22d19cb91b78 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:18.783004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6f773696-1d91-4b5a-ad0f-22d19cb91b78 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:18.789306 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f773696-1d91-4b5a-ad0f-22d19cb91b78 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:18.789761 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f773696-1d91-4b5a-ad0f-22d19cb91b78 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:18.790535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f773696-1d91-4b5a-ad0f-22d19cb91b78 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:18.791008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f773696-1d91-4b5a-ad0f-22d19cb91b78 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:18.928213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6f773696-1d91-4b5a-ad0f-22d19cb91b78 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:18.937039 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6f773696-1d91-4b5a-ad0f-22d19cb91b78 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.158268 Nov 02 23:27:18.937732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1792/2367] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:18 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:19.955641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-52abc563-5695-4f7f-9aea-31b8a68a4ce4 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:19.956355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-52abc563-5695-4f7f-9aea-31b8a68a4ce4 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:19.963280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52abc563-5695-4f7f-9aea-31b8a68a4ce4 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:19.963725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52abc563-5695-4f7f-9aea-31b8a68a4ce4 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:19.964512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52abc563-5695-4f7f-9aea-31b8a68a4ce4 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:19.964946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52abc563-5695-4f7f-9aea-31b8a68a4ce4 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:20.106626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-52abc563-5695-4f7f-9aea-31b8a68a4ce4 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:20.115190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-52abc563-5695-4f7f-9aea-31b8a68a4ce4 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.163866 Nov 02 23:27:20.115766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1793/2368] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:19 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:21.132095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-243bcbb5-6874-4025-af0c-c309ba95ed8c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:21.132780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-243bcbb5-6874-4025-af0c-c309ba95ed8c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:21.139726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-243bcbb5-6874-4025-af0c-c309ba95ed8c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:21.140166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-243bcbb5-6874-4025-af0c-c309ba95ed8c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:21.140931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-243bcbb5-6874-4025-af0c-c309ba95ed8c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:21.141353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-243bcbb5-6874-4025-af0c-c309ba95ed8c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:21.274712 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-243bcbb5-6874-4025-af0c-c309ba95ed8c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:21.282548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-243bcbb5-6874-4025-af0c-c309ba95ed8c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.154124 Nov 02 23:27:21.283153 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1794/2369] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:21 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:27:22.300014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a821aebf-c121-41a7-95dd-b25015e41049 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:22.300776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a821aebf-c121-41a7-95dd-b25015e41049 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:22.307756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a821aebf-c121-41a7-95dd-b25015e41049 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:22.308199 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a821aebf-c121-41a7-95dd-b25015e41049 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:22.308977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a821aebf-c121-41a7-95dd-b25015e41049 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:22.309404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a821aebf-c121-41a7-95dd-b25015e41049 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:22.446715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a821aebf-c121-41a7-95dd-b25015e41049 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:22.455160 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a821aebf-c121-41a7-95dd-b25015e41049 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.158696 Nov 02 23:27:22.455837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1795/2370] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:22 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:23.473002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c7ec2ec9-1302-43fa-9bcb-3e59722b1540 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:23.474011 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c7ec2ec9-1302-43fa-9bcb-3e59722b1540 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:23.481276 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7ec2ec9-1302-43fa-9bcb-3e59722b1540 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:23.481845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7ec2ec9-1302-43fa-9bcb-3e59722b1540 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:23.483139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7ec2ec9-1302-43fa-9bcb-3e59722b1540 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:23.483583 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7ec2ec9-1302-43fa-9bcb-3e59722b1540 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:23.628930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c7ec2ec9-1302-43fa-9bcb-3e59722b1540 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:23.637947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c7ec2ec9-1302-43fa-9bcb-3e59722b1540 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.168922 Nov 02 23:27:23.638512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1796/2371] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:23 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:24.658042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-848adcf6-4377-4064-99e6-50b7f32f27eb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:24.659175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-848adcf6-4377-4064-99e6-50b7f32f27eb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:24.665843 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-848adcf6-4377-4064-99e6-50b7f32f27eb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:24.666296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-848adcf6-4377-4064-99e6-50b7f32f27eb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:24.667123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-848adcf6-4377-4064-99e6-50b7f32f27eb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:24.667572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-848adcf6-4377-4064-99e6-50b7f32f27eb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:24.819741 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-848adcf6-4377-4064-99e6-50b7f32f27eb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:24.828550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-848adcf6-4377-4064-99e6-50b7f32f27eb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.176042 Nov 02 23:27:24.829202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1797/2372] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:24 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:25.846645 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a8087deb-62ad-4003-8991-aa989bc8fe2e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:25.847329 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a8087deb-62ad-4003-8991-aa989bc8fe2e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:25.853880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a8087deb-62ad-4003-8991-aa989bc8fe2e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:25.854327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a8087deb-62ad-4003-8991-aa989bc8fe2e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:25.855141 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a8087deb-62ad-4003-8991-aa989bc8fe2e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:25.855574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a8087deb-62ad-4003-8991-aa989bc8fe2e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:26.033237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a8087deb-62ad-4003-8991-aa989bc8fe2e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:26.041266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a8087deb-62ad-4003-8991-aa989bc8fe2e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.198394 Nov 02 23:27:26.041840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1798/2373] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:25 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:27.057720 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-72e38945-829d-44e5-b346-5776fbffe2c7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:27.059033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-72e38945-829d-44e5-b346-5776fbffe2c7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:27.065100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72e38945-829d-44e5-b346-5776fbffe2c7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:27.065539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72e38945-829d-44e5-b346-5776fbffe2c7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:27.066588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72e38945-829d-44e5-b346-5776fbffe2c7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:27.067555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72e38945-829d-44e5-b346-5776fbffe2c7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:27.240072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-72e38945-829d-44e5-b346-5776fbffe2c7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:27.248842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-72e38945-829d-44e5-b346-5776fbffe2c7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.194921 Nov 02 23:27:27.249473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1799/2374] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:27 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:28.267070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3e88348d-26ad-4ea8-93e8-e3b7634efd4e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:28.267898 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3e88348d-26ad-4ea8-93e8-e3b7634efd4e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:28.275181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e88348d-26ad-4ea8-93e8-e3b7634efd4e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:28.275626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e88348d-26ad-4ea8-93e8-e3b7634efd4e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:28.276429 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e88348d-26ad-4ea8-93e8-e3b7634efd4e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:28.276875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e88348d-26ad-4ea8-93e8-e3b7634efd4e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:28.428714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3e88348d-26ad-4ea8-93e8-e3b7634efd4e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:28.436790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3e88348d-26ad-4ea8-93e8-e3b7634efd4e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.173352 Nov 02 23:27:28.437380 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1800/2375] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:28 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:29.455990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1a1adb85-909d-4d33-9b14-2501c711102e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:29.456717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1a1adb85-909d-4d33-9b14-2501c711102e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:29.463978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a1adb85-909d-4d33-9b14-2501c711102e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:29.464421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a1adb85-909d-4d33-9b14-2501c711102e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:29.465213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a1adb85-909d-4d33-9b14-2501c711102e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:29.465641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a1adb85-909d-4d33-9b14-2501c711102e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:29.610567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1a1adb85-909d-4d33-9b14-2501c711102e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:29.619271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1a1adb85-909d-4d33-9b14-2501c711102e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.167461 Nov 02 23:27:29.619856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1801/2376] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:29 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:30.635470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1acb7e88-1d4a-4062-be9a-8a5d687f92a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:30.636210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1acb7e88-1d4a-4062-be9a-8a5d687f92a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:30.642107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1acb7e88-1d4a-4062-be9a-8a5d687f92a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:30.642548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1acb7e88-1d4a-4062-be9a-8a5d687f92a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:30.643348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1acb7e88-1d4a-4062-be9a-8a5d687f92a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:30.643781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1acb7e88-1d4a-4062-be9a-8a5d687f92a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:30.786116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1acb7e88-1d4a-4062-be9a-8a5d687f92a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:30.795687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1acb7e88-1d4a-4062-be9a-8a5d687f92a2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.163688 Nov 02 23:27:30.796298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1802/2377] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:30 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:31.813836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aae3bf25-bbba-437b-925b-248d07d68944 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:31.814564 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aae3bf25-bbba-437b-925b-248d07d68944 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:31.821434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aae3bf25-bbba-437b-925b-248d07d68944 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:31.821872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aae3bf25-bbba-437b-925b-248d07d68944 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:31.822660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aae3bf25-bbba-437b-925b-248d07d68944 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:31.823113 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aae3bf25-bbba-437b-925b-248d07d68944 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:31.965364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aae3bf25-bbba-437b-925b-248d07d68944 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:31.974180 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aae3bf25-bbba-437b-925b-248d07d68944 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.164716 Nov 02 23:27:31.974766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1803/2378] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:31 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:32.991238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7c4f58ed-23b9-4d30-a6aa-c53011aa6de0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:32.991919 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7c4f58ed-23b9-4d30-a6aa-c53011aa6de0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:32.998804 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7c4f58ed-23b9-4d30-a6aa-c53011aa6de0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:32.999327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7c4f58ed-23b9-4d30-a6aa-c53011aa6de0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:33.000146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7c4f58ed-23b9-4d30-a6aa-c53011aa6de0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:33.000582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7c4f58ed-23b9-4d30-a6aa-c53011aa6de0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:33.144594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7c4f58ed-23b9-4d30-a6aa-c53011aa6de0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:33.153259 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7c4f58ed-23b9-4d30-a6aa-c53011aa6de0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.165580 Nov 02 23:27:33.153838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1804/2379] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:32 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:27:34.171784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-732cc788-3c75-4784-b4a1-0443eb142dcc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:34.172363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-732cc788-3c75-4784-b4a1-0443eb142dcc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:34.178473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-732cc788-3c75-4784-b4a1-0443eb142dcc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:34.178864 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-732cc788-3c75-4784-b4a1-0443eb142dcc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:34.179682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-732cc788-3c75-4784-b4a1-0443eb142dcc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:34.180122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-732cc788-3c75-4784-b4a1-0443eb142dcc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:34.334980 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-732cc788-3c75-4784-b4a1-0443eb142dcc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:34.346896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-732cc788-3c75-4784-b4a1-0443eb142dcc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.179173 Nov 02 23:27:34.347514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1805/2380] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:34 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:35.364455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-861b2c2c-e9c2-412a-a3c3-fc66dfbc65d6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:35.365174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-861b2c2c-e9c2-412a-a3c3-fc66dfbc65d6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:35.371668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-861b2c2c-e9c2-412a-a3c3-fc66dfbc65d6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:35.372116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-861b2c2c-e9c2-412a-a3c3-fc66dfbc65d6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:35.372887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-861b2c2c-e9c2-412a-a3c3-fc66dfbc65d6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:35.373328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-861b2c2c-e9c2-412a-a3c3-fc66dfbc65d6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:35.513247 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-861b2c2c-e9c2-412a-a3c3-fc66dfbc65d6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:35.522422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-861b2c2c-e9c2-412a-a3c3-fc66dfbc65d6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.161544 Nov 02 23:27:35.523104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1806/2381] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:35 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:36.540161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1d953c07-a4c8-4cdc-8642-4a0155a1c932 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:36.540939 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1d953c07-a4c8-4cdc-8642-4a0155a1c932 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:36.547311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d953c07-a4c8-4cdc-8642-4a0155a1c932 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:36.547754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d953c07-a4c8-4cdc-8642-4a0155a1c932 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:36.548537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d953c07-a4c8-4cdc-8642-4a0155a1c932 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:36.548964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d953c07-a4c8-4cdc-8642-4a0155a1c932 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:36.683296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1d953c07-a4c8-4cdc-8642-4a0155a1c932 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:36.691024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1d953c07-a4c8-4cdc-8642-4a0155a1c932 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.154657 Nov 02 23:27:36.692392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1807/2382] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:36 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:37.708920 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-22c66345-fad5-44b4-a99c-da4de9a72f10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:37.709586 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-22c66345-fad5-44b4-a99c-da4de9a72f10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:37.716142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22c66345-fad5-44b4-a99c-da4de9a72f10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:37.716588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22c66345-fad5-44b4-a99c-da4de9a72f10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:37.717382 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22c66345-fad5-44b4-a99c-da4de9a72f10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:37.717816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22c66345-fad5-44b4-a99c-da4de9a72f10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:37.857044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-22c66345-fad5-44b4-a99c-da4de9a72f10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:37.865137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-22c66345-fad5-44b4-a99c-da4de9a72f10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.159863 Nov 02 23:27:37.865730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1808/2383] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:37 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:38.882129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-30ccad16-7ca1-4223-b0d4-946014dd5d5e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:38.882848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-30ccad16-7ca1-4223-b0d4-946014dd5d5e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:38.889069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30ccad16-7ca1-4223-b0d4-946014dd5d5e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:38.889511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30ccad16-7ca1-4223-b0d4-946014dd5d5e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:38.890277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30ccad16-7ca1-4223-b0d4-946014dd5d5e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:38.890714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30ccad16-7ca1-4223-b0d4-946014dd5d5e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:39.032251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-30ccad16-7ca1-4223-b0d4-946014dd5d5e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:39.040361 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-30ccad16-7ca1-4223-b0d4-946014dd5d5e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.161828 Nov 02 23:27:39.041008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1809/2384] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:38 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:40.057525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2b3cab78-fa5d-4e1b-aea0-1cad3299dbd2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:40.058288 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2b3cab78-fa5d-4e1b-aea0-1cad3299dbd2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:40.064830 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b3cab78-fa5d-4e1b-aea0-1cad3299dbd2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:40.065275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b3cab78-fa5d-4e1b-aea0-1cad3299dbd2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:40.066322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b3cab78-fa5d-4e1b-aea0-1cad3299dbd2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:40.066759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b3cab78-fa5d-4e1b-aea0-1cad3299dbd2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:40.221519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2b3cab78-fa5d-4e1b-aea0-1cad3299dbd2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:40.230820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2b3cab78-fa5d-4e1b-aea0-1cad3299dbd2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.176826 Nov 02 23:27:40.231389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1810/2385] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:40 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:41.251999 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-14fb7ecb-6b6c-4803-9915-d08bac266c81 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:41.252753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-14fb7ecb-6b6c-4803-9915-d08bac266c81 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:41.259840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14fb7ecb-6b6c-4803-9915-d08bac266c81 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:41.260292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14fb7ecb-6b6c-4803-9915-d08bac266c81 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:41.261073 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14fb7ecb-6b6c-4803-9915-d08bac266c81 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:41.261509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14fb7ecb-6b6c-4803-9915-d08bac266c81 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:41.444215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-14fb7ecb-6b6c-4803-9915-d08bac266c81 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:41.457999 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-14fb7ecb-6b6c-4803-9915-d08bac266c81 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.209925 Nov 02 23:27:41.458836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1811/2386] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:41 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:42.477229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1be62c65-228a-494c-b2ab-2d3dcd621f4d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:42.477934 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1be62c65-228a-494c-b2ab-2d3dcd621f4d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:42.484662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1be62c65-228a-494c-b2ab-2d3dcd621f4d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:42.485102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1be62c65-228a-494c-b2ab-2d3dcd621f4d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:42.485880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1be62c65-228a-494c-b2ab-2d3dcd621f4d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:42.486305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1be62c65-228a-494c-b2ab-2d3dcd621f4d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:42.628570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1be62c65-228a-494c-b2ab-2d3dcd621f4d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:42.643254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1be62c65-228a-494c-b2ab-2d3dcd621f4d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.169244 Nov 02 23:27:42.644759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1812/2387] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:42 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:43.662952 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cbd4690d-59d4-4285-8295-2b1d6db9406e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:43.663643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cbd4690d-59d4-4285-8295-2b1d6db9406e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:43.670381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cbd4690d-59d4-4285-8295-2b1d6db9406e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:43.670819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cbd4690d-59d4-4285-8295-2b1d6db9406e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:43.671651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cbd4690d-59d4-4285-8295-2b1d6db9406e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:43.672080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cbd4690d-59d4-4285-8295-2b1d6db9406e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:43.839416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cbd4690d-59d4-4285-8295-2b1d6db9406e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:43.848505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cbd4690d-59d4-4285-8295-2b1d6db9406e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.189368 Nov 02 23:27:43.849124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1813/2388] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:43 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:44.865873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-672be6d8-410d-42cb-8361-e54265829b26 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:44.866553 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-672be6d8-410d-42cb-8361-e54265829b26 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:44.873039 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-672be6d8-410d-42cb-8361-e54265829b26 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:44.873526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-672be6d8-410d-42cb-8361-e54265829b26 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:44.874299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-672be6d8-410d-42cb-8361-e54265829b26 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:44.874724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-672be6d8-410d-42cb-8361-e54265829b26 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:45.014341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-672be6d8-410d-42cb-8361-e54265829b26 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:45.023003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-672be6d8-410d-42cb-8361-e54265829b26 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.161195 Nov 02 23:27:45.023599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1814/2389] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:44 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:46.016977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:27:46.016977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:27:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 23:27:46.040427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1e78cde8-53b3-4147-b69c-25077574737b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:46.041032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1e78cde8-53b3-4147-b69c-25077574737b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:46.047542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e78cde8-53b3-4147-b69c-25077574737b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:46.047927 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e78cde8-53b3-4147-b69c-25077574737b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:46.048697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e78cde8-53b3-4147-b69c-25077574737b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:46.049125 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e78cde8-53b3-4147-b69c-25077574737b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:46.185536 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1e78cde8-53b3-4147-b69c-25077574737b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:46.193797 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1e78cde8-53b3-4147-b69c-25077574737b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.156872 Nov 02 23:27:46.194360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1815/2390] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:46 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:47.210712 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a3415811-abf4-4f4c-9207-236fc5a331b9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:47.211354 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a3415811-abf4-4f4c-9207-236fc5a331b9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:47.217719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3415811-abf4-4f4c-9207-236fc5a331b9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:47.218200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3415811-abf4-4f4c-9207-236fc5a331b9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:47.219021 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3415811-abf4-4f4c-9207-236fc5a331b9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:47.219551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a3415811-abf4-4f4c-9207-236fc5a331b9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:47.364629 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a3415811-abf4-4f4c-9207-236fc5a331b9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:47.372951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a3415811-abf4-4f4c-9207-236fc5a331b9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.165856 Nov 02 23:27:47.373652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1816/2391] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:47 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:48.399232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b5d81ad6-be70-447c-9ae9-66481296a1a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:48.399938 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b5d81ad6-be70-447c-9ae9-66481296a1a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:48.405972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5d81ad6-be70-447c-9ae9-66481296a1a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:48.406415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5d81ad6-be70-447c-9ae9-66481296a1a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:48.407204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5d81ad6-be70-447c-9ae9-66481296a1a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:48.407633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5d81ad6-be70-447c-9ae9-66481296a1a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:48.540579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b5d81ad6-be70-447c-9ae9-66481296a1a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:48.554324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b5d81ad6-be70-447c-9ae9-66481296a1a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.158286 Nov 02 23:27:48.555400 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1817/2392] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:48 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:49.571656 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c2a75235-c3f9-4f52-972b-382084ba0887 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:49.572361 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c2a75235-c3f9-4f52-972b-382084ba0887 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:49.578442 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2a75235-c3f9-4f52-972b-382084ba0887 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:49.578881 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2a75235-c3f9-4f52-972b-382084ba0887 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:49.579669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2a75235-c3f9-4f52-972b-382084ba0887 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:49.580098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2a75235-c3f9-4f52-972b-382084ba0887 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:49.715342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c2a75235-c3f9-4f52-972b-382084ba0887 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:49.723741 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c2a75235-c3f9-4f52-972b-382084ba0887 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.155657 Nov 02 23:27:49.724315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1818/2393] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:49 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:50.741617 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-45ccffb8-f045-478d-a55d-4cd51ddd2c0d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:50.742389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-45ccffb8-f045-478d-a55d-4cd51ddd2c0d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:50.749861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45ccffb8-f045-478d-a55d-4cd51ddd2c0d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:50.750382 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45ccffb8-f045-478d-a55d-4cd51ddd2c0d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:50.751318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45ccffb8-f045-478d-a55d-4cd51ddd2c0d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:50.751791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45ccffb8-f045-478d-a55d-4cd51ddd2c0d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:50.895081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-45ccffb8-f045-478d-a55d-4cd51ddd2c0d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:50.903067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-45ccffb8-f045-478d-a55d-4cd51ddd2c0d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.165819 Nov 02 23:27:50.903645 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1819/2394] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:50 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:51.920620 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4f5244cb-a5bc-4508-b80f-aec51824742a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:51.921323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4f5244cb-a5bc-4508-b80f-aec51824742a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:51.928467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f5244cb-a5bc-4508-b80f-aec51824742a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:51.928913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f5244cb-a5bc-4508-b80f-aec51824742a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:51.929691 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f5244cb-a5bc-4508-b80f-aec51824742a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:51.930122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f5244cb-a5bc-4508-b80f-aec51824742a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:52.067975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4f5244cb-a5bc-4508-b80f-aec51824742a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:52.075958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4f5244cb-a5bc-4508-b80f-aec51824742a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.159036 Nov 02 23:27:52.076539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1820/2395] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:51 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:53.093276 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-274a1822-4f9d-4a08-894e-4c02fd69716a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:53.093946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-274a1822-4f9d-4a08-894e-4c02fd69716a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:53.101244 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-274a1822-4f9d-4a08-894e-4c02fd69716a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:53.101682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-274a1822-4f9d-4a08-894e-4c02fd69716a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:53.102454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-274a1822-4f9d-4a08-894e-4c02fd69716a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:53.102880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-274a1822-4f9d-4a08-894e-4c02fd69716a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:53.239373 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-274a1822-4f9d-4a08-894e-4c02fd69716a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:53.247075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-274a1822-4f9d-4a08-894e-4c02fd69716a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.157396 Nov 02 23:27:53.247655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1821/2396] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:53 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:54.265772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ff34a01a-a90f-4dde-92a5-f78705666924 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:54.265772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ff34a01a-a90f-4dde-92a5-f78705666924 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:54.272753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff34a01a-a90f-4dde-92a5-f78705666924 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:54.273205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff34a01a-a90f-4dde-92a5-f78705666924 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:54.273982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff34a01a-a90f-4dde-92a5-f78705666924 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:54.274408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ff34a01a-a90f-4dde-92a5-f78705666924 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:54.410318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ff34a01a-a90f-4dde-92a5-f78705666924 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:54.418738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ff34a01a-a90f-4dde-92a5-f78705666924 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.157378 Nov 02 23:27:54.419357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1822/2397] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:54 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:55.436089 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4e4557cf-1c20-43f2-b1f8-fa840585cca3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:55.436786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4e4557cf-1c20-43f2-b1f8-fa840585cca3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:55.444211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e4557cf-1c20-43f2-b1f8-fa840585cca3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:55.444663 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e4557cf-1c20-43f2-b1f8-fa840585cca3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:55.445507 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e4557cf-1c20-43f2-b1f8-fa840585cca3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:55.445978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e4557cf-1c20-43f2-b1f8-fa840585cca3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:55.601795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4e4557cf-1c20-43f2-b1f8-fa840585cca3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:55.610477 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4e4557cf-1c20-43f2-b1f8-fa840585cca3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.178144 Nov 02 23:27:55.611092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1823/2398] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:55 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:56.628568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3de717e7-ef73-422a-9d5f-621a35852ef2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:56.629244 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3de717e7-ef73-422a-9d5f-621a35852ef2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:56.636038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3de717e7-ef73-422a-9d5f-621a35852ef2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:56.636516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3de717e7-ef73-422a-9d5f-621a35852ef2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:56.637367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3de717e7-ef73-422a-9d5f-621a35852ef2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:56.637811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3de717e7-ef73-422a-9d5f-621a35852ef2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:56.778402 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3de717e7-ef73-422a-9d5f-621a35852ef2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:56.787003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3de717e7-ef73-422a-9d5f-621a35852ef2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.162096 Nov 02 23:27:56.787682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1824/2399] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:56 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:57.804923 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-62e12557-ae4c-48b6-ab49-789675262d15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:57.805628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-62e12557-ae4c-48b6-ab49-789675262d15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:57.812329 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-62e12557-ae4c-48b6-ab49-789675262d15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:57.812777 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-62e12557-ae4c-48b6-ab49-789675262d15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:57.813566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-62e12557-ae4c-48b6-ab49-789675262d15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:57.814001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-62e12557-ae4c-48b6-ab49-789675262d15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:57.958519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-62e12557-ae4c-48b6-ab49-789675262d15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:57.967369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-62e12557-ae4c-48b6-ab49-789675262d15 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.166631 Nov 02 23:27:57.967850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1825/2400] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:57 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:27:58.984801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3a689ae9-51fc-4401-a2f5-f247020bc960 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:27:58.985510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3a689ae9-51fc-4401-a2f5-f247020bc960 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:27:58.992778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a689ae9-51fc-4401-a2f5-f247020bc960 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:58.993352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a689ae9-51fc-4401-a2f5-f247020bc960 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:58.994272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a689ae9-51fc-4401-a2f5-f247020bc960 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:27:58.994801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a689ae9-51fc-4401-a2f5-f247020bc960 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:27:59.137523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3a689ae9-51fc-4401-a2f5-f247020bc960 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:27:59.150209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3a689ae9-51fc-4401-a2f5-f247020bc960 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.168637 Nov 02 23:27:59.151030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1826/2401] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:27:58 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:00.169775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-123fc95e-869e-4344-9545-8bfe6b7a38ef tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:00.170497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-123fc95e-869e-4344-9545-8bfe6b7a38ef tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:00.177090 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-123fc95e-869e-4344-9545-8bfe6b7a38ef tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:00.177540 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-123fc95e-869e-4344-9545-8bfe6b7a38ef tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:00.178338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-123fc95e-869e-4344-9545-8bfe6b7a38ef tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:00.178773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-123fc95e-869e-4344-9545-8bfe6b7a38ef tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:00.328041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-123fc95e-869e-4344-9545-8bfe6b7a38ef tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:00.336598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-123fc95e-869e-4344-9545-8bfe6b7a38ef tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.170544 Nov 02 23:28:00.337204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1827/2402] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:00 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:01.354098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-24ff0a2c-e4e1-4aec-8d88-5d1cd1bc4294 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:01.354813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-24ff0a2c-e4e1-4aec-8d88-5d1cd1bc4294 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:01.361458 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24ff0a2c-e4e1-4aec-8d88-5d1cd1bc4294 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:01.361921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24ff0a2c-e4e1-4aec-8d88-5d1cd1bc4294 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:01.362678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24ff0a2c-e4e1-4aec-8d88-5d1cd1bc4294 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:01.363670 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24ff0a2c-e4e1-4aec-8d88-5d1cd1bc4294 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:01.504723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-24ff0a2c-e4e1-4aec-8d88-5d1cd1bc4294 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:01.513071 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-24ff0a2c-e4e1-4aec-8d88-5d1cd1bc4294 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.162795 Nov 02 23:28:01.513651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1828/2403] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:01 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:28:02.530478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5fdcc34c-8677-4a94-a869-1454c666a0c1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:02.531257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5fdcc34c-8677-4a94-a869-1454c666a0c1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:02.539063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5fdcc34c-8677-4a94-a869-1454c666a0c1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:02.539494 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5fdcc34c-8677-4a94-a869-1454c666a0c1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:02.540285 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5fdcc34c-8677-4a94-a869-1454c666a0c1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:02.540718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5fdcc34c-8677-4a94-a869-1454c666a0c1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:02.681984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5fdcc34c-8677-4a94-a869-1454c666a0c1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:02.691804 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5fdcc34c-8677-4a94-a869-1454c666a0c1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.165157 Nov 02 23:28:02.692544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1829/2404] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:02 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:03.709411 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b18d0f9d-fd0b-4ee1-9eb0-84cd22f34ee6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:03.710114 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b18d0f9d-fd0b-4ee1-9eb0-84cd22f34ee6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:03.716546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b18d0f9d-fd0b-4ee1-9eb0-84cd22f34ee6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:03.716912 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b18d0f9d-fd0b-4ee1-9eb0-84cd22f34ee6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:03.717689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b18d0f9d-fd0b-4ee1-9eb0-84cd22f34ee6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:03.718117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b18d0f9d-fd0b-4ee1-9eb0-84cd22f34ee6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:03.867739 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b18d0f9d-fd0b-4ee1-9eb0-84cd22f34ee6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:03.875889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b18d0f9d-fd0b-4ee1-9eb0-84cd22f34ee6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.170014 Nov 02 23:28:03.876488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1830/2405] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:03 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:04.892983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f3927535-08b4-467d-a24e-3800d1b457bc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:04.893659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f3927535-08b4-467d-a24e-3800d1b457bc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:04.899790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3927535-08b4-467d-a24e-3800d1b457bc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:04.900234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3927535-08b4-467d-a24e-3800d1b457bc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:04.900986 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3927535-08b4-467d-a24e-3800d1b457bc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:04.901421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3927535-08b4-467d-a24e-3800d1b457bc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:05.045369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f3927535-08b4-467d-a24e-3800d1b457bc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:05.054373 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f3927535-08b4-467d-a24e-3800d1b457bc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.164959 Nov 02 23:28:05.055124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1831/2406] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:04 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:06.071864 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a12fd313-58e5-4297-94d0-65bb06c8e1ba tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:06.072548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a12fd313-58e5-4297-94d0-65bb06c8e1ba tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:06.078880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a12fd313-58e5-4297-94d0-65bb06c8e1ba tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:06.079284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a12fd313-58e5-4297-94d0-65bb06c8e1ba tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:06.080056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a12fd313-58e5-4297-94d0-65bb06c8e1ba tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:06.080477 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a12fd313-58e5-4297-94d0-65bb06c8e1ba tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:06.241136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a12fd313-58e5-4297-94d0-65bb06c8e1ba tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:06.249808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a12fd313-58e5-4297-94d0-65bb06c8e1ba tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.181507 Nov 02 23:28:06.250416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1832/2407] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:06 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:07.269963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-033e54fc-af44-420b-b1a0-12b8c451aea7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:07.270657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-033e54fc-af44-420b-b1a0-12b8c451aea7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:07.277352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-033e54fc-af44-420b-b1a0-12b8c451aea7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:07.277797 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-033e54fc-af44-420b-b1a0-12b8c451aea7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:07.278572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-033e54fc-af44-420b-b1a0-12b8c451aea7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:07.279059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-033e54fc-af44-420b-b1a0-12b8c451aea7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:07.415795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-033e54fc-af44-420b-b1a0-12b8c451aea7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:07.423550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-033e54fc-af44-420b-b1a0-12b8c451aea7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.157444 Nov 02 23:28:07.424125 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1833/2408] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:07 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:08.441635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-532530b8-9734-45a4-ac5d-5f3645dfaec7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:08.442329 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-532530b8-9734-45a4-ac5d-5f3645dfaec7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:08.448636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-532530b8-9734-45a4-ac5d-5f3645dfaec7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:08.449078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-532530b8-9734-45a4-ac5d-5f3645dfaec7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:08.449848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-532530b8-9734-45a4-ac5d-5f3645dfaec7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:08.450268 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-532530b8-9734-45a4-ac5d-5f3645dfaec7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:08.582644 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-532530b8-9734-45a4-ac5d-5f3645dfaec7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:08.590249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-532530b8-9734-45a4-ac5d-5f3645dfaec7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.152708 Nov 02 23:28:08.590809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1834/2409] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:08 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:09.608296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-420b4d8c-9434-40f0-8039-7f91f410087f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:09.609000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-420b4d8c-9434-40f0-8039-7f91f410087f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:09.615749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-420b4d8c-9434-40f0-8039-7f91f410087f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:09.616199 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-420b4d8c-9434-40f0-8039-7f91f410087f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:09.617022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-420b4d8c-9434-40f0-8039-7f91f410087f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:09.617681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-420b4d8c-9434-40f0-8039-7f91f410087f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:09.749421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-420b4d8c-9434-40f0-8039-7f91f410087f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:09.757862 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-420b4d8c-9434-40f0-8039-7f91f410087f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.153505 Nov 02 23:28:09.758360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1835/2410] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:09 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:10.775151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-10bc87ac-e7d1-4d40-8747-536381cb4c10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:10.775865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-10bc87ac-e7d1-4d40-8747-536381cb4c10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:10.781935 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10bc87ac-e7d1-4d40-8747-536381cb4c10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:10.782374 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10bc87ac-e7d1-4d40-8747-536381cb4c10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:10.783171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10bc87ac-e7d1-4d40-8747-536381cb4c10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:10.783599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10bc87ac-e7d1-4d40-8747-536381cb4c10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:10.911581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-10bc87ac-e7d1-4d40-8747-536381cb4c10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:10.919222 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-10bc87ac-e7d1-4d40-8747-536381cb4c10 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.147681 Nov 02 23:28:10.919782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1836/2411] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:10 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:11.937000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-74fc9819-1b41-434f-9dc7-597542f6e586 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:11.938132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-74fc9819-1b41-434f-9dc7-597542f6e586 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:11.944914 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74fc9819-1b41-434f-9dc7-597542f6e586 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:11.945407 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74fc9819-1b41-434f-9dc7-597542f6e586 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:11.946228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74fc9819-1b41-434f-9dc7-597542f6e586 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:11.946659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74fc9819-1b41-434f-9dc7-597542f6e586 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:12.097622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-74fc9819-1b41-434f-9dc7-597542f6e586 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:12.105675 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-74fc9819-1b41-434f-9dc7-597542f6e586 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.172854 Nov 02 23:28:12.106249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1837/2412] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:11 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:13.124108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-74eb8fb2-841c-4aa7-b867-07837a56122e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:13.124855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-74eb8fb2-841c-4aa7-b867-07837a56122e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:13.131830 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74eb8fb2-841c-4aa7-b867-07837a56122e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:13.132346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74eb8fb2-841c-4aa7-b867-07837a56122e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:13.133157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74eb8fb2-841c-4aa7-b867-07837a56122e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:13.133593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74eb8fb2-841c-4aa7-b867-07837a56122e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:13.287940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-74eb8fb2-841c-4aa7-b867-07837a56122e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:13.298640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-74eb8fb2-841c-4aa7-b867-07837a56122e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.179021 Nov 02 23:28:13.299646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1838/2413] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:13 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:14.320486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1fc8f8a6-a476-4ea7-99ec-7a15b5bcf612 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:14.321592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1fc8f8a6-a476-4ea7-99ec-7a15b5bcf612 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:14.330628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fc8f8a6-a476-4ea7-99ec-7a15b5bcf612 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:14.331149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fc8f8a6-a476-4ea7-99ec-7a15b5bcf612 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:14.332302 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fc8f8a6-a476-4ea7-99ec-7a15b5bcf612 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:14.332785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fc8f8a6-a476-4ea7-99ec-7a15b5bcf612 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:14.478844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1fc8f8a6-a476-4ea7-99ec-7a15b5bcf612 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:14.489231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1fc8f8a6-a476-4ea7-99ec-7a15b5bcf612 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.174535 Nov 02 23:28:14.489806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1839/2414] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:14 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:28:15.506374 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1314d362-9ea3-4eb2-91fe-e2dc13f68a40 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:15.507050 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1314d362-9ea3-4eb2-91fe-e2dc13f68a40 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:15.513517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1314d362-9ea3-4eb2-91fe-e2dc13f68a40 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:15.513955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1314d362-9ea3-4eb2-91fe-e2dc13f68a40 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:15.514731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1314d362-9ea3-4eb2-91fe-e2dc13f68a40 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:15.515184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1314d362-9ea3-4eb2-91fe-e2dc13f68a40 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:15.887922 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1314d362-9ea3-4eb2-91fe-e2dc13f68a40 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:15.895624 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1314d362-9ea3-4eb2-91fe-e2dc13f68a40 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.393491 Nov 02 23:28:15.896193 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1840/2415] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:15 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:16.912636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d56516a3-4f1b-4327-8deb-b2f523e69983 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:16.913353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d56516a3-4f1b-4327-8deb-b2f523e69983 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:16.919632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d56516a3-4f1b-4327-8deb-b2f523e69983 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:16.920074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d56516a3-4f1b-4327-8deb-b2f523e69983 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:16.920847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d56516a3-4f1b-4327-8deb-b2f523e69983 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:16.921267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d56516a3-4f1b-4327-8deb-b2f523e69983 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:17.056594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d56516a3-4f1b-4327-8deb-b2f523e69983 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:17.064476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d56516a3-4f1b-4327-8deb-b2f523e69983 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.155490 Nov 02 23:28:17.065046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1841/2416] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:16 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:18.084048 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3ce3957f-d1e3-49c2-b5df-fbc643ae67e1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:18.084766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3ce3957f-d1e3-49c2-b5df-fbc643ae67e1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:18.091507 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3ce3957f-d1e3-49c2-b5df-fbc643ae67e1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:18.092006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3ce3957f-d1e3-49c2-b5df-fbc643ae67e1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:18.092874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3ce3957f-d1e3-49c2-b5df-fbc643ae67e1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:18.093304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3ce3957f-d1e3-49c2-b5df-fbc643ae67e1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:18.246343 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3ce3957f-d1e3-49c2-b5df-fbc643ae67e1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:18.254750 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3ce3957f-d1e3-49c2-b5df-fbc643ae67e1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.176081 Nov 02 23:28:18.255398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1842/2417] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:18 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:19.272753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-07a7db9f-47e4-4b96-b6cb-2339d95966f9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:19.273404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-07a7db9f-47e4-4b96-b6cb-2339d95966f9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:19.279965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-07a7db9f-47e4-4b96-b6cb-2339d95966f9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:19.280405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-07a7db9f-47e4-4b96-b6cb-2339d95966f9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:19.281172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-07a7db9f-47e4-4b96-b6cb-2339d95966f9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:19.281597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-07a7db9f-47e4-4b96-b6cb-2339d95966f9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:19.415038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-07a7db9f-47e4-4b96-b6cb-2339d95966f9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:19.423096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-07a7db9f-47e4-4b96-b6cb-2339d95966f9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.154763 Nov 02 23:28:19.423678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1843/2418] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:19 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:20.440157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c14b5d0b-4da4-4ce0-967f-6b7ba3c93479 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:20.441606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c14b5d0b-4da4-4ce0-967f-6b7ba3c93479 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:20.448616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c14b5d0b-4da4-4ce0-967f-6b7ba3c93479 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:20.449146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c14b5d0b-4da4-4ce0-967f-6b7ba3c93479 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:20.449956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c14b5d0b-4da4-4ce0-967f-6b7ba3c93479 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:20.450394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c14b5d0b-4da4-4ce0-967f-6b7ba3c93479 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:20.587899 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c14b5d0b-4da4-4ce0-967f-6b7ba3c93479 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:20.595569 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c14b5d0b-4da4-4ce0-967f-6b7ba3c93479 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.159051 Nov 02 23:28:20.596153 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1844/2419] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:20 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:21.613053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9e6e8c69-9db5-4e84-81d1-fa6560731912 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:21.613720 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9e6e8c69-9db5-4e84-81d1-fa6560731912 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:21.620330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e6e8c69-9db5-4e84-81d1-fa6560731912 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:21.620782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e6e8c69-9db5-4e84-81d1-fa6560731912 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:21.621562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e6e8c69-9db5-4e84-81d1-fa6560731912 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:21.621992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e6e8c69-9db5-4e84-81d1-fa6560731912 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:21.763606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9e6e8c69-9db5-4e84-81d1-fa6560731912 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:21.771381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9e6e8c69-9db5-4e84-81d1-fa6560731912 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.162584 Nov 02 23:28:21.771946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1845/2420] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:21 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:22.789299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0677edce-1868-4e9d-816f-c91ba379c2bf tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:22.789977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0677edce-1868-4e9d-816f-c91ba379c2bf tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:22.796555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0677edce-1868-4e9d-816f-c91ba379c2bf tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:22.797001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0677edce-1868-4e9d-816f-c91ba379c2bf tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:22.797782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0677edce-1868-4e9d-816f-c91ba379c2bf tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:22.798216 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0677edce-1868-4e9d-816f-c91ba379c2bf tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:22.935175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0677edce-1868-4e9d-816f-c91ba379c2bf tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:22.943263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0677edce-1868-4e9d-816f-c91ba379c2bf tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.157759 Nov 02 23:28:22.943863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1846/2421] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:22 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:24.166041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d9ffed0a-3a52-43c8-aa26-9bd04d772bbf tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:24.166756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d9ffed0a-3a52-43c8-aa26-9bd04d772bbf tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:24.172968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9ffed0a-3a52-43c8-aa26-9bd04d772bbf tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:24.173413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9ffed0a-3a52-43c8-aa26-9bd04d772bbf tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:24.174204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9ffed0a-3a52-43c8-aa26-9bd04d772bbf tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:24.174635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9ffed0a-3a52-43c8-aa26-9bd04d772bbf tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:24.321529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d9ffed0a-3a52-43c8-aa26-9bd04d772bbf tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:24.329599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d9ffed0a-3a52-43c8-aa26-9bd04d772bbf tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.372984 Nov 02 23:28:24.330180 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1847/2422] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:23 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:25.347687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b7569166-df6e-4dcd-8874-2345c8a3a9ca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:25.348396 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b7569166-df6e-4dcd-8874-2345c8a3a9ca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:25.355184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b7569166-df6e-4dcd-8874-2345c8a3a9ca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:25.355636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b7569166-df6e-4dcd-8874-2345c8a3a9ca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:25.356470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b7569166-df6e-4dcd-8874-2345c8a3a9ca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:25.356902 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b7569166-df6e-4dcd-8874-2345c8a3a9ca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:25.496615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b7569166-df6e-4dcd-8874-2345c8a3a9ca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:25.505418 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b7569166-df6e-4dcd-8874-2345c8a3a9ca tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.162030 Nov 02 23:28:25.506030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1848/2423] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:25 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:26.523658 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-45d4fd03-e177-486c-ac7d-dcb069d348cc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:26.524358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-45d4fd03-e177-486c-ac7d-dcb069d348cc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:26.530592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45d4fd03-e177-486c-ac7d-dcb069d348cc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:26.531080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45d4fd03-e177-486c-ac7d-dcb069d348cc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:26.531861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45d4fd03-e177-486c-ac7d-dcb069d348cc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:26.532297 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45d4fd03-e177-486c-ac7d-dcb069d348cc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:26.676922 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-45d4fd03-e177-486c-ac7d-dcb069d348cc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:26.684888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-45d4fd03-e177-486c-ac7d-dcb069d348cc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.164821 Nov 02 23:28:26.685472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1849/2424] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:26 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:27.715803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-badaf498-f0c9-4790-a6da-1a7ff3136c67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:27.716519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-badaf498-f0c9-4790-a6da-1a7ff3136c67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:27.724230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-badaf498-f0c9-4790-a6da-1a7ff3136c67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:27.724692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-badaf498-f0c9-4790-a6da-1a7ff3136c67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:27.725493 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-badaf498-f0c9-4790-a6da-1a7ff3136c67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:27.725896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-badaf498-f0c9-4790-a6da-1a7ff3136c67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:27.878169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-badaf498-f0c9-4790-a6da-1a7ff3136c67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:27.890295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-badaf498-f0c9-4790-a6da-1a7ff3136c67 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.178381 Nov 02 23:28:27.891030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1850/2425] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:27 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:28.915347 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ecca5529-d744-4132-96eb-30abf367a23b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:28.916047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ecca5529-d744-4132-96eb-30abf367a23b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:28.922701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ecca5529-d744-4132-96eb-30abf367a23b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:28.923182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ecca5529-d744-4132-96eb-30abf367a23b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:28.923965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ecca5529-d744-4132-96eb-30abf367a23b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:28.924394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ecca5529-d744-4132-96eb-30abf367a23b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:29.080241 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ecca5529-d744-4132-96eb-30abf367a23b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:29.094806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ecca5529-d744-4132-96eb-30abf367a23b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.182370 Nov 02 23:28:29.095640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1851/2426] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:28 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:30.119206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dd4462d9-b2ef-44fa-9942-faa0881eb065 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:30.119931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dd4462d9-b2ef-44fa-9942-faa0881eb065 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:30.129597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd4462d9-b2ef-44fa-9942-faa0881eb065 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:30.130047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd4462d9-b2ef-44fa-9942-faa0881eb065 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:30.130826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd4462d9-b2ef-44fa-9942-faa0881eb065 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:30.131301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd4462d9-b2ef-44fa-9942-faa0881eb065 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:30.305830 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dd4462d9-b2ef-44fa-9942-faa0881eb065 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:30.314468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dd4462d9-b2ef-44fa-9942-faa0881eb065 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.199314 Nov 02 23:28:30.315152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1852/2427] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:30 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:31.337055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d4f7a4a6-28a4-483c-b4cd-9f75c396c6d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:31.337936 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d4f7a4a6-28a4-483c-b4cd-9f75c396c6d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:31.345980 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d4f7a4a6-28a4-483c-b4cd-9f75c396c6d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:31.346429 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d4f7a4a6-28a4-483c-b4cd-9f75c396c6d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:31.348282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d4f7a4a6-28a4-483c-b4cd-9f75c396c6d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:31.349019 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d4f7a4a6-28a4-483c-b4cd-9f75c396c6d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:31.507921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d4f7a4a6-28a4-483c-b4cd-9f75c396c6d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:31.516201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d4f7a4a6-28a4-483c-b4cd-9f75c396c6d2 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.185974 Nov 02 23:28:31.516836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1853/2428] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:31 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:28:32.535104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6ec9fd49-8637-4bd2-8f3a-1a8b58e48e60 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:32.535833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6ec9fd49-8637-4bd2-8f3a-1a8b58e48e60 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:32.542395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ec9fd49-8637-4bd2-8f3a-1a8b58e48e60 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:32.542839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ec9fd49-8637-4bd2-8f3a-1a8b58e48e60 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:32.543664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ec9fd49-8637-4bd2-8f3a-1a8b58e48e60 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:32.544093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ec9fd49-8637-4bd2-8f3a-1a8b58e48e60 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:32.703237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6ec9fd49-8637-4bd2-8f3a-1a8b58e48e60 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:32.712081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6ec9fd49-8637-4bd2-8f3a-1a8b58e48e60 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.181573 Nov 02 23:28:32.712678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1854/2429] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:32 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:33.729752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b9d85e9b-3379-41e6-b166-2e0ccb6068eb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:33.730542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b9d85e9b-3379-41e6-b166-2e0ccb6068eb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:33.736946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9d85e9b-3379-41e6-b166-2e0ccb6068eb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:33.737932 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9d85e9b-3379-41e6-b166-2e0ccb6068eb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:33.738721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9d85e9b-3379-41e6-b166-2e0ccb6068eb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:33.739188 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9d85e9b-3379-41e6-b166-2e0ccb6068eb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:33.899263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b9d85e9b-3379-41e6-b166-2e0ccb6068eb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:33.912112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b9d85e9b-3379-41e6-b166-2e0ccb6068eb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.186160 Nov 02 23:28:33.912968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1855/2430] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:33 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:34.933160 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1d350a16-1363-4644-a016-4de06e031ff3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:34.933887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1d350a16-1363-4644-a016-4de06e031ff3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:34.941248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d350a16-1363-4644-a016-4de06e031ff3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:34.941687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d350a16-1363-4644-a016-4de06e031ff3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:34.942488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d350a16-1363-4644-a016-4de06e031ff3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:34.942905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d350a16-1363-4644-a016-4de06e031ff3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:35.085206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1d350a16-1363-4644-a016-4de06e031ff3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:35.093824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1d350a16-1363-4644-a016-4de06e031ff3 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.164305 Nov 02 23:28:35.094474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1856/2431] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:34 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:36.111168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2edf6427-d9bd-4253-be35-25cf9c23bd5c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:36.111891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2edf6427-d9bd-4253-be35-25cf9c23bd5c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:36.119294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2edf6427-d9bd-4253-be35-25cf9c23bd5c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:36.119745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2edf6427-d9bd-4253-be35-25cf9c23bd5c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:36.120548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2edf6427-d9bd-4253-be35-25cf9c23bd5c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:36.120987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2edf6427-d9bd-4253-be35-25cf9c23bd5c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:36.273562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2edf6427-d9bd-4253-be35-25cf9c23bd5c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:36.284906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2edf6427-d9bd-4253-be35-25cf9c23bd5c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.176573 Nov 02 23:28:36.285935 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1857/2432] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:36 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:37.306142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4391caf0-7890-49c0-bcbb-98a8736917a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:37.307270 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4391caf0-7890-49c0-bcbb-98a8736917a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:37.313511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4391caf0-7890-49c0-bcbb-98a8736917a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:37.313963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4391caf0-7890-49c0-bcbb-98a8736917a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:37.315072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4391caf0-7890-49c0-bcbb-98a8736917a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:37.316083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4391caf0-7890-49c0-bcbb-98a8736917a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:37.463122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4391caf0-7890-49c0-bcbb-98a8736917a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:37.472303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4391caf0-7890-49c0-bcbb-98a8736917a5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.169243 Nov 02 23:28:37.472897 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1858/2433] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:37 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:38.489874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2b1e7bb4-3dea-4eb8-8bdb-0c717f1c8e3d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:38.490582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2b1e7bb4-3dea-4eb8-8bdb-0c717f1c8e3d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:38.497118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b1e7bb4-3dea-4eb8-8bdb-0c717f1c8e3d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:38.497564 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b1e7bb4-3dea-4eb8-8bdb-0c717f1c8e3d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:38.498341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b1e7bb4-3dea-4eb8-8bdb-0c717f1c8e3d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:38.498776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b1e7bb4-3dea-4eb8-8bdb-0c717f1c8e3d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:38.656418 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2b1e7bb4-3dea-4eb8-8bdb-0c717f1c8e3d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:38.667141 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2b1e7bb4-3dea-4eb8-8bdb-0c717f1c8e3d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.180831 Nov 02 23:28:38.667755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1859/2434] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:38 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:39.694078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-09394c1d-b9af-41f4-8e00-d23c76e7c7da tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:39.695133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-09394c1d-b9af-41f4-8e00-d23c76e7c7da tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:39.701207 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-09394c1d-b9af-41f4-8e00-d23c76e7c7da tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:39.701659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-09394c1d-b9af-41f4-8e00-d23c76e7c7da tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:39.702434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-09394c1d-b9af-41f4-8e00-d23c76e7c7da tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:39.702862 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-09394c1d-b9af-41f4-8e00-d23c76e7c7da tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:39.852023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-09394c1d-b9af-41f4-8e00-d23c76e7c7da tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:39.860793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-09394c1d-b9af-41f4-8e00-d23c76e7c7da tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.180806 Nov 02 23:28:39.861529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1860/2435] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:39 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:40.877488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-00488ad5-62d1-4562-9680-b26ccfe5b016 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:40.878809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-00488ad5-62d1-4562-9680-b26ccfe5b016 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:40.885137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-00488ad5-62d1-4562-9680-b26ccfe5b016 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:40.885577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-00488ad5-62d1-4562-9680-b26ccfe5b016 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:40.886353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-00488ad5-62d1-4562-9680-b26ccfe5b016 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:40.886778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-00488ad5-62d1-4562-9680-b26ccfe5b016 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:41.035532 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-00488ad5-62d1-4562-9680-b26ccfe5b016 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:41.048424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-00488ad5-62d1-4562-9680-b26ccfe5b016 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.174176 Nov 02 23:28:41.050053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1861/2436] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:40 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:42.075119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4b7e01af-2ceb-4fff-9464-4f1664717a56 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:42.075820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4b7e01af-2ceb-4fff-9464-4f1664717a56 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:42.081988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b7e01af-2ceb-4fff-9464-4f1664717a56 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:42.082447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b7e01af-2ceb-4fff-9464-4f1664717a56 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:42.083254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b7e01af-2ceb-4fff-9464-4f1664717a56 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:42.083692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b7e01af-2ceb-4fff-9464-4f1664717a56 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:42.221994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4b7e01af-2ceb-4fff-9464-4f1664717a56 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:42.230154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4b7e01af-2ceb-4fff-9464-4f1664717a56 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.158779 Nov 02 23:28:42.230756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1862/2437] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:42 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:43.247987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cc2273f5-8656-4b64-bf3b-319368d80f33 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:43.248701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cc2273f5-8656-4b64-bf3b-319368d80f33 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:43.255813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc2273f5-8656-4b64-bf3b-319368d80f33 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:43.256257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc2273f5-8656-4b64-bf3b-319368d80f33 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:43.257032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc2273f5-8656-4b64-bf3b-319368d80f33 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:43.257460 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc2273f5-8656-4b64-bf3b-319368d80f33 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:43.389969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cc2273f5-8656-4b64-bf3b-319368d80f33 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:43.397930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cc2273f5-8656-4b64-bf3b-319368d80f33 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.153559 Nov 02 23:28:43.398521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1863/2438] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:43 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:28:44.415267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d2bed499-fa62-4459-88c0-917b0297e897 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:44.415990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d2bed499-fa62-4459-88c0-917b0297e897 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:44.422389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2bed499-fa62-4459-88c0-917b0297e897 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:44.422828 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2bed499-fa62-4459-88c0-917b0297e897 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:44.423774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2bed499-fa62-4459-88c0-917b0297e897 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:44.424201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2bed499-fa62-4459-88c0-917b0297e897 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:44.562258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d2bed499-fa62-4459-88c0-917b0297e897 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:44.570822 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d2bed499-fa62-4459-88c0-917b0297e897 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.159397 Nov 02 23:28:44.571443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1864/2439] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:44 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:45.588320 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-abe262ec-7c2d-4be6-8ad6-8ae6f6efee34 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:45.589234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-abe262ec-7c2d-4be6-8ad6-8ae6f6efee34 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:45.595318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-abe262ec-7c2d-4be6-8ad6-8ae6f6efee34 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:45.595761 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-abe262ec-7c2d-4be6-8ad6-8ae6f6efee34 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:45.597118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-abe262ec-7c2d-4be6-8ad6-8ae6f6efee34 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:45.597613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-abe262ec-7c2d-4be6-8ad6-8ae6f6efee34 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:45.761538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-abe262ec-7c2d-4be6-8ad6-8ae6f6efee34 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:45.770124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-abe262ec-7c2d-4be6-8ad6-8ae6f6efee34 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.185395 Nov 02 23:28:45.770702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1865/2440] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:45 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:46.787829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-53177b00-17c5-4eee-bb86-cbca5f2b6166 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:46.788552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-53177b00-17c5-4eee-bb86-cbca5f2b6166 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:46.795325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53177b00-17c5-4eee-bb86-cbca5f2b6166 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:46.795791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53177b00-17c5-4eee-bb86-cbca5f2b6166 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:46.796568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53177b00-17c5-4eee-bb86-cbca5f2b6166 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:46.797000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53177b00-17c5-4eee-bb86-cbca5f2b6166 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:46.945917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-53177b00-17c5-4eee-bb86-cbca5f2b6166 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:46.954249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-53177b00-17c5-4eee-bb86-cbca5f2b6166 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.170783 Nov 02 23:28:46.954850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1866/2441] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:46 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:47.974153 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3f47374c-e5c2-4ec4-ac0c-8260d451e842 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:47.974893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3f47374c-e5c2-4ec4-ac0c-8260d451e842 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:47.981595 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f47374c-e5c2-4ec4-ac0c-8260d451e842 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:47.982163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f47374c-e5c2-4ec4-ac0c-8260d451e842 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:47.983078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f47374c-e5c2-4ec4-ac0c-8260d451e842 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:47.983559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f47374c-e5c2-4ec4-ac0c-8260d451e842 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:48.157120 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3f47374c-e5c2-4ec4-ac0c-8260d451e842 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:48.168951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3f47374c-e5c2-4ec4-ac0c-8260d451e842 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.198334 Nov 02 23:28:48.178248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1867/2442] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:47 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:49.185361 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fedf925b-a3a7-474a-9a48-bb039079a32b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:49.186028 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fedf925b-a3a7-474a-9a48-bb039079a32b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:49.196977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fedf925b-a3a7-474a-9a48-bb039079a32b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:49.198051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fedf925b-a3a7-474a-9a48-bb039079a32b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:49.199559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fedf925b-a3a7-474a-9a48-bb039079a32b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:49.200446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fedf925b-a3a7-474a-9a48-bb039079a32b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:49.353650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fedf925b-a3a7-474a-9a48-bb039079a32b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:49.362195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fedf925b-a3a7-474a-9a48-bb039079a32b tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.179945 Nov 02 23:28:49.362957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1868/2443] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:49 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:50.379771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f8d38041-af47-42c3-a4a0-c13c9958933e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:50.380458 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f8d38041-af47-42c3-a4a0-c13c9958933e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:50.386715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8d38041-af47-42c3-a4a0-c13c9958933e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:50.387206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8d38041-af47-42c3-a4a0-c13c9958933e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:50.387987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8d38041-af47-42c3-a4a0-c13c9958933e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:50.388423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8d38041-af47-42c3-a4a0-c13c9958933e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:50.523349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f8d38041-af47-42c3-a4a0-c13c9958933e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:50.531014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f8d38041-af47-42c3-a4a0-c13c9958933e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.155013 Nov 02 23:28:50.531587 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1869/2444] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:50 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:51.548453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-acec8c18-2c56-428e-ab6c-e5e8ed54be63 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:51.549645 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-acec8c18-2c56-428e-ab6c-e5e8ed54be63 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:51.556117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-acec8c18-2c56-428e-ab6c-e5e8ed54be63 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:51.556591 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-acec8c18-2c56-428e-ab6c-e5e8ed54be63 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:51.557518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-acec8c18-2c56-428e-ab6c-e5e8ed54be63 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:51.558050 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-acec8c18-2c56-428e-ab6c-e5e8ed54be63 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:51.696809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-acec8c18-2c56-428e-ab6c-e5e8ed54be63 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:51.705796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-acec8c18-2c56-428e-ab6c-e5e8ed54be63 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.160947 Nov 02 23:28:51.706365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1870/2445] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:51 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:52.727998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2a4a9663-bb7b-49cb-964a-91075fd1ca22 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:52.728653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2a4a9663-bb7b-49cb-964a-91075fd1ca22 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:52.734839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a4a9663-bb7b-49cb-964a-91075fd1ca22 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:52.735321 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a4a9663-bb7b-49cb-964a-91075fd1ca22 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:52.736104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a4a9663-bb7b-49cb-964a-91075fd1ca22 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:52.736537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a4a9663-bb7b-49cb-964a-91075fd1ca22 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:52.871852 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2a4a9663-bb7b-49cb-964a-91075fd1ca22 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:52.879878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2a4a9663-bb7b-49cb-964a-91075fd1ca22 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.155546 Nov 02 23:28:52.880465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1871/2446] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:52 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:53.897233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-820552c3-65c6-491a-8113-ea672df1e581 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:53.897926 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-820552c3-65c6-491a-8113-ea672df1e581 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:53.904204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-820552c3-65c6-491a-8113-ea672df1e581 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:53.904649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-820552c3-65c6-491a-8113-ea672df1e581 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:53.905422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-820552c3-65c6-491a-8113-ea672df1e581 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:53.905852 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-820552c3-65c6-491a-8113-ea672df1e581 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:54.066496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-820552c3-65c6-491a-8113-ea672df1e581 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:54.074326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-820552c3-65c6-491a-8113-ea672df1e581 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.181276 Nov 02 23:28:54.074951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1872/2447] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:53 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:55.091984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f5344786-f013-4e41-a6cc-6e45bd6df83f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:55.092713 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f5344786-f013-4e41-a6cc-6e45bd6df83f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:55.100150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f5344786-f013-4e41-a6cc-6e45bd6df83f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:55.100598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f5344786-f013-4e41-a6cc-6e45bd6df83f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:55.101371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f5344786-f013-4e41-a6cc-6e45bd6df83f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:55.101798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f5344786-f013-4e41-a6cc-6e45bd6df83f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:55.233328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f5344786-f013-4e41-a6cc-6e45bd6df83f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:55.241205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f5344786-f013-4e41-a6cc-6e45bd6df83f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.152859 Nov 02 23:28:55.241773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1873/2448] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:55 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:56.257667 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9b89e59a-dfe0-4a40-b274-16b4a16ad144 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:56.258262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9b89e59a-dfe0-4a40-b274-16b4a16ad144 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:56.264426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9b89e59a-dfe0-4a40-b274-16b4a16ad144 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:56.264876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9b89e59a-dfe0-4a40-b274-16b4a16ad144 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:56.265638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9b89e59a-dfe0-4a40-b274-16b4a16ad144 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:56.266069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9b89e59a-dfe0-4a40-b274-16b4a16ad144 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:56.395822 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9b89e59a-dfe0-4a40-b274-16b4a16ad144 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:56.403438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9b89e59a-dfe0-4a40-b274-16b4a16ad144 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.149396 Nov 02 23:28:56.404000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1874/2449] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:56 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:57.420401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b856cea0-b12c-4da5-a86a-30688bd0b82d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:57.421089 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b856cea0-b12c-4da5-a86a-30688bd0b82d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:57.427501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b856cea0-b12c-4da5-a86a-30688bd0b82d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:57.427946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b856cea0-b12c-4da5-a86a-30688bd0b82d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:57.428729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b856cea0-b12c-4da5-a86a-30688bd0b82d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:57.429161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b856cea0-b12c-4da5-a86a-30688bd0b82d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:57.668816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:28:57.669091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:28:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 (ip 10.222.0.41) !!! Nov 02 23:28:57.696595 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b856cea0-b12c-4da5-a86a-30688bd0b82d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:57.705041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b856cea0-b12c-4da5-a86a-30688bd0b82d tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.288266 Nov 02 23:28:57.706299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1875/2450] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:57 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:28:58.722464 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a52c3c0c-25da-45c2-8cdd-0d1177f6c4a9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:58.725010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a52c3c0c-25da-45c2-8cdd-0d1177f6c4a9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:58.731169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a52c3c0c-25da-45c2-8cdd-0d1177f6c4a9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:58.731617 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a52c3c0c-25da-45c2-8cdd-0d1177f6c4a9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:58.732384 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a52c3c0c-25da-45c2-8cdd-0d1177f6c4a9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:58.733023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a52c3c0c-25da-45c2-8cdd-0d1177f6c4a9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:58.865750 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a52c3c0c-25da-45c2-8cdd-0d1177f6c4a9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:28:58.873650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a52c3c0c-25da-45c2-8cdd-0d1177f6c4a9 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.154872 Nov 02 23:28:58.874214 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1876/2451] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:58 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:28:59.890657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fa313d70-50f3-4388-a195-5f4b7cb344da tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:28:59.891349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fa313d70-50f3-4388-a195-5f4b7cb344da tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:28:59.897779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fa313d70-50f3-4388-a195-5f4b7cb344da tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:59.898227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fa313d70-50f3-4388-a195-5f4b7cb344da tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:28:59.899011 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fa313d70-50f3-4388-a195-5f4b7cb344da tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:28:59.899449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fa313d70-50f3-4388-a195-5f4b7cb344da tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:00.034035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fa313d70-50f3-4388-a195-5f4b7cb344da tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:00.041734 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fa313d70-50f3-4388-a195-5f4b7cb344da tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.154722 Nov 02 23:29:00.042291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1877/2452] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:28:59 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:01.058481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a2ec55ef-a0a7-4673-9cf6-ca982a26905e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:01.059168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a2ec55ef-a0a7-4673-9cf6-ca982a26905e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:01.065575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2ec55ef-a0a7-4673-9cf6-ca982a26905e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:01.066024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2ec55ef-a0a7-4673-9cf6-ca982a26905e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:01.066787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2ec55ef-a0a7-4673-9cf6-ca982a26905e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:01.067243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2ec55ef-a0a7-4673-9cf6-ca982a26905e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:01.200471 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a2ec55ef-a0a7-4673-9cf6-ca982a26905e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:01.209166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a2ec55ef-a0a7-4673-9cf6-ca982a26905e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.154383 Nov 02 23:29:01.209747 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1878/2453] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:01 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:02.226309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-88c34148-7b6c-486c-804a-495b24a3c1df tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:02.226991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-88c34148-7b6c-486c-804a-495b24a3c1df tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:02.233719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88c34148-7b6c-486c-804a-495b24a3c1df tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:02.234165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88c34148-7b6c-486c-804a-495b24a3c1df tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:02.234950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88c34148-7b6c-486c-804a-495b24a3c1df tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:02.235388 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88c34148-7b6c-486c-804a-495b24a3c1df tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:02.370961 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-88c34148-7b6c-486c-804a-495b24a3c1df tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:02.378632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-88c34148-7b6c-486c-804a-495b24a3c1df tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.156462 Nov 02 23:29:02.379235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1879/2454] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:02 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:03.395965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3a9ab1ab-f249-4425-b4c1-335dd911d203 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:03.396614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3a9ab1ab-f249-4425-b4c1-335dd911d203 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:03.402690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a9ab1ab-f249-4425-b4c1-335dd911d203 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:03.403165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a9ab1ab-f249-4425-b4c1-335dd911d203 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:03.403931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a9ab1ab-f249-4425-b4c1-335dd911d203 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:03.404361 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a9ab1ab-f249-4425-b4c1-335dd911d203 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:03.529829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3a9ab1ab-f249-4425-b4c1-335dd911d203 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:03.537484 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3a9ab1ab-f249-4425-b4c1-335dd911d203 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.145258 Nov 02 23:29:03.538052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1880/2455] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:03 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:04.554809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-98ba31b0-2a13-44a9-ad15-f1b864f18971 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:04.555535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-98ba31b0-2a13-44a9-ad15-f1b864f18971 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:04.561833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98ba31b0-2a13-44a9-ad15-f1b864f18971 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:04.562274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98ba31b0-2a13-44a9-ad15-f1b864f18971 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:04.563068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98ba31b0-2a13-44a9-ad15-f1b864f18971 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:04.563497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98ba31b0-2a13-44a9-ad15-f1b864f18971 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:04.695280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-98ba31b0-2a13-44a9-ad15-f1b864f18971 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:04.703046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-98ba31b0-2a13-44a9-ad15-f1b864f18971 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.151865 Nov 02 23:29:04.703610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1881/2456] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:04 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:05.720405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b19e137c-029d-41f9-a085-2b0d309bf65e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:05.721084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b19e137c-029d-41f9-a085-2b0d309bf65e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:05.728014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b19e137c-029d-41f9-a085-2b0d309bf65e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:05.728459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b19e137c-029d-41f9-a085-2b0d309bf65e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:05.729224 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b19e137c-029d-41f9-a085-2b0d309bf65e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:05.729651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b19e137c-029d-41f9-a085-2b0d309bf65e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:05.856753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b19e137c-029d-41f9-a085-2b0d309bf65e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:05.864490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b19e137c-029d-41f9-a085-2b0d309bf65e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.148236 Nov 02 23:29:05.865049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1882/2457] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:05 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:06.880356 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6557a85c-1e8a-4c02-93db-f7ffc3a9ce8a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:06.881026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6557a85c-1e8a-4c02-93db-f7ffc3a9ce8a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:06.887183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6557a85c-1e8a-4c02-93db-f7ffc3a9ce8a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:06.887632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6557a85c-1e8a-4c02-93db-f7ffc3a9ce8a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:06.888420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6557a85c-1e8a-4c02-93db-f7ffc3a9ce8a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:06.888854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6557a85c-1e8a-4c02-93db-f7ffc3a9ce8a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:07.021470 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6557a85c-1e8a-4c02-93db-f7ffc3a9ce8a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:07.029552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6557a85c-1e8a-4c02-93db-f7ffc3a9ce8a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.152811 Nov 02 23:29:07.030144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1883/2458] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:06 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:08.046786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3f01c14d-e9f2-4d80-9834-91b448e123d8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:08.047477 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3f01c14d-e9f2-4d80-9834-91b448e123d8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:08.054023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f01c14d-e9f2-4d80-9834-91b448e123d8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:08.054463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f01c14d-e9f2-4d80-9834-91b448e123d8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:08.055247 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f01c14d-e9f2-4d80-9834-91b448e123d8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:08.055681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f01c14d-e9f2-4d80-9834-91b448e123d8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:08.195825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3f01c14d-e9f2-4d80-9834-91b448e123d8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:08.203508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3f01c14d-e9f2-4d80-9834-91b448e123d8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.160390 Nov 02 23:29:08.204077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1884/2459] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:08 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:09.220248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0488cb2a-1b64-421a-ab13-fe899a24b602 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:09.220877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0488cb2a-1b64-421a-ab13-fe899a24b602 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:09.227238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0488cb2a-1b64-421a-ab13-fe899a24b602 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:09.229967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0488cb2a-1b64-421a-ab13-fe899a24b602 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:09.231021 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0488cb2a-1b64-421a-ab13-fe899a24b602 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:09.231463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0488cb2a-1b64-421a-ab13-fe899a24b602 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:09.361473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0488cb2a-1b64-421a-ab13-fe899a24b602 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:09.370308 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0488cb2a-1b64-421a-ab13-fe899a24b602 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.153607 Nov 02 23:29:09.370878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1885/2460] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:09 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:10.388330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-afe3926c-d58c-48c2-82fa-4bd0813510d5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:10.389018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-afe3926c-d58c-48c2-82fa-4bd0813510d5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:10.395892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-afe3926c-d58c-48c2-82fa-4bd0813510d5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:10.396335 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-afe3926c-d58c-48c2-82fa-4bd0813510d5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:10.397089 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-afe3926c-d58c-48c2-82fa-4bd0813510d5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:10.397593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-afe3926c-d58c-48c2-82fa-4bd0813510d5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:10.532427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-afe3926c-d58c-48c2-82fa-4bd0813510d5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:10.540388 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-afe3926c-d58c-48c2-82fa-4bd0813510d5 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.155595 Nov 02 23:29:10.540970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1886/2461] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:10 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:11.559097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-999a7434-ada5-4ed1-8b15-6927bf526ab7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:11.559802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-999a7434-ada5-4ed1-8b15-6927bf526ab7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:11.566173 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-999a7434-ada5-4ed1-8b15-6927bf526ab7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:11.566612 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-999a7434-ada5-4ed1-8b15-6927bf526ab7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:11.567408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-999a7434-ada5-4ed1-8b15-6927bf526ab7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:11.567837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-999a7434-ada5-4ed1-8b15-6927bf526ab7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:11.697285 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-999a7434-ada5-4ed1-8b15-6927bf526ab7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:11.704837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-999a7434-ada5-4ed1-8b15-6927bf526ab7 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.150968 Nov 02 23:29:11.705393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1887/2462] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:11 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:29:12.722181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-19898d77-7e67-4619-815b-68f2c694f8fc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:12.722972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-19898d77-7e67-4619-815b-68f2c694f8fc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:12.729229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19898d77-7e67-4619-815b-68f2c694f8fc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:12.729675 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19898d77-7e67-4619-815b-68f2c694f8fc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:12.730448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19898d77-7e67-4619-815b-68f2c694f8fc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:12.730876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19898d77-7e67-4619-815b-68f2c694f8fc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:12.863085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-19898d77-7e67-4619-815b-68f2c694f8fc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:12.870732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-19898d77-7e67-4619-815b-68f2c694f8fc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.152310 Nov 02 23:29:12.871339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1888/2463] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:12 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:13.888233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-172c5e8d-beb3-43d0-962c-17470f9efce6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:13.888947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-172c5e8d-beb3-43d0-962c-17470f9efce6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:13.895225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-172c5e8d-beb3-43d0-962c-17470f9efce6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:13.895672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-172c5e8d-beb3-43d0-962c-17470f9efce6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:13.896439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-172c5e8d-beb3-43d0-962c-17470f9efce6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:13.896865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-172c5e8d-beb3-43d0-962c-17470f9efce6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:14.024209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-172c5e8d-beb3-43d0-962c-17470f9efce6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:14.031824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-172c5e8d-beb3-43d0-962c-17470f9efce6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.147259 Nov 02 23:29:14.032390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1889/2464] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:13 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:15.048924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-76d97b5f-3a7f-4237-93ee-666f823b4bec tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:15.049528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-76d97b5f-3a7f-4237-93ee-666f823b4bec tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:15.056373 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-76d97b5f-3a7f-4237-93ee-666f823b4bec tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:15.056821 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-76d97b5f-3a7f-4237-93ee-666f823b4bec tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:15.057587 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-76d97b5f-3a7f-4237-93ee-666f823b4bec tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:15.058017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-76d97b5f-3a7f-4237-93ee-666f823b4bec tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:15.188201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-76d97b5f-3a7f-4237-93ee-666f823b4bec tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:15.196867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-76d97b5f-3a7f-4237-93ee-666f823b4bec tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.151604 Nov 02 23:29:15.197430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1890/2465] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:15 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:16.213530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6099e76e-60a1-4114-a0a2-44724a553794 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:16.214144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6099e76e-60a1-4114-a0a2-44724a553794 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:16.220473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6099e76e-60a1-4114-a0a2-44724a553794 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:16.220927 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6099e76e-60a1-4114-a0a2-44724a553794 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:16.221731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6099e76e-60a1-4114-a0a2-44724a553794 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:16.222167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6099e76e-60a1-4114-a0a2-44724a553794 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:16.348949 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6099e76e-60a1-4114-a0a2-44724a553794 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:16.356944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6099e76e-60a1-4114-a0a2-44724a553794 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.147063 Nov 02 23:29:16.357567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1891/2466] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:16 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:17.373666 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3c8ca4ea-1379-46a9-85d7-b2f07a47223e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:17.374324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3c8ca4ea-1379-46a9-85d7-b2f07a47223e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:17.380421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c8ca4ea-1379-46a9-85d7-b2f07a47223e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:17.380868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c8ca4ea-1379-46a9-85d7-b2f07a47223e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:17.381628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c8ca4ea-1379-46a9-85d7-b2f07a47223e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:17.382056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c8ca4ea-1379-46a9-85d7-b2f07a47223e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:17.511403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3c8ca4ea-1379-46a9-85d7-b2f07a47223e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:17.519506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3c8ca4ea-1379-46a9-85d7-b2f07a47223e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.149548 Nov 02 23:29:17.520073 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1892/2467] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:17 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:18.536663 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9bb86b46-02ed-4280-85f3-d03f889c35ed tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:18.537374 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9bb86b46-02ed-4280-85f3-d03f889c35ed tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:18.543462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9bb86b46-02ed-4280-85f3-d03f889c35ed tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:18.543907 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9bb86b46-02ed-4280-85f3-d03f889c35ed tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:18.544667 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9bb86b46-02ed-4280-85f3-d03f889c35ed tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:18.545094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9bb86b46-02ed-4280-85f3-d03f889c35ed tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:18.679450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9bb86b46-02ed-4280-85f3-d03f889c35ed tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:18.687311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9bb86b46-02ed-4280-85f3-d03f889c35ed tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.154733 Nov 02 23:29:18.687876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1893/2468] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:18 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:19.704184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c94595cf-1cf6-4fa2-9a54-fdf0e666384f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:19.704798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c94595cf-1cf6-4fa2-9a54-fdf0e666384f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:19.711028 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c94595cf-1cf6-4fa2-9a54-fdf0e666384f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:19.711552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c94595cf-1cf6-4fa2-9a54-fdf0e666384f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:19.712436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c94595cf-1cf6-4fa2-9a54-fdf0e666384f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:19.712905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c94595cf-1cf6-4fa2-9a54-fdf0e666384f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:19.839872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c94595cf-1cf6-4fa2-9a54-fdf0e666384f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:19.848350 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c94595cf-1cf6-4fa2-9a54-fdf0e666384f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.147871 Nov 02 23:29:19.848927 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1894/2469] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:19 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:20.864431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6ac0b0eb-66c9-4ae2-8c26-f9e3b055e1dc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:20.865079 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6ac0b0eb-66c9-4ae2-8c26-f9e3b055e1dc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:20.871251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ac0b0eb-66c9-4ae2-8c26-f9e3b055e1dc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:20.871700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ac0b0eb-66c9-4ae2-8c26-f9e3b055e1dc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:20.872463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ac0b0eb-66c9-4ae2-8c26-f9e3b055e1dc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:20.872892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ac0b0eb-66c9-4ae2-8c26-f9e3b055e1dc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:21.004705 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6ac0b0eb-66c9-4ae2-8c26-f9e3b055e1dc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:21.012452 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6ac0b0eb-66c9-4ae2-8c26-f9e3b055e1dc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.151659 Nov 02 23:29:21.013018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1895/2470] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:20 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:22.029156 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-894eb817-08e2-41aa-918b-b07513f9045a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:22.029781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-894eb817-08e2-41aa-918b-b07513f9045a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:22.036316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-894eb817-08e2-41aa-918b-b07513f9045a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:22.036762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-894eb817-08e2-41aa-918b-b07513f9045a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:22.037523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-894eb817-08e2-41aa-918b-b07513f9045a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:22.037955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-894eb817-08e2-41aa-918b-b07513f9045a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:22.164345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-894eb817-08e2-41aa-918b-b07513f9045a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:22.172028 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-894eb817-08e2-41aa-918b-b07513f9045a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.146698 Nov 02 23:29:22.172596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1896/2471] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:22 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:29:23.189285 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-795b82a7-ddd0-40c1-a64e-37f168de22d0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:23.190778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-795b82a7-ddd0-40c1-a64e-37f168de22d0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:23.196904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-795b82a7-ddd0-40c1-a64e-37f168de22d0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:23.197345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-795b82a7-ddd0-40c1-a64e-37f168de22d0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:23.198100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-795b82a7-ddd0-40c1-a64e-37f168de22d0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:23.198527 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-795b82a7-ddd0-40c1-a64e-37f168de22d0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:23.326237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-795b82a7-ddd0-40c1-a64e-37f168de22d0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:23.333894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-795b82a7-ddd0-40c1-a64e-37f168de22d0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.148240 Nov 02 23:29:23.334460 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1897/2472] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:23 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:24.350587 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2d90eda7-0454-401e-9318-17f2ec049936 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:24.351289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2d90eda7-0454-401e-9318-17f2ec049936 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:24.357659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d90eda7-0454-401e-9318-17f2ec049936 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:24.358098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d90eda7-0454-401e-9318-17f2ec049936 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:24.358864 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d90eda7-0454-401e-9318-17f2ec049936 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:24.359318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d90eda7-0454-401e-9318-17f2ec049936 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:24.491655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2d90eda7-0454-401e-9318-17f2ec049936 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:24.499389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2d90eda7-0454-401e-9318-17f2ec049936 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.152433 Nov 02 23:29:24.499950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1898/2473] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:24 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:29:25.516846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-abe06883-c3c3-4432-b0f1-fe7e0fced996 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:25.517613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-abe06883-c3c3-4432-b0f1-fe7e0fced996 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:25.524939 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-abe06883-c3c3-4432-b0f1-fe7e0fced996 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:25.525421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-abe06883-c3c3-4432-b0f1-fe7e0fced996 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:25.526207 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-abe06883-c3c3-4432-b0f1-fe7e0fced996 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:25.526640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-abe06883-c3c3-4432-b0f1-fe7e0fced996 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:25.675426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-abe06883-c3c3-4432-b0f1-fe7e0fced996 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:25.684240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-abe06883-c3c3-4432-b0f1-fe7e0fced996 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.171060 Nov 02 23:29:25.685045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1899/2474] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:25 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:26.701402 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c667c718-27a6-4d17-a9a1-33b4dcfc2619 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:26.702526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c667c718-27a6-4d17-a9a1-33b4dcfc2619 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:26.709254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c667c718-27a6-4d17-a9a1-33b4dcfc2619 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:26.709702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c667c718-27a6-4d17-a9a1-33b4dcfc2619 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:26.710486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c667c718-27a6-4d17-a9a1-33b4dcfc2619 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:26.710947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c667c718-27a6-4d17-a9a1-33b4dcfc2619 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:26.863654 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c667c718-27a6-4d17-a9a1-33b4dcfc2619 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:26.872272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c667c718-27a6-4d17-a9a1-33b4dcfc2619 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.174505 Nov 02 23:29:26.872857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1900/2475] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:26 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:27.889328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ba6d6ab4-c7d3-4ac6-ac17-9c9558c034cc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:27.890112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ba6d6ab4-c7d3-4ac6-ac17-9c9558c034cc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:27.896580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ba6d6ab4-c7d3-4ac6-ac17-9c9558c034cc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:27.897022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ba6d6ab4-c7d3-4ac6-ac17-9c9558c034cc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:27.897804 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ba6d6ab4-c7d3-4ac6-ac17-9c9558c034cc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:27.898230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ba6d6ab4-c7d3-4ac6-ac17-9c9558c034cc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:28.036352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ba6d6ab4-c7d3-4ac6-ac17-9c9558c034cc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:28.044298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ba6d6ab4-c7d3-4ac6-ac17-9c9558c034cc tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.158708 Nov 02 23:29:28.044875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1901/2476] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:27 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:29.061336 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bdb0745e-f783-4ccb-ab87-1e3f67003bd8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:29.061964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bdb0745e-f783-4ccb-ab87-1e3f67003bd8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:29.068772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bdb0745e-f783-4ccb-ab87-1e3f67003bd8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:29.069211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bdb0745e-f783-4ccb-ab87-1e3f67003bd8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:29.069959 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bdb0745e-f783-4ccb-ab87-1e3f67003bd8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:29.070385 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bdb0745e-f783-4ccb-ab87-1e3f67003bd8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:29.202950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bdb0745e-f783-4ccb-ab87-1e3f67003bd8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:29.211492 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bdb0745e-f783-4ccb-ab87-1e3f67003bd8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.153811 Nov 02 23:29:29.212071 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1902/2477] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:29 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:30.228409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e2ca4da9-d143-4c27-bb38-eca48486f07e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:30.229081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e2ca4da9-d143-4c27-bb38-eca48486f07e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:30.235111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e2ca4da9-d143-4c27-bb38-eca48486f07e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:30.235557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e2ca4da9-d143-4c27-bb38-eca48486f07e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:30.236320 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e2ca4da9-d143-4c27-bb38-eca48486f07e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:30.236780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e2ca4da9-d143-4c27-bb38-eca48486f07e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:30.381216 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e2ca4da9-d143-4c27-bb38-eca48486f07e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:30.389773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e2ca4da9-d143-4c27-bb38-eca48486f07e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.165048 Nov 02 23:29:30.390447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1903/2478] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:30 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:31.407703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fe6d1519-1178-4d32-af8e-e6de246501a8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:31.408389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fe6d1519-1178-4d32-af8e-e6de246501a8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:31.415672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fe6d1519-1178-4d32-af8e-e6de246501a8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:31.415904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fe6d1519-1178-4d32-af8e-e6de246501a8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:31.416515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fe6d1519-1178-4d32-af8e-e6de246501a8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:31.416948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fe6d1519-1178-4d32-af8e-e6de246501a8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:31.586833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fe6d1519-1178-4d32-af8e-e6de246501a8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:31.596871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fe6d1519-1178-4d32-af8e-e6de246501a8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.192410 Nov 02 23:29:31.597477 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1904/2479] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:31 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:29:32.614864 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9acebf02-cd67-4e7a-bbcf-cba7129a7112 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:32.615607 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9acebf02-cd67-4e7a-bbcf-cba7129a7112 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:32.621522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9acebf02-cd67-4e7a-bbcf-cba7129a7112 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:32.621965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9acebf02-cd67-4e7a-bbcf-cba7129a7112 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:32.622738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9acebf02-cd67-4e7a-bbcf-cba7129a7112 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:32.623205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9acebf02-cd67-4e7a-bbcf-cba7129a7112 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:32.775513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9acebf02-cd67-4e7a-bbcf-cba7129a7112 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:32.784778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9acebf02-cd67-4e7a-bbcf-cba7129a7112 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.174256 Nov 02 23:29:32.785371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1905/2480] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:32 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:33.803549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6f206281-0412-4919-a4b9-1ce3d950f0c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:33.804427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6f206281-0412-4919-a4b9-1ce3d950f0c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:33.810840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f206281-0412-4919-a4b9-1ce3d950f0c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:33.811324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f206281-0412-4919-a4b9-1ce3d950f0c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:33.812108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f206281-0412-4919-a4b9-1ce3d950f0c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:33.812537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f206281-0412-4919-a4b9-1ce3d950f0c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:33.952267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6f206281-0412-4919-a4b9-1ce3d950f0c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:33.961433 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6f206281-0412-4919-a4b9-1ce3d950f0c6 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.162257 Nov 02 23:29:33.962058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1906/2481] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:33 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:34.980171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d1823391-b3b7-4e59-91ae-72341c06a97a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:34.980893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d1823391-b3b7-4e59-91ae-72341c06a97a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:34.987491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d1823391-b3b7-4e59-91ae-72341c06a97a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:34.987935 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d1823391-b3b7-4e59-91ae-72341c06a97a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:34.988706 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d1823391-b3b7-4e59-91ae-72341c06a97a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:34.989134 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d1823391-b3b7-4e59-91ae-72341c06a97a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:35.146034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d1823391-b3b7-4e59-91ae-72341c06a97a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:35.154087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d1823391-b3b7-4e59-91ae-72341c06a97a tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.177693 Nov 02 23:29:35.154708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1907/2482] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:34 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:36.172331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-33cdc47f-6de9-453f-b3d8-eeb12e2bdcf1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:36.173274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-33cdc47f-6de9-453f-b3d8-eeb12e2bdcf1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:36.180041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-33cdc47f-6de9-453f-b3d8-eeb12e2bdcf1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:36.180479 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-33cdc47f-6de9-453f-b3d8-eeb12e2bdcf1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:36.181304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-33cdc47f-6de9-453f-b3d8-eeb12e2bdcf1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:36.181735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-33cdc47f-6de9-453f-b3d8-eeb12e2bdcf1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:36.320718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-33cdc47f-6de9-453f-b3d8-eeb12e2bdcf1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:36.328846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-33cdc47f-6de9-453f-b3d8-eeb12e2bdcf1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.160246 Nov 02 23:29:36.329422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1908/2483] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:36 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:37.346365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f3a6c676-b0ee-4106-aed7-d94f334caf03 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:37.347521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f3a6c676-b0ee-4106-aed7-d94f334caf03 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:37.354394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3a6c676-b0ee-4106-aed7-d94f334caf03 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:37.354836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3a6c676-b0ee-4106-aed7-d94f334caf03 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:37.355630 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3a6c676-b0ee-4106-aed7-d94f334caf03 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:37.356056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3a6c676-b0ee-4106-aed7-d94f334caf03 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:37.495663 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f3a6c676-b0ee-4106-aed7-d94f334caf03 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:37.503689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f3a6c676-b0ee-4106-aed7-d94f334caf03 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.161567 Nov 02 23:29:37.504281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1909/2484] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:37 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:38.521304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d97736a6-9f25-4648-8a5c-ca87660d203e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:38.522138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d97736a6-9f25-4648-8a5c-ca87660d203e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:38.528933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d97736a6-9f25-4648-8a5c-ca87660d203e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:38.529379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d97736a6-9f25-4648-8a5c-ca87660d203e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:38.530161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d97736a6-9f25-4648-8a5c-ca87660d203e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:38.530589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d97736a6-9f25-4648-8a5c-ca87660d203e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:38.675523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d97736a6-9f25-4648-8a5c-ca87660d203e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:38.684491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d97736a6-9f25-4648-8a5c-ca87660d203e tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.166823 Nov 02 23:29:38.685092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1910/2485] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:38 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:39.701569 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b3d6b19f-90fa-4767-b166-71e604c022bd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:39.702277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b3d6b19f-90fa-4767-b166-71e604c022bd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:39.708450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3d6b19f-90fa-4767-b166-71e604c022bd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:39.708901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3d6b19f-90fa-4767-b166-71e604c022bd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:39.709664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3d6b19f-90fa-4767-b166-71e604c022bd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:39.710090 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3d6b19f-90fa-4767-b166-71e604c022bd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:39.851387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b3d6b19f-90fa-4767-b166-71e604c022bd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:39.863857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b3d6b19f-90fa-4767-b166-71e604c022bd tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.165922 Nov 02 23:29:39.864447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1911/2486] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:39 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:40.882112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d7cb4deb-6458-44a5-a44f-b9e1ce59fbdb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:40.882912 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d7cb4deb-6458-44a5-a44f-b9e1ce59fbdb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:40.889034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d7cb4deb-6458-44a5-a44f-b9e1ce59fbdb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:40.889482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d7cb4deb-6458-44a5-a44f-b9e1ce59fbdb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:40.890251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d7cb4deb-6458-44a5-a44f-b9e1ce59fbdb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:40.890670 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d7cb4deb-6458-44a5-a44f-b9e1ce59fbdb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:41.029409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d7cb4deb-6458-44a5-a44f-b9e1ce59fbdb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:41.038317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d7cb4deb-6458-44a5-a44f-b9e1ce59fbdb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.160233 Nov 02 23:29:41.038971 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1912/2487] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:40 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:42.056277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-daaf971b-adcf-4218-a418-d74c1f5d7c97 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:42.056989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-daaf971b-adcf-4218-a418-d74c1f5d7c97 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:42.063557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-daaf971b-adcf-4218-a418-d74c1f5d7c97 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:42.064006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-daaf971b-adcf-4218-a418-d74c1f5d7c97 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:42.065043 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-daaf971b-adcf-4218-a418-d74c1f5d7c97 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:42.065475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-daaf971b-adcf-4218-a418-d74c1f5d7c97 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:42.211899 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-daaf971b-adcf-4218-a418-d74c1f5d7c97 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:42.220050 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-daaf971b-adcf-4218-a418-d74c1f5d7c97 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.167844 Nov 02 23:29:42.220645 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1913/2488] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:42 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:29:43.239260 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-24eee608-23b1-4525-a51f-e2306406e6e1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:43.239899 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-24eee608-23b1-4525-a51f-e2306406e6e1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:43.246136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24eee608-23b1-4525-a51f-e2306406e6e1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:43.246586 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24eee608-23b1-4525-a51f-e2306406e6e1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:43.247416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24eee608-23b1-4525-a51f-e2306406e6e1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:43.247854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-24eee608-23b1-4525-a51f-e2306406e6e1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:43.408542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-24eee608-23b1-4525-a51f-e2306406e6e1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:43.417410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-24eee608-23b1-4525-a51f-e2306406e6e1 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.183248 Nov 02 23:29:43.418002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1914/2489] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:43 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:44.435662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-36baa6c8-2b07-4c56-b4c7-79c939736924 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:44.436278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-36baa6c8-2b07-4c56-b4c7-79c939736924 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:44.443273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-36baa6c8-2b07-4c56-b4c7-79c939736924 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:44.443731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-36baa6c8-2b07-4c56-b4c7-79c939736924 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:44.444515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-36baa6c8-2b07-4c56-b4c7-79c939736924 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:44.444955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-36baa6c8-2b07-4c56-b4c7-79c939736924 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:44.588975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-36baa6c8-2b07-4c56-b4c7-79c939736924 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:44.598035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-36baa6c8-2b07-4c56-b4c7-79c939736924 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.166021 Nov 02 23:29:44.598983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1915/2490] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:44 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:45.615278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-468cd35c-91cf-410e-90de-47bb651e7520 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:45.615981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-468cd35c-91cf-410e-90de-47bb651e7520 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:45.622424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-468cd35c-91cf-410e-90de-47bb651e7520 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:45.622871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-468cd35c-91cf-410e-90de-47bb651e7520 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:45.623685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-468cd35c-91cf-410e-90de-47bb651e7520 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:45.624126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-468cd35c-91cf-410e-90de-47bb651e7520 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:45.766136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-468cd35c-91cf-410e-90de-47bb651e7520 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:45.774574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-468cd35c-91cf-410e-90de-47bb651e7520 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.162965 Nov 02 23:29:45.775198 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1916/2491] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:45 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:46.222786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3e761a7a-95b9-4174-a6a8-72c36761ea20 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:46.223493 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3e761a7a-95b9-4174-a6a8-72c36761ea20 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:46.230067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e761a7a-95b9-4174-a6a8-72c36761ea20 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:46.230523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e761a7a-95b9-4174-a6a8-72c36761ea20 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:46.231383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e761a7a-95b9-4174-a6a8-72c36761ea20 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:46.231819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e761a7a-95b9-4174-a6a8-72c36761ea20 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:46.259789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3e761a7a-95b9-4174-a6a8-72c36761ea20 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Going to try to terminate instance {{(pid=115800) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 23:29:46.358159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3e761a7a-95b9-4174-a6a8-72c36761ea20 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "DELETE /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 204 len: 0 microversion: 2.1 time: 0.140260 Nov 02 23:29:46.358823 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1917/2492] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:29:46 2021] DELETE /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 23:29:46.368183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0642cdb0-07a0-4a05-89d9-afd71887fe6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:46.368885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0642cdb0-07a0-4a05-89d9-afd71887fe6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:46.375273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0642cdb0-07a0-4a05-89d9-afd71887fe6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:46.375873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0642cdb0-07a0-4a05-89d9-afd71887fe6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:46.377006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0642cdb0-07a0-4a05-89d9-afd71887fe6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:46.377440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0642cdb0-07a0-4a05-89d9-afd71887fe6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:46.520814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0642cdb0-07a0-4a05-89d9-afd71887fe6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:46.528862 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0642cdb0-07a0-4a05-89d9-afd71887fe6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1558 microversion: 2.1 time: 0.165585 Nov 02 23:29:46.529443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1918/2493] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:46 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:46.792773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-371535dd-6090-40a7-93e0-e2ba23f553af tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:46.793833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-371535dd-6090-40a7-93e0-e2ba23f553af tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:46.801265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-371535dd-6090-40a7-93e0-e2ba23f553af tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:46.801801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-371535dd-6090-40a7-93e0-e2ba23f553af tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:46.802709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-371535dd-6090-40a7-93e0-e2ba23f553af tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:46.803310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-371535dd-6090-40a7-93e0-e2ba23f553af tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:46.951364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-371535dd-6090-40a7-93e0-e2ba23f553af tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:46.960167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-371535dd-6090-40a7-93e0-e2ba23f553af tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.171959 Nov 02 23:29:46.960762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1919/2494] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:46 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:47.546013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-56dd9247-e5fc-4919-b713-d9b1764932c8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:47.546628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-56dd9247-e5fc-4919-b713-d9b1764932c8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:47.553680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56dd9247-e5fc-4919-b713-d9b1764932c8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:47.554131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56dd9247-e5fc-4919-b713-d9b1764932c8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:47.554974 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56dd9247-e5fc-4919-b713-d9b1764932c8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:47.555419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56dd9247-e5fc-4919-b713-d9b1764932c8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:47.710937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-56dd9247-e5fc-4919-b713-d9b1764932c8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:47.719356 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-56dd9247-e5fc-4919-b713-d9b1764932c8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1558 microversion: 2.1 time: 0.176916 Nov 02 23:29:47.719958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1920/2495] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:47 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:47.979081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b07fbba9-bdec-4198-b9bb-d03fc3f37287 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:47.980202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b07fbba9-bdec-4198-b9bb-d03fc3f37287 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:47.986556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b07fbba9-bdec-4198-b9bb-d03fc3f37287 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:47.987544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b07fbba9-bdec-4198-b9bb-d03fc3f37287 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:47.988393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b07fbba9-bdec-4198-b9bb-d03fc3f37287 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:47.988827 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b07fbba9-bdec-4198-b9bb-d03fc3f37287 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:48.148600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b07fbba9-bdec-4198-b9bb-d03fc3f37287 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:48.161202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b07fbba9-bdec-4198-b9bb-d03fc3f37287 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.185718 Nov 02 23:29:48.162019 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1921/2496] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:47 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:48.416937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-3a3816e9-295f-43c1-ba32-ac3edf7f9355 req-39dd9aa7-65fd-4d32-abbb-4ab1c8febb05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70df37d3-8cae-4366-a8c6-fc59e334cfd6", "name": "network-vif-deleted", "tag": "ca582222-cb8c-4686-856e-ca98f5fa2458"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:29:48.420529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:29:48.420529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:29:48.435144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-3a3816e9-295f-43c1-ba32-ac3edf7f9355 req-39dd9aa7-65fd-4d32-abbb-4ab1c8febb05 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:48.436358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-3a3816e9-295f-43c1-ba32-ac3edf7f9355 req-39dd9aa7-65fd-4d32-abbb-4ab1c8febb05 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:48.476306 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-3a3816e9-295f-43c1-ba32-ac3edf7f9355 req-39dd9aa7-65fd-4d32-abbb-4ab1c8febb05 service nova] Creating event network-vif-deleted:ca582222-cb8c-4686-856e-ca98f5fa2458 for instance 70df37d3-8cae-4366-a8c6-fc59e334cfd6 on hv-cinder-81584 Nov 02 23:29:48.485857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-3a3816e9-295f-43c1-ba32-ac3edf7f9355 req-39dd9aa7-65fd-4d32-abbb-4ab1c8febb05 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169260 Nov 02 23:29:48.486903 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1922/2497] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:29:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:29:48.738542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5c4e65c0-e570-4959-b2ac-831ce9f6bd98 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:48.739287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5c4e65c0-e570-4959-b2ac-831ce9f6bd98 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:48.745988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5c4e65c0-e570-4959-b2ac-831ce9f6bd98 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:48.746538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5c4e65c0-e570-4959-b2ac-831ce9f6bd98 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:48.747287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5c4e65c0-e570-4959-b2ac-831ce9f6bd98 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:48.747745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5c4e65c0-e570-4959-b2ac-831ce9f6bd98 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:48.822508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5c4e65c0-e570-4959-b2ac-831ce9f6bd98 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:48.830873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5c4e65c0-e570-4959-b2ac-831ce9f6bd98 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.096976 Nov 02 23:29:48.831509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1923/2498] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:48 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:49.181974 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cfb4bedb-4b51-4538-82c7-60e6c337e0b8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:49.182955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cfb4bedb-4b51-4538-82c7-60e6c337e0b8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:49.194200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cfb4bedb-4b51-4538-82c7-60e6c337e0b8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:49.194972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cfb4bedb-4b51-4538-82c7-60e6c337e0b8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:49.196250 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cfb4bedb-4b51-4538-82c7-60e6c337e0b8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:49.196995 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cfb4bedb-4b51-4538-82c7-60e6c337e0b8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:49.382101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cfb4bedb-4b51-4538-82c7-60e6c337e0b8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:49.390612 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cfb4bedb-4b51-4538-82c7-60e6c337e0b8 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.214938 Nov 02 23:29:49.391258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1924/2499] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:49 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:49.848478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d449dc18-7b0f-4470-a00c-923fd7ea4d2c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:49.849119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d449dc18-7b0f-4470-a00c-923fd7ea4d2c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:49.855363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d449dc18-7b0f-4470-a00c-923fd7ea4d2c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:49.855805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d449dc18-7b0f-4470-a00c-923fd7ea4d2c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:49.856594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d449dc18-7b0f-4470-a00c-923fd7ea4d2c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:49.857026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d449dc18-7b0f-4470-a00c-923fd7ea4d2c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:49.922010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d449dc18-7b0f-4470-a00c-923fd7ea4d2c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:49.931272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d449dc18-7b0f-4470-a00c-923fd7ea4d2c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.086907 Nov 02 23:29:49.931872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1925/2500] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:49 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:50.411719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-55cba65b-7641-4b61-b91b-22488731fdcb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:50.412596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-55cba65b-7641-4b61-b91b-22488731fdcb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:50.419767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55cba65b-7641-4b61-b91b-22488731fdcb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:50.420289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55cba65b-7641-4b61-b91b-22488731fdcb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:50.421242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55cba65b-7641-4b61-b91b-22488731fdcb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:50.421753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55cba65b-7641-4b61-b91b-22488731fdcb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:50.597093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-55cba65b-7641-4b61-b91b-22488731fdcb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:50.605609 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-55cba65b-7641-4b61-b91b-22488731fdcb tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.200021 Nov 02 23:29:50.606283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1926/2501] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:50 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:50.948784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6750c981-33df-4910-8fff-47889b0d809c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:50.949396 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6750c981-33df-4910-8fff-47889b0d809c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:50.955647 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6750c981-33df-4910-8fff-47889b0d809c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:50.956577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6750c981-33df-4910-8fff-47889b0d809c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:50.957364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6750c981-33df-4910-8fff-47889b0d809c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:50.957783 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6750c981-33df-4910-8fff-47889b0d809c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:51.026816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6750c981-33df-4910-8fff-47889b0d809c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:51.035798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6750c981-33df-4910-8fff-47889b0d809c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.090770 Nov 02 23:29:51.036440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1927/2502] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:50 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:51.624064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-38ac486b-e197-4003-8216-1e4ba6641793 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:51.624784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-38ac486b-e197-4003-8216-1e4ba6641793 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:51.632606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-38ac486b-e197-4003-8216-1e4ba6641793 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:51.633107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-38ac486b-e197-4003-8216-1e4ba6641793 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:51.633966 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-38ac486b-e197-4003-8216-1e4ba6641793 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:51.634448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-38ac486b-e197-4003-8216-1e4ba6641793 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:51.948180 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-38ac486b-e197-4003-8216-1e4ba6641793 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:51.956992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-38ac486b-e197-4003-8216-1e4ba6641793 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.336745 Nov 02 23:29:51.957751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1928/2503] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:51 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:52.053104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2080130d-52cb-4c4b-9639-cad623da11f8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:52.053765 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2080130d-52cb-4c4b-9639-cad623da11f8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:52.060206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2080130d-52cb-4c4b-9639-cad623da11f8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:52.060646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2080130d-52cb-4c4b-9639-cad623da11f8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:52.061426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2080130d-52cb-4c4b-9639-cad623da11f8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:52.061851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2080130d-52cb-4c4b-9639-cad623da11f8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:52.125517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2080130d-52cb-4c4b-9639-cad623da11f8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:52.133959 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2080130d-52cb-4c4b-9639-cad623da11f8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.085027 Nov 02 23:29:52.134742 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1929/2504] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:52 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:52.978541 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2998499d-b796-448b-a391-178ac98291ac tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:52.979666 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2998499d-b796-448b-a391-178ac98291ac tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:52.991263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2998499d-b796-448b-a391-178ac98291ac tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:52.992052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2998499d-b796-448b-a391-178ac98291ac tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:52.993463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2998499d-b796-448b-a391-178ac98291ac tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:52.994210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2998499d-b796-448b-a391-178ac98291ac tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:53.167125 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2998499d-b796-448b-a391-178ac98291ac tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:53.176764 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2998499d-b796-448b-a391-178ac98291ac tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.205044 Nov 02 23:29:53.177508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1930/2505] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:52 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:53.183276 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-787b27d9-27b1-462d-8f44-eb420a0c26b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:53.183884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-787b27d9-27b1-462d-8f44-eb420a0c26b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:53.194436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-787b27d9-27b1-462d-8f44-eb420a0c26b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:53.195265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-787b27d9-27b1-462d-8f44-eb420a0c26b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:53.196707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-787b27d9-27b1-462d-8f44-eb420a0c26b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:53.197471 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-787b27d9-27b1-462d-8f44-eb420a0c26b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:53.285861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-787b27d9-27b1-462d-8f44-eb420a0c26b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:53.294703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-787b27d9-27b1-462d-8f44-eb420a0c26b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.115866 Nov 02 23:29:53.295374 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1931/2506] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:53 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:29:54.195720 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f04718fc-6d3f-4cae-bcb9-0c506ad6aa7f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:54.196561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f04718fc-6d3f-4cae-bcb9-0c506ad6aa7f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:54.203044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f04718fc-6d3f-4cae-bcb9-0c506ad6aa7f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:54.203508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f04718fc-6d3f-4cae-bcb9-0c506ad6aa7f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:54.204336 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f04718fc-6d3f-4cae-bcb9-0c506ad6aa7f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:54.204756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f04718fc-6d3f-4cae-bcb9-0c506ad6aa7f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:54.360973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f04718fc-6d3f-4cae-bcb9-0c506ad6aa7f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:54.370033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f04718fc-6d3f-4cae-bcb9-0c506ad6aa7f tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.177896 Nov 02 23:29:54.370692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1932/2507] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:54 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:54.376208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c6909d6a-eedd-4799-9a41-28ad3dfdceb8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:54.376965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c6909d6a-eedd-4799-9a41-28ad3dfdceb8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:54.384284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6909d6a-eedd-4799-9a41-28ad3dfdceb8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:54.385476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6909d6a-eedd-4799-9a41-28ad3dfdceb8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:54.386444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6909d6a-eedd-4799-9a41-28ad3dfdceb8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:54.386944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6909d6a-eedd-4799-9a41-28ad3dfdceb8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:54.452033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c6909d6a-eedd-4799-9a41-28ad3dfdceb8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:54.460520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c6909d6a-eedd-4799-9a41-28ad3dfdceb8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.088453 Nov 02 23:29:54.461116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1933/2508] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:54 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:29:55.389497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1658e81b-9b73-4c18-bbc6-458cf2393d33 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:55.390200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1658e81b-9b73-4c18-bbc6-458cf2393d33 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:55.397376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1658e81b-9b73-4c18-bbc6-458cf2393d33 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:55.397822 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1658e81b-9b73-4c18-bbc6-458cf2393d33 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:55.398628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1658e81b-9b73-4c18-bbc6-458cf2393d33 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:55.399110 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1658e81b-9b73-4c18-bbc6-458cf2393d33 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:55.565280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1658e81b-9b73-4c18-bbc6-458cf2393d33 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:55.577409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1658e81b-9b73-4c18-bbc6-458cf2393d33 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.191961 Nov 02 23:29:55.578471 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1934/2509] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:55 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:55.587359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f6cb4d74-21cc-4936-b9bb-2af9e4942b43 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:55.588425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f6cb4d74-21cc-4936-b9bb-2af9e4942b43 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:55.599214 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f6cb4d74-21cc-4936-b9bb-2af9e4942b43 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:55.599904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f6cb4d74-21cc-4936-b9bb-2af9e4942b43 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:55.601166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f6cb4d74-21cc-4936-b9bb-2af9e4942b43 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:55.601913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f6cb4d74-21cc-4936-b9bb-2af9e4942b43 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:55.686398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f6cb4d74-21cc-4936-b9bb-2af9e4942b43 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:55.695782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f6cb4d74-21cc-4936-b9bb-2af9e4942b43 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.115627 Nov 02 23:29:55.696498 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1935/2510] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:55 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:29:56.595619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-022ba51d-29cf-416d-b3c9-d014eafcd37c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:56.597008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-022ba51d-29cf-416d-b3c9-d014eafcd37c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:56.603612 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-022ba51d-29cf-416d-b3c9-d014eafcd37c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:56.604060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-022ba51d-29cf-416d-b3c9-d014eafcd37c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:56.604858 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-022ba51d-29cf-416d-b3c9-d014eafcd37c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:56.605295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-022ba51d-29cf-416d-b3c9-d014eafcd37c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:56.755366 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-022ba51d-29cf-416d-b3c9-d014eafcd37c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:56.763851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-022ba51d-29cf-416d-b3c9-d014eafcd37c tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.171894 Nov 02 23:29:56.764548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1936/2511] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:56 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:56.769210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c56c71f6-b24a-4eea-b78d-c2239969453b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:56.769811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c56c71f6-b24a-4eea-b78d-c2239969453b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:56.779284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c56c71f6-b24a-4eea-b78d-c2239969453b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:56.780072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c56c71f6-b24a-4eea-b78d-c2239969453b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:56.781511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c56c71f6-b24a-4eea-b78d-c2239969453b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:56.782296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c56c71f6-b24a-4eea-b78d-c2239969453b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:56.849591 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c56c71f6-b24a-4eea-b78d-c2239969453b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:56.858107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c56c71f6-b24a-4eea-b78d-c2239969453b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.092474 Nov 02 23:29:56.858838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1937/2512] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:56 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:29:57.781045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-553302a6-470c-4afa-a855-65dc626ccca0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:57.781819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-553302a6-470c-4afa-a855-65dc626ccca0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] [instance: 21eb9b39-67de-489a-aa38-4f0b94947a68] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:57.788275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-553302a6-470c-4afa-a855-65dc626ccca0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:57.788727 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-553302a6-470c-4afa-a855-65dc626ccca0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:57.789558 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-553302a6-470c-4afa-a855-65dc626ccca0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:57.789997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-553302a6-470c-4afa-a855-65dc626ccca0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:57.938907 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-553302a6-470c-4afa-a855-65dc626ccca0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b767694343c4a488f2ba0c19b62947e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02de7621570a42e28e06ce65bd3b3000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:57.948399 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-553302a6-470c-4afa-a855-65dc626ccca0 tempest-VolumesSnapshotTestJSON-1134351355 tempest-VolumesSnapshotTestJSON-1134351355-project] 10.222.0.41 "GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68" status: 200 len: 1560 microversion: 2.1 time: 0.171114 Nov 02 23:29:57.948991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1938/2513] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:57 2021] GET /compute/v2.1/servers/21eb9b39-67de-489a-aa38-4f0b94947a68 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:29:57.953649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-150384f9-374c-443e-9189-5cb1a91c94c5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:57.954327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-150384f9-374c-443e-9189-5cb1a91c94c5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:57.961942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-150384f9-374c-443e-9189-5cb1a91c94c5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:57.962476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-150384f9-374c-443e-9189-5cb1a91c94c5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:57.963692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-150384f9-374c-443e-9189-5cb1a91c94c5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:57.964284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-150384f9-374c-443e-9189-5cb1a91c94c5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:58.063963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-150384f9-374c-443e-9189-5cb1a91c94c5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:58.078254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-150384f9-374c-443e-9189-5cb1a91c94c5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.127862 Nov 02 23:29:58.079304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1939/2514] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:57 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:29:59.101490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d37791eb-52cf-45fb-b999-7321a4f6450b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:29:59.102212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d37791eb-52cf-45fb-b999-7321a4f6450b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:29:59.109294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d37791eb-52cf-45fb-b999-7321a4f6450b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:59.109740 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d37791eb-52cf-45fb-b999-7321a4f6450b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:59.110529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d37791eb-52cf-45fb-b999-7321a4f6450b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:29:59.110984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d37791eb-52cf-45fb-b999-7321a4f6450b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:29:59.177836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d37791eb-52cf-45fb-b999-7321a4f6450b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:29:59.186309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d37791eb-52cf-45fb-b999-7321a4f6450b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.088679 Nov 02 23:29:59.186940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1940/2515] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:29:59 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:00.203785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-77cbe462-2a78-407b-9359-4dd9eb5603e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:00.204689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-77cbe462-2a78-407b-9359-4dd9eb5603e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:00.210789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-77cbe462-2a78-407b-9359-4dd9eb5603e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:00.211266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-77cbe462-2a78-407b-9359-4dd9eb5603e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:00.212039 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-77cbe462-2a78-407b-9359-4dd9eb5603e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:00.212465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-77cbe462-2a78-407b-9359-4dd9eb5603e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:00.276447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-77cbe462-2a78-407b-9359-4dd9eb5603e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:00.285737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-77cbe462-2a78-407b-9359-4dd9eb5603e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.085620 Nov 02 23:30:00.286315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1941/2516] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:00 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:01.302951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8873cf3f-d244-4319-868a-28aa97bbc314 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:01.303649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8873cf3f-d244-4319-868a-28aa97bbc314 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:01.310108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8873cf3f-d244-4319-868a-28aa97bbc314 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:01.310560 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8873cf3f-d244-4319-868a-28aa97bbc314 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:01.311392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8873cf3f-d244-4319-868a-28aa97bbc314 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:01.311827 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8873cf3f-d244-4319-868a-28aa97bbc314 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:01.374045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8873cf3f-d244-4319-868a-28aa97bbc314 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:01.382756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8873cf3f-d244-4319-868a-28aa97bbc314 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.083440 Nov 02 23:30:01.383372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1942/2517] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:01 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:02.399681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b9be5377-3453-49eb-b9d2-1ce09d9b4df5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:02.400395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b9be5377-3453-49eb-b9d2-1ce09d9b4df5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:02.406717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9be5377-3453-49eb-b9d2-1ce09d9b4df5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:02.407204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9be5377-3453-49eb-b9d2-1ce09d9b4df5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:02.407984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9be5377-3453-49eb-b9d2-1ce09d9b4df5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:02.408419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9be5377-3453-49eb-b9d2-1ce09d9b4df5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:02.472800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b9be5377-3453-49eb-b9d2-1ce09d9b4df5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:02.480646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b9be5377-3453-49eb-b9d2-1ce09d9b4df5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.084641 Nov 02 23:30:02.481217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1943/2518] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:02 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:03.497402 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5391c3b3-b05d-4c0f-93c4-5f6214caf600 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:03.498117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5391c3b3-b05d-4c0f-93c4-5f6214caf600 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:03.504805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5391c3b3-b05d-4c0f-93c4-5f6214caf600 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:03.505272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5391c3b3-b05d-4c0f-93c4-5f6214caf600 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:03.506076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5391c3b3-b05d-4c0f-93c4-5f6214caf600 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:03.506507 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5391c3b3-b05d-4c0f-93c4-5f6214caf600 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:03.572537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5391c3b3-b05d-4c0f-93c4-5f6214caf600 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:03.580859 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5391c3b3-b05d-4c0f-93c4-5f6214caf600 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.087016 Nov 02 23:30:03.581437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1944/2519] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:03 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:04.598054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-92a68cbe-e392-4968-a74d-56420faa7289 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:04.598750 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-92a68cbe-e392-4968-a74d-56420faa7289 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:04.604843 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92a68cbe-e392-4968-a74d-56420faa7289 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:04.605291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92a68cbe-e392-4968-a74d-56420faa7289 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:04.606055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92a68cbe-e392-4968-a74d-56420faa7289 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:04.606486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-92a68cbe-e392-4968-a74d-56420faa7289 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:04.664909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-92a68cbe-e392-4968-a74d-56420faa7289 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:04.672547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-92a68cbe-e392-4968-a74d-56420faa7289 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078137 Nov 02 23:30:04.673104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1945/2520] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:04 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:05.690072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-da42e7f6-ebce-4924-9a9a-d86d947148b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:05.691346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-da42e7f6-ebce-4924-9a9a-d86d947148b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:05.697485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-da42e7f6-ebce-4924-9a9a-d86d947148b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:05.697929 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-da42e7f6-ebce-4924-9a9a-d86d947148b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:05.698695 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-da42e7f6-ebce-4924-9a9a-d86d947148b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:05.699169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-da42e7f6-ebce-4924-9a9a-d86d947148b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:05.761495 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-da42e7f6-ebce-4924-9a9a-d86d947148b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:05.770360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-da42e7f6-ebce-4924-9a9a-d86d947148b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.084237 Nov 02 23:30:05.770962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1946/2521] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:05 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:06.787783 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fadc4855-6bc9-488c-9b3c-95690d2b8573 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:06.788517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fadc4855-6bc9-488c-9b3c-95690d2b8573 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:06.795190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fadc4855-6bc9-488c-9b3c-95690d2b8573 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:06.795640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fadc4855-6bc9-488c-9b3c-95690d2b8573 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:06.796416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fadc4855-6bc9-488c-9b3c-95690d2b8573 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:06.796847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fadc4855-6bc9-488c-9b3c-95690d2b8573 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:06.860590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fadc4855-6bc9-488c-9b3c-95690d2b8573 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:06.868821 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fadc4855-6bc9-488c-9b3c-95690d2b8573 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.085354 Nov 02 23:30:06.869388 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1947/2522] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:06 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:07.887574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7e8d8d09-88c6-4024-8eff-7dbc78290d0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:07.888218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7e8d8d09-88c6-4024-8eff-7dbc78290d0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:07.894802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7e8d8d09-88c6-4024-8eff-7dbc78290d0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:07.895355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7e8d8d09-88c6-4024-8eff-7dbc78290d0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:07.896130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7e8d8d09-88c6-4024-8eff-7dbc78290d0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:07.896559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7e8d8d09-88c6-4024-8eff-7dbc78290d0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:07.964236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7e8d8d09-88c6-4024-8eff-7dbc78290d0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:07.973718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7e8d8d09-88c6-4024-8eff-7dbc78290d0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.089900 Nov 02 23:30:07.974264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1948/2523] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:07 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:08.991017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6a4aaf89-104a-4ed8-9ea4-eb11b1856332 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:08.991727 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6a4aaf89-104a-4ed8-9ea4-eb11b1856332 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:08.997963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a4aaf89-104a-4ed8-9ea4-eb11b1856332 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:08.998404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a4aaf89-104a-4ed8-9ea4-eb11b1856332 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:08.999206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a4aaf89-104a-4ed8-9ea4-eb11b1856332 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:08.999642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a4aaf89-104a-4ed8-9ea4-eb11b1856332 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:09.061197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6a4aaf89-104a-4ed8-9ea4-eb11b1856332 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:09.069861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6a4aaf89-104a-4ed8-9ea4-eb11b1856332 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.083066 Nov 02 23:30:09.070422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1949/2524] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:08 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:10.087245 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d8df551e-28c6-4133-aa8c-fcff832ca2ab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:10.087987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d8df551e-28c6-4133-aa8c-fcff832ca2ab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:10.094496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8df551e-28c6-4133-aa8c-fcff832ca2ab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:10.094982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8df551e-28c6-4133-aa8c-fcff832ca2ab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:10.095784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8df551e-28c6-4133-aa8c-fcff832ca2ab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:10.096251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8df551e-28c6-4133-aa8c-fcff832ca2ab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:10.160163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d8df551e-28c6-4133-aa8c-fcff832ca2ab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:10.168409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d8df551e-28c6-4133-aa8c-fcff832ca2ab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.084811 Nov 02 23:30:10.169060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1950/2525] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:10 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:11.185104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9285fa31-e90c-437a-a8ee-af9655d28c35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:11.185805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9285fa31-e90c-437a-a8ee-af9655d28c35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:11.192817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9285fa31-e90c-437a-a8ee-af9655d28c35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:11.193256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9285fa31-e90c-437a-a8ee-af9655d28c35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:11.194028 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9285fa31-e90c-437a-a8ee-af9655d28c35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:11.194457 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9285fa31-e90c-437a-a8ee-af9655d28c35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:11.257416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9285fa31-e90c-437a-a8ee-af9655d28c35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:11.265434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9285fa31-e90c-437a-a8ee-af9655d28c35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.084191 Nov 02 23:30:11.265999 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1951/2526] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:11 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:12.282615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-09d318ca-5333-4286-b66d-e2e39a1403da tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:12.283327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-09d318ca-5333-4286-b66d-e2e39a1403da tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:12.290244 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-09d318ca-5333-4286-b66d-e2e39a1403da tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:12.290689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-09d318ca-5333-4286-b66d-e2e39a1403da tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:12.291513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-09d318ca-5333-4286-b66d-e2e39a1403da tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:12.291947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-09d318ca-5333-4286-b66d-e2e39a1403da tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:12.353755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-09d318ca-5333-4286-b66d-e2e39a1403da tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:12.361530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-09d318ca-5333-4286-b66d-e2e39a1403da tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082690 Nov 02 23:30:12.362094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1952/2527] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:12 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:13.379296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e4bc63d7-c66a-469a-90a4-8d0ec1d6f774 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:13.379950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e4bc63d7-c66a-469a-90a4-8d0ec1d6f774 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:13.387277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4bc63d7-c66a-469a-90a4-8d0ec1d6f774 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:13.387717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4bc63d7-c66a-469a-90a4-8d0ec1d6f774 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:13.388484 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4bc63d7-c66a-469a-90a4-8d0ec1d6f774 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:13.388904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4bc63d7-c66a-469a-90a4-8d0ec1d6f774 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:13.456641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e4bc63d7-c66a-469a-90a4-8d0ec1d6f774 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:13.464845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e4bc63d7-c66a-469a-90a4-8d0ec1d6f774 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.089331 Nov 02 23:30:13.465595 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1953/2528] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:13 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:14.483153 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3fefd652-b75a-44a9-825d-f31e9b2fdc2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:14.483963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3fefd652-b75a-44a9-825d-f31e9b2fdc2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:14.490187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fefd652-b75a-44a9-825d-f31e9b2fdc2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:14.491235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fefd652-b75a-44a9-825d-f31e9b2fdc2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:14.492068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fefd652-b75a-44a9-825d-f31e9b2fdc2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:14.492505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fefd652-b75a-44a9-825d-f31e9b2fdc2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:14.553661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3fefd652-b75a-44a9-825d-f31e9b2fdc2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:14.562270 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3fefd652-b75a-44a9-825d-f31e9b2fdc2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082725 Nov 02 23:30:14.562970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1954/2529] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:14 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:15.579718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ab583fc4-c588-4d6e-a4fe-d48dd4199606 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:15.580420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ab583fc4-c588-4d6e-a4fe-d48dd4199606 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:15.586908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ab583fc4-c588-4d6e-a4fe-d48dd4199606 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:15.587446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ab583fc4-c588-4d6e-a4fe-d48dd4199606 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:15.588211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ab583fc4-c588-4d6e-a4fe-d48dd4199606 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:15.588641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ab583fc4-c588-4d6e-a4fe-d48dd4199606 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:15.651030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ab583fc4-c588-4d6e-a4fe-d48dd4199606 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:15.659204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ab583fc4-c588-4d6e-a4fe-d48dd4199606 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.083064 Nov 02 23:30:15.659787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1955/2530] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:15 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:16.676057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-eb4746b5-d940-4834-bc59-b2482c4a00f2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:16.676779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-eb4746b5-d940-4834-bc59-b2482c4a00f2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:16.684207 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb4746b5-d940-4834-bc59-b2482c4a00f2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:16.684647 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb4746b5-d940-4834-bc59-b2482c4a00f2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:16.685414 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb4746b5-d940-4834-bc59-b2482c4a00f2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:16.685838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb4746b5-d940-4834-bc59-b2482c4a00f2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:16.748848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-eb4746b5-d940-4834-bc59-b2482c4a00f2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:16.756987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-eb4746b5-d940-4834-bc59-b2482c4a00f2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.084622 Nov 02 23:30:16.757558 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1956/2531] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:16 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:17.774192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d71463ae-28a1-497a-885f-e59516def0cc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:17.774961 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d71463ae-28a1-497a-885f-e59516def0cc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:17.781297 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d71463ae-28a1-497a-885f-e59516def0cc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:17.781737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d71463ae-28a1-497a-885f-e59516def0cc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:17.782519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d71463ae-28a1-497a-885f-e59516def0cc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:17.782975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d71463ae-28a1-497a-885f-e59516def0cc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:17.845548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d71463ae-28a1-497a-885f-e59516def0cc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:17.854231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d71463ae-28a1-497a-885f-e59516def0cc tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.084256 Nov 02 23:30:17.854824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1957/2532] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:17 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:18.871311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7ef30697-20e8-45ea-b40d-4f027b0d8484 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:18.872074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7ef30697-20e8-45ea-b40d-4f027b0d8484 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:18.878448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ef30697-20e8-45ea-b40d-4f027b0d8484 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:18.879180 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ef30697-20e8-45ea-b40d-4f027b0d8484 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:18.879982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ef30697-20e8-45ea-b40d-4f027b0d8484 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:18.880414 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ef30697-20e8-45ea-b40d-4f027b0d8484 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:18.942091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7ef30697-20e8-45ea-b40d-4f027b0d8484 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:18.956122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7ef30697-20e8-45ea-b40d-4f027b0d8484 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.088143 Nov 02 23:30:18.957108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1958/2533] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:18 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:19.975102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7dc068c3-af24-472c-a246-da522b0a9661 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:19.975792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7dc068c3-af24-472c-a246-da522b0a9661 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:19.982232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7dc068c3-af24-472c-a246-da522b0a9661 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:19.982677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7dc068c3-af24-472c-a246-da522b0a9661 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:19.983474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7dc068c3-af24-472c-a246-da522b0a9661 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:19.983906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7dc068c3-af24-472c-a246-da522b0a9661 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:20.048292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7dc068c3-af24-472c-a246-da522b0a9661 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:20.057710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7dc068c3-af24-472c-a246-da522b0a9661 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.086259 Nov 02 23:30:20.058314 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1959/2534] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:19 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:21.074924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0e0b6d3e-972d-400c-a917-68c04aa78037 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:21.075628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0e0b6d3e-972d-400c-a917-68c04aa78037 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:21.081781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e0b6d3e-972d-400c-a917-68c04aa78037 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:21.082226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e0b6d3e-972d-400c-a917-68c04aa78037 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:21.083010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e0b6d3e-972d-400c-a917-68c04aa78037 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:21.083444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e0b6d3e-972d-400c-a917-68c04aa78037 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:21.141930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0e0b6d3e-972d-400c-a917-68c04aa78037 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:21.150469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0e0b6d3e-972d-400c-a917-68c04aa78037 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.079453 Nov 02 23:30:21.151054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1960/2535] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:21 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:22.167616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fef111d5-735b-472f-8548-b80654820e60 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:22.168392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fef111d5-735b-472f-8548-b80654820e60 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:22.175068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fef111d5-735b-472f-8548-b80654820e60 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:22.175517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fef111d5-735b-472f-8548-b80654820e60 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:22.176302 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fef111d5-735b-472f-8548-b80654820e60 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:22.176732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fef111d5-735b-472f-8548-b80654820e60 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:22.244466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fef111d5-735b-472f-8548-b80654820e60 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:22.252931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fef111d5-735b-472f-8548-b80654820e60 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.089471 Nov 02 23:30:22.253522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1961/2536] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:22 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:23.273888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7c262843-498b-40c2-b4ac-6be1936d8484 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:23.275049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7c262843-498b-40c2-b4ac-6be1936d8484 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:23.286414 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7c262843-498b-40c2-b4ac-6be1936d8484 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:23.287258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7c262843-498b-40c2-b4ac-6be1936d8484 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:23.288679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7c262843-498b-40c2-b4ac-6be1936d8484 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:23.289463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7c262843-498b-40c2-b4ac-6be1936d8484 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:23.378787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7c262843-498b-40c2-b4ac-6be1936d8484 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:23.387430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7c262843-498b-40c2-b4ac-6be1936d8484 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.120434 Nov 02 23:30:23.388013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1962/2537] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:23 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:30:24.405390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cc1b0599-95f5-42c8-ad4f-e316c41eda56 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:24.406114 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cc1b0599-95f5-42c8-ad4f-e316c41eda56 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:24.412804 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc1b0599-95f5-42c8-ad4f-e316c41eda56 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:24.413242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc1b0599-95f5-42c8-ad4f-e316c41eda56 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:24.414116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc1b0599-95f5-42c8-ad4f-e316c41eda56 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:24.414543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc1b0599-95f5-42c8-ad4f-e316c41eda56 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:24.475540 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cc1b0599-95f5-42c8-ad4f-e316c41eda56 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:24.483524 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cc1b0599-95f5-42c8-ad4f-e316c41eda56 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081764 Nov 02 23:30:24.484097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1963/2538] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:24 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:25.500655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-53eb7a20-ae9d-407b-b483-486bba92b858 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:25.501337 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-53eb7a20-ae9d-407b-b483-486bba92b858 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:25.507553 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53eb7a20-ae9d-407b-b483-486bba92b858 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:25.507993 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53eb7a20-ae9d-407b-b483-486bba92b858 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:25.508790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53eb7a20-ae9d-407b-b483-486bba92b858 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:25.509215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53eb7a20-ae9d-407b-b483-486bba92b858 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:25.568639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-53eb7a20-ae9d-407b-b483-486bba92b858 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:25.576857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-53eb7a20-ae9d-407b-b483-486bba92b858 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.079839 Nov 02 23:30:25.577418 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1964/2539] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:25 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:26.593342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5b4a5133-a93e-455a-8b59-12871e446baf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:26.594028 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5b4a5133-a93e-455a-8b59-12871e446baf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:26.600407 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b4a5133-a93e-455a-8b59-12871e446baf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:26.600853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b4a5133-a93e-455a-8b59-12871e446baf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:26.602116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b4a5133-a93e-455a-8b59-12871e446baf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:26.602543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b4a5133-a93e-455a-8b59-12871e446baf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:26.660705 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5b4a5133-a93e-455a-8b59-12871e446baf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:26.669197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5b4a5133-a93e-455a-8b59-12871e446baf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.079492 Nov 02 23:30:26.669886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1965/2540] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:26 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:27.686117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4ce27a79-8e96-490e-9445-017d82e66712 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:27.686810 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4ce27a79-8e96-490e-9445-017d82e66712 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:27.693565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ce27a79-8e96-490e-9445-017d82e66712 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:27.694007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ce27a79-8e96-490e-9445-017d82e66712 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:27.694781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ce27a79-8e96-490e-9445-017d82e66712 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:27.695278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ce27a79-8e96-490e-9445-017d82e66712 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:27.757514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4ce27a79-8e96-490e-9445-017d82e66712 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:27.766424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4ce27a79-8e96-490e-9445-017d82e66712 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.083934 Nov 02 23:30:27.767025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1966/2541] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:27 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:28.782829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6a48fa05-0951-4226-8f1b-73eb49a493bf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:28.783572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6a48fa05-0951-4226-8f1b-73eb49a493bf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:28.789676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a48fa05-0951-4226-8f1b-73eb49a493bf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:28.790112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a48fa05-0951-4226-8f1b-73eb49a493bf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:28.790874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a48fa05-0951-4226-8f1b-73eb49a493bf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:28.791326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6a48fa05-0951-4226-8f1b-73eb49a493bf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:28.852159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6a48fa05-0951-4226-8f1b-73eb49a493bf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:28.859818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6a48fa05-0951-4226-8f1b-73eb49a493bf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080663 Nov 02 23:30:28.860379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1967/2542] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:28 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:29.877649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-16a1b533-f0e9-4909-8c08-279f3f1a5c52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:29.878358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-16a1b533-f0e9-4909-8c08-279f3f1a5c52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:29.884151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-16a1b533-f0e9-4909-8c08-279f3f1a5c52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:29.884583 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-16a1b533-f0e9-4909-8c08-279f3f1a5c52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:29.885354 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-16a1b533-f0e9-4909-8c08-279f3f1a5c52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:29.885777 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-16a1b533-f0e9-4909-8c08-279f3f1a5c52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:29.947031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-16a1b533-f0e9-4909-8c08-279f3f1a5c52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:29.955044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-16a1b533-f0e9-4909-8c08-279f3f1a5c52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081160 Nov 02 23:30:29.955624 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1968/2543] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:29 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:30.971953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-61d91d81-65e5-4f3f-b373-26a79c9390bd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:30.972841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-61d91d81-65e5-4f3f-b373-26a79c9390bd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:30.979086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-61d91d81-65e5-4f3f-b373-26a79c9390bd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:30.979527 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-61d91d81-65e5-4f3f-b373-26a79c9390bd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:30.980291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-61d91d81-65e5-4f3f-b373-26a79c9390bd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:30.980715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-61d91d81-65e5-4f3f-b373-26a79c9390bd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:31.039948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-61d91d81-65e5-4f3f-b373-26a79c9390bd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:31.047735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-61d91d81-65e5-4f3f-b373-26a79c9390bd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.079497 Nov 02 23:30:31.048307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1969/2544] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:30 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:32.065242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6653f493-81b9-4a8a-b5e9-1f0042be4633 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:32.065979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6653f493-81b9-4a8a-b5e9-1f0042be4633 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:32.072909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6653f493-81b9-4a8a-b5e9-1f0042be4633 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:32.073351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6653f493-81b9-4a8a-b5e9-1f0042be4633 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:32.074119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6653f493-81b9-4a8a-b5e9-1f0042be4633 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:32.074545 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6653f493-81b9-4a8a-b5e9-1f0042be4633 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:32.135762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6653f493-81b9-4a8a-b5e9-1f0042be4633 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:32.143937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6653f493-81b9-4a8a-b5e9-1f0042be4633 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082589 Nov 02 23:30:32.144509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1970/2545] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:32 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:33.162398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2ac793ea-567d-4bb2-b07c-b95457847a12 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:33.163193 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2ac793ea-567d-4bb2-b07c-b95457847a12 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:33.171622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ac793ea-567d-4bb2-b07c-b95457847a12 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:33.172305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ac793ea-567d-4bb2-b07c-b95457847a12 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:33.173228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ac793ea-567d-4bb2-b07c-b95457847a12 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:33.173980 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ac793ea-567d-4bb2-b07c-b95457847a12 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:33.236514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2ac793ea-567d-4bb2-b07c-b95457847a12 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:33.245135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2ac793ea-567d-4bb2-b07c-b95457847a12 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.087178 Nov 02 23:30:33.245700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1971/2546] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:33 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:34.261984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-723833cf-8b3c-411d-a5fd-cd124e9e503f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:34.262882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-723833cf-8b3c-411d-a5fd-cd124e9e503f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:34.269187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-723833cf-8b3c-411d-a5fd-cd124e9e503f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:34.269627 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-723833cf-8b3c-411d-a5fd-cd124e9e503f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:34.270441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-723833cf-8b3c-411d-a5fd-cd124e9e503f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:34.270906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-723833cf-8b3c-411d-a5fd-cd124e9e503f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:34.337757 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-723833cf-8b3c-411d-a5fd-cd124e9e503f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:34.345904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-723833cf-8b3c-411d-a5fd-cd124e9e503f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.088029 Nov 02 23:30:34.346523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1972/2547] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:34 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:35.364075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-db9ea1da-192e-4cc6-b831-e7e49c218ad5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:35.364747 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-db9ea1da-192e-4cc6-b831-e7e49c218ad5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:35.371736 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db9ea1da-192e-4cc6-b831-e7e49c218ad5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:35.372212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db9ea1da-192e-4cc6-b831-e7e49c218ad5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:35.373406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db9ea1da-192e-4cc6-b831-e7e49c218ad5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:35.373406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db9ea1da-192e-4cc6-b831-e7e49c218ad5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:35.443324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-db9ea1da-192e-4cc6-b831-e7e49c218ad5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:35.456000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-db9ea1da-192e-4cc6-b831-e7e49c218ad5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.095682 Nov 02 23:30:35.456986 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1973/2548] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:35 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:30:36.473405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-84103b2b-f099-4d03-ae4d-a6b89d4c7a7f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:36.474055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-84103b2b-f099-4d03-ae4d-a6b89d4c7a7f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:36.480860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-84103b2b-f099-4d03-ae4d-a6b89d4c7a7f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:36.481304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-84103b2b-f099-4d03-ae4d-a6b89d4c7a7f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:36.482075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-84103b2b-f099-4d03-ae4d-a6b89d4c7a7f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:36.482505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-84103b2b-f099-4d03-ae4d-a6b89d4c7a7f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:36.543610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-84103b2b-f099-4d03-ae4d-a6b89d4c7a7f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:36.551547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-84103b2b-f099-4d03-ae4d-a6b89d4c7a7f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081756 Nov 02 23:30:36.552118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1974/2549] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:36 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:36.791355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:30:36.791576 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:30:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 23:30:37.569023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4ef07d7c-ad97-4966-b95e-681fcc13f1ef tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:37.569689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4ef07d7c-ad97-4966-b95e-681fcc13f1ef tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:37.575826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ef07d7c-ad97-4966-b95e-681fcc13f1ef tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:37.576278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ef07d7c-ad97-4966-b95e-681fcc13f1ef tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:37.577040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ef07d7c-ad97-4966-b95e-681fcc13f1ef tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:37.577466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ef07d7c-ad97-4966-b95e-681fcc13f1ef tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:37.641303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4ef07d7c-ad97-4966-b95e-681fcc13f1ef tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:37.649712 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4ef07d7c-ad97-4966-b95e-681fcc13f1ef tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.083739 Nov 02 23:30:37.650499 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1975/2550] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:37 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:38.665662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f9bf4b41-8846-4ce2-a50e-a8be4e2fe254 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:38.666315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f9bf4b41-8846-4ce2-a50e-a8be4e2fe254 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:38.673121 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f9bf4b41-8846-4ce2-a50e-a8be4e2fe254 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:38.673559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f9bf4b41-8846-4ce2-a50e-a8be4e2fe254 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:38.674334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f9bf4b41-8846-4ce2-a50e-a8be4e2fe254 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:38.674760 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f9bf4b41-8846-4ce2-a50e-a8be4e2fe254 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:38.739806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f9bf4b41-8846-4ce2-a50e-a8be4e2fe254 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:38.750687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f9bf4b41-8846-4ce2-a50e-a8be4e2fe254 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.088742 Nov 02 23:30:38.751388 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1976/2551] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:38 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:39.768337 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0cda4387-0d1e-490b-80ad-ab100aecd395 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:39.768974 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0cda4387-0d1e-490b-80ad-ab100aecd395 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:39.775823 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0cda4387-0d1e-490b-80ad-ab100aecd395 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:39.776265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0cda4387-0d1e-490b-80ad-ab100aecd395 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:39.777021 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0cda4387-0d1e-490b-80ad-ab100aecd395 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:39.777626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0cda4387-0d1e-490b-80ad-ab100aecd395 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:39.839468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0cda4387-0d1e-490b-80ad-ab100aecd395 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:39.847528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0cda4387-0d1e-490b-80ad-ab100aecd395 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082803 Nov 02 23:30:39.848102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1977/2552] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:39 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:40.864812 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-478f5411-8540-41d6-a9e0-18b10b20a56b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:40.865726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-478f5411-8540-41d6-a9e0-18b10b20a56b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:40.872949 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-478f5411-8540-41d6-a9e0-18b10b20a56b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:40.873394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-478f5411-8540-41d6-a9e0-18b10b20a56b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:40.874182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-478f5411-8540-41d6-a9e0-18b10b20a56b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:40.874618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-478f5411-8540-41d6-a9e0-18b10b20a56b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:40.937156 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-478f5411-8540-41d6-a9e0-18b10b20a56b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:40.950007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-478f5411-8540-41d6-a9e0-18b10b20a56b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.088590 Nov 02 23:30:40.951117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1978/2553] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:40 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:41.967758 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1d5dec42-6ddc-458e-9244-f4973f76a6f2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:41.968853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1d5dec42-6ddc-458e-9244-f4973f76a6f2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:41.974674 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d5dec42-6ddc-458e-9244-f4973f76a6f2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:41.975146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d5dec42-6ddc-458e-9244-f4973f76a6f2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:41.975910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d5dec42-6ddc-458e-9244-f4973f76a6f2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:41.976332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d5dec42-6ddc-458e-9244-f4973f76a6f2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:42.040997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1d5dec42-6ddc-458e-9244-f4973f76a6f2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:42.049704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1d5dec42-6ddc-458e-9244-f4973f76a6f2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.085585 Nov 02 23:30:42.051774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1979/2554] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:41 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:43.066454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c42261e6-826b-4686-9911-951026cf3e5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:43.067151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c42261e6-826b-4686-9911-951026cf3e5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:43.073911 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c42261e6-826b-4686-9911-951026cf3e5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:43.074351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c42261e6-826b-4686-9911-951026cf3e5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:43.075224 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c42261e6-826b-4686-9911-951026cf3e5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:43.075716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c42261e6-826b-4686-9911-951026cf3e5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:43.136267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c42261e6-826b-4686-9911-951026cf3e5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:43.143946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c42261e6-826b-4686-9911-951026cf3e5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081413 Nov 02 23:30:43.144498 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1980/2555] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:43 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:30:44.160469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4ffdf296-c3d4-4941-aea7-4af6f672cac3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:44.161211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4ffdf296-c3d4-4941-aea7-4af6f672cac3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:44.169203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ffdf296-c3d4-4941-aea7-4af6f672cac3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:44.169651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ffdf296-c3d4-4941-aea7-4af6f672cac3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:44.170430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ffdf296-c3d4-4941-aea7-4af6f672cac3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:44.170863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ffdf296-c3d4-4941-aea7-4af6f672cac3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:44.255794 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4ffdf296-c3d4-4941-aea7-4af6f672cac3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:44.263938 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4ffdf296-c3d4-4941-aea7-4af6f672cac3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.107083 Nov 02 23:30:44.264513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1981/2556] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:44 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:45.280530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-56578015-6777-4e00-9b8a-98edbba0d6ff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:45.281279 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-56578015-6777-4e00-9b8a-98edbba0d6ff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:45.287510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56578015-6777-4e00-9b8a-98edbba0d6ff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:45.287956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56578015-6777-4e00-9b8a-98edbba0d6ff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:45.288733 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56578015-6777-4e00-9b8a-98edbba0d6ff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:45.289169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-56578015-6777-4e00-9b8a-98edbba0d6ff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:45.349318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-56578015-6777-4e00-9b8a-98edbba0d6ff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:45.357944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-56578015-6777-4e00-9b8a-98edbba0d6ff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081005 Nov 02 23:30:45.358515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1982/2557] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:45 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:46.375471 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5126759a-178c-42f9-b787-0aab07caf671 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:46.376156 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5126759a-178c-42f9-b787-0aab07caf671 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:46.382569 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5126759a-178c-42f9-b787-0aab07caf671 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:46.383048 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5126759a-178c-42f9-b787-0aab07caf671 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:46.383825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5126759a-178c-42f9-b787-0aab07caf671 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:46.384286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5126759a-178c-42f9-b787-0aab07caf671 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:46.446282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5126759a-178c-42f9-b787-0aab07caf671 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:46.454491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5126759a-178c-42f9-b787-0aab07caf671 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.083350 Nov 02 23:30:46.455123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1983/2558] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:46 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:47.471833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-55841ea4-ffdc-4c39-8327-c99727ec4a90 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:47.472501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-55841ea4-ffdc-4c39-8327-c99727ec4a90 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:47.478585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55841ea4-ffdc-4c39-8327-c99727ec4a90 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:47.479065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55841ea4-ffdc-4c39-8327-c99727ec4a90 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:47.479825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55841ea4-ffdc-4c39-8327-c99727ec4a90 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:47.480255 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55841ea4-ffdc-4c39-8327-c99727ec4a90 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:47.538584 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-55841ea4-ffdc-4c39-8327-c99727ec4a90 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:30:47.546792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-55841ea4-ffdc-4c39-8327-c99727ec4a90 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078591 Nov 02 23:30:47.547373 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1984/2559] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:30:47 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:30:48.520586 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-939e5d5a-21c8-4253-8666-a1f0bb49f372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:30:48.521232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-939e5d5a-21c8-4253-8666-a1f0bb49f372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:30:48.527243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-939e5d5a-21c8-4253-8666-a1f0bb49f372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:48.527683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-939e5d5a-21c8-4253-8666-a1f0bb49f372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:48.528444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-939e5d5a-21c8-4253-8666-a1f0bb49f372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:48.528869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-939e5d5a-21c8-4253-8666-a1f0bb49f372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:48.554494 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-939e5d5a-21c8-4253-8666-a1f0bb49f372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Going to try to terminate instance {{(pid=115800) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 23:30:48.561888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.compute.api [None req-939e5d5a-21c8-4253-8666-a1f0bb49f372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Working on deleting snapshot ef26ff30-4320-477d-b405-5d864b664cff from shelved instance... Nov 02 23:30:49.196036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-939e5d5a-21c8-4253-8666-a1f0bb49f372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Doing local delete in cell 8cf0116f-06d0-4573-b34b-f5af4d2eb5ed(cell1) {{(pid=115800) _delete /opt/stack/nova/nova/compute/api.py:2437}} Nov 02 23:30:49.196833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-939e5d5a-21c8-4253-8666-a1f0bb49f372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:30:49.197267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-939e5d5a-21c8-4253-8666-a1f0bb49f372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:30:49.197683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.compute.api [None req-939e5d5a-21c8-4253-8666-a1f0bb49f372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 02 23:30:49.204887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.network.neutron [None req-939e5d5a-21c8-4253-8666-a1f0bb49f372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] deallocate_for_instance() {{(pid=115800) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1675}} Nov 02 23:30:50.405983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.network.neutron [None req-939e5d5a-21c8-4253-8666-a1f0bb49f372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Updating instance_info_cache with network_info: [] {{(pid=115800) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 02 23:31:48.930665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.scheduler.client.report [None req-939e5d5a-21c8-4253-8666-a1f0bb49f372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Deleted allocations for instance 15750fff-dec6-4bcc-a69c-0f9576f7970e Nov 02 23:31:49.061279 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-939e5d5a-21c8-4253-8666-a1f0bb49f372 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "DELETE /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 204 len: 0 microversion: 2.20 time: 60.544109 Nov 02 23:31:49.061780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1985/2560] 10.222.0.41 () {60 vars in 1279 bytes} [Tue Nov 2 23:30:48 2021] DELETE /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 0 bytes in 60545 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 23:31:49.068250 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b3531dfd-471b-490e-a0b3-fdbbd6467d72 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:31:49.068768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b3531dfd-471b-490e-a0b3-fdbbd6467d72 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:31:49.074941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3531dfd-471b-490e-a0b3-fdbbd6467d72 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:49.075387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3531dfd-471b-490e-a0b3-fdbbd6467d72 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:49.076163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3531dfd-471b-490e-a0b3-fdbbd6467d72 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:49.076593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3531dfd-471b-490e-a0b3-fdbbd6467d72 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:49.143948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b3531dfd-471b-490e-a0b3-fdbbd6467d72 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:49.153787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b3531dfd-471b-490e-a0b3-fdbbd6467d72 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.090784 Nov 02 23:31:49.154379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1986/2561] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:31:49 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:31:49.217823 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-f2329db4-0229-4934-a0a3-dfcf3c6fa3e2 req-39f7a820-e5ca-421c-9054-4b629ec19584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15750fff-dec6-4bcc-a69c-0f9576f7970e", "name": "network-vif-deleted", "tag": "1be9ce23-4225-4b98-9740-ed6ade9ebf4a"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:31:49.219393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:31:49.219393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:31:49.226287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-f2329db4-0229-4934-a0a3-dfcf3c6fa3e2 req-39f7a820-e5ca-421c-9054-4b629ec19584 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:49.226722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-f2329db4-0229-4934-a0a3-dfcf3c6fa3e2 req-39f7a820-e5ca-421c-9054-4b629ec19584 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:49.238177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.compute.server_external_events [req-f2329db4-0229-4934-a0a3-dfcf3c6fa3e2 req-39f7a820-e5ca-421c-9054-4b629ec19584 service nova] Unable to find a host for instance 15750fff-dec6-4bcc-a69c-0f9576f7970e. Dropping event network-vif-deleted {{(pid=115800) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 02 23:31:49.239091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-f2329db4-0229-4934-a0a3-dfcf3c6fa3e2 req-39f7a820-e5ca-421c-9054-4b629ec19584 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.083766 Nov 02 23:31:49.239682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1987/2562] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:31:49 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 85 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 23:31:49.245553 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d1e39a75-b8d9-429e-a50c-97e8fd3ec10a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:31:49.246206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d1e39a75-b8d9-429e-a50c-97e8fd3ec10a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:31:49.252990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d1e39a75-b8d9-429e-a50c-97e8fd3ec10a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:49.253434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d1e39a75-b8d9-429e-a50c-97e8fd3ec10a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:49.254210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d1e39a75-b8d9-429e-a50c-97e8fd3ec10a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:49.254638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d1e39a75-b8d9-429e-a50c-97e8fd3ec10a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:49.268399 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-d1e39a75-b8d9-429e-a50c-97e8fd3ec10a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] HTTP exception thrown: Instance 15750fff-dec6-4bcc-a69c-0f9576f7970e could not be found. Nov 02 23:31:49.268996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d1e39a75-b8d9-429e-a50c-97e8fd3ec10a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Returning 404 to user: Instance 15750fff-dec6-4bcc-a69c-0f9576f7970e could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:31:49.269819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d1e39a75-b8d9-429e-a50c-97e8fd3ec10a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "DELETE /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 404 len: 111 microversion: 2.20 time: 0.027959 Nov 02 23:31:49.270375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1988/2563] 10.222.0.41 () {60 vars in 1279 bytes} [Tue Nov 2 23:31:49 2021] DELETE /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 23:31:49.274665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-49cf00a0-6b42-4a3e-a74e-644097a10541 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:31:49.275184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-49cf00a0-6b42-4a3e-a74e-644097a10541 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:31:49.281053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-49cf00a0-6b42-4a3e-a74e-644097a10541 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:49.281490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-49cf00a0-6b42-4a3e-a74e-644097a10541 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:49.282261 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-49cf00a0-6b42-4a3e-a74e-644097a10541 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:49.283096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-49cf00a0-6b42-4a3e-a74e-644097a10541 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:49.299313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-49cf00a0-6b42-4a3e-a74e-644097a10541 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] HTTP exception thrown: Instance 91317c10-28a4-413c-ae6d-2021c9ed1651 could not be found. Nov 02 23:31:49.299901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-49cf00a0-6b42-4a3e-a74e-644097a10541 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Returning 404 to user: Instance 91317c10-28a4-413c-ae6d-2021c9ed1651 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:31:49.300725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-49cf00a0-6b42-4a3e-a74e-644097a10541 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "DELETE /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651" status: 404 len: 111 microversion: 2.1 time: 0.029456 Nov 02 23:31:49.301277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1989/2564] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:31:49 2021] DELETE /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 23:31:49.305812 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1a21250c-f7af-4754-945b-25b2f7d04fdb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:31:49.306411 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1a21250c-f7af-4754-945b-25b2f7d04fdb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:31:49.312443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a21250c-f7af-4754-945b-25b2f7d04fdb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:49.312811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a21250c-f7af-4754-945b-25b2f7d04fdb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:49.314448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a21250c-f7af-4754-945b-25b2f7d04fdb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:49.314878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1a21250c-f7af-4754-945b-25b2f7d04fdb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:49.377689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1a21250c-f7af-4754-945b-25b2f7d04fdb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:49.385973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1a21250c-f7af-4754-945b-25b2f7d04fdb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.083716 Nov 02 23:31:49.386544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1990/2565] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:31:49 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:31:49.390838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-90e823d1-b580-41fb-aaf2-e2e2c79f996a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '.version_select at 0x7fd8581cec10>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:31:49.408637 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-90e823d1-b580-41fb-aaf2-e2e2c79f996a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1891433527" status: 204 len: 0 microversion: 2.20 time: 0.021011 Nov 02 23:31:49.409216 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1991/2566] 10.222.0.41 () {60 vars in 1261 bytes} [Tue Nov 2 23:31:49 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1891433527 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 23:31:49.413793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9869a0be-0d05-4480-99dc-51d284567c12 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:31:49.414451 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9869a0be-0d05-4480-99dc-51d284567c12 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: 91317c10-28a4-413c-ae6d-2021c9ed1651] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:31:49.421014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9869a0be-0d05-4480-99dc-51d284567c12 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:49.421440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9869a0be-0d05-4480-99dc-51d284567c12 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:49.422224 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9869a0be-0d05-4480-99dc-51d284567c12 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:49.423185 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9869a0be-0d05-4480-99dc-51d284567c12 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:49.436880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-9869a0be-0d05-4480-99dc-51d284567c12 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] HTTP exception thrown: Instance 91317c10-28a4-413c-ae6d-2021c9ed1651 could not be found. Nov 02 23:31:49.437482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9869a0be-0d05-4480-99dc-51d284567c12 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Returning 404 to user: Instance 91317c10-28a4-413c-ae6d-2021c9ed1651 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:31:49.439280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9869a0be-0d05-4480-99dc-51d284567c12 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651" status: 404 len: 111 microversion: 2.1 time: 0.028198 Nov 02 23:31:49.439844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1992/2567] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:31:49 2021] GET /compute/v2.1/servers/91317c10-28a4-413c-ae6d-2021c9ed1651 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 23:31:50.287911 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5a2e90ed-e654-449f-99f7-2772dc224515 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'create', calling method: .version_select at 0x7fd858213940>, body: {"keypair": {"name": "tempest-keypair-1684113584"}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:31:50.306880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-5a2e90ed-e654-449f-99f7-2772dc224515 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Getting quotas for project f6d6ef936bc64892a3d3ff11413f78b8. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:31:50.311273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-5a2e90ed-e654-449f-99f7-2772dc224515 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Getting quotas for user 5c145054a2644e17b76cb2b67dcbd57a and project f6d6ef936bc64892a3d3ff11413f78b8. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:31:50.595047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-5a2e90ed-e654-449f-99f7-2772dc224515 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Getting quotas for project f6d6ef936bc64892a3d3ff11413f78b8. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:31:50.598625 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-5a2e90ed-e654-449f-99f7-2772dc224515 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Getting quotas for user 5c145054a2644e17b76cb2b67dcbd57a and project f6d6ef936bc64892a3d3ff11413f78b8. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:31:50.612548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5a2e90ed-e654-449f-99f7-2772dc224515 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.328057 Nov 02 23:31:50.613223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1993/2568] 10.222.0.41 () {62 vars in 1198 bytes} [Tue Nov 2 23:31:50 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 330 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Nov 02 23:31:50.618033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-88dbf691-ed84-4e0d-a579-35f29837f3b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:31:50.618635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-88dbf691-ed84-4e0d-a579-35f29837f3b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:31:50.625798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88dbf691-ed84-4e0d-a579-35f29837f3b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:50.626782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88dbf691-ed84-4e0d-a579-35f29837f3b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:50.627632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88dbf691-ed84-4e0d-a579-35f29837f3b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:50.628069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88dbf691-ed84-4e0d-a579-35f29837f3b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:50.696634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-88dbf691-ed84-4e0d-a579-35f29837f3b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:50.711932 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-88dbf691-ed84-4e0d-a579-35f29837f3b4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.097335 Nov 02 23:31:50.712523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1994/2569] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:31:50 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:31:51.734372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cf58c924-6686-4210-8622-6b3090f4971b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:31:51.735074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cf58c924-6686-4210-8622-6b3090f4971b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:31:51.743672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf58c924-6686-4210-8622-6b3090f4971b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:51.744119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf58c924-6686-4210-8622-6b3090f4971b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:51.744904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf58c924-6686-4210-8622-6b3090f4971b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:51.745330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf58c924-6686-4210-8622-6b3090f4971b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:51.830508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cf58c924-6686-4210-8622-6b3090f4971b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:51.839422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cf58c924-6686-4210-8622-6b3090f4971b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.108938 Nov 02 23:31:51.840321 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1995/2570] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:31:51 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:31:51.910766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-034ed856-db44-4460-8271-90fd616980aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1886244122", "imageRef": "4159c567-fd66-4bbb-9bf4-6ce0afd65d88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fdc236b7-7cb8-4ee0-a8bc-b772823b9da2"}], "security_groups": [{"name": "tempest-securitygroup--107579363"}], "key_name": "tempest-keypair-1684113584", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:31:52.014059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.network.neutron [None req-034ed856-db44-4460-8271-90fd616980aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] validate_networks() for [('fdc236b7-7cb8-4ee0-a8bc-b772823b9da2', None, None, None, None, None)] {{(pid=115800) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 23:31:52.433137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-034ed856-db44-4460-8271-90fd616980aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Flavor limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 23:31:52.433562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-034ed856-db44-4460-8271-90fd616980aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Image limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 23:31:52.434039 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-034ed856-db44-4460-8271-90fd616980aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Flavor pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 23:31:52.434451 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-034ed856-db44-4460-8271-90fd616980aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Image pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 23:31:52.434867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-034ed856-db44-4460-8271-90fd616980aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 23:31:52.444199 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-034ed856-db44-4460-8271-90fd616980aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:52.444650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-034ed856-db44-4460-8271-90fd616980aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:52.445459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-034ed856-db44-4460-8271-90fd616980aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:52.445894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-034ed856-db44-4460-8271-90fd616980aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:52.463375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-034ed856-db44-4460-8271-90fd616980aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Getting quotas for project f6d6ef936bc64892a3d3ff11413f78b8. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:31:52.467411 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-034ed856-db44-4460-8271-90fd616980aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Getting quotas for user 5c145054a2644e17b76cb2b67dcbd57a and project f6d6ef936bc64892a3d3ff11413f78b8. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:31:52.478874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-034ed856-db44-4460-8271-90fd616980aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Going to run 1 instances... {{(pid=115800) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 23:31:52.481243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-034ed856-db44-4460-8271-90fd616980aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4159c567-fd66-4bbb-9bf4-6ce0afd65d88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 23:31:52.528453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-034ed856-db44-4460-8271-90fd616980aa tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.622096 Nov 02 23:31:52.529112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1996/2571] 10.222.0.41 () {62 vars in 1187 bytes} [Tue Nov 2 23:31:51 2021] POST /compute/v2.1/servers => generated 401 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 02 23:31:52.538721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-27f00c86-d7d8-44e1-8fc1-3a2a1cbc1d1a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:31:52.539360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-27f00c86-d7d8-44e1-8fc1-3a2a1cbc1d1a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:31:52.598686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-27f00c86-d7d8-44e1-8fc1-3a2a1cbc1d1a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:52.607046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-27f00c86-d7d8-44e1-8fc1-3a2a1cbc1d1a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:52.608760 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-27f00c86-d7d8-44e1-8fc1-3a2a1cbc1d1a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:52.610210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-27f00c86-d7d8-44e1-8fc1-3a2a1cbc1d1a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f" status: 200 len: 1282 microversion: 2.20 time: 0.074747 Nov 02 23:31:52.610418 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1997/2572] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:31:52 2021] GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f => generated 1282 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:31:52.857490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b2071cd0-9790-49d3-bf2f-23c7e4971023 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:31:52.858339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b2071cd0-9790-49d3-bf2f-23c7e4971023 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:31:52.866800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b2071cd0-9790-49d3-bf2f-23c7e4971023 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:52.867490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b2071cd0-9790-49d3-bf2f-23c7e4971023 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:52.868358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b2071cd0-9790-49d3-bf2f-23c7e4971023 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:52.869103 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b2071cd0-9790-49d3-bf2f-23c7e4971023 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:52.935318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b2071cd0-9790-49d3-bf2f-23c7e4971023 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:52.945346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b2071cd0-9790-49d3-bf2f-23c7e4971023 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.091540 Nov 02 23:31:52.945934 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1998/2573] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:31:52 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:31:53.627887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e4bf6f27-d6ec-4f83-aa7c-cf301d14989e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:31:53.628666 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e4bf6f27-d6ec-4f83-aa7c-cf301d14989e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:31:53.635053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4bf6f27-d6ec-4f83-aa7c-cf301d14989e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:53.635571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4bf6f27-d6ec-4f83-aa7c-cf301d14989e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:53.636425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4bf6f27-d6ec-4f83-aa7c-cf301d14989e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:53.636934 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4bf6f27-d6ec-4f83-aa7c-cf301d14989e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:53.701964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e4bf6f27-d6ec-4f83-aa7c-cf301d14989e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:53.711117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e4bf6f27-d6ec-4f83-aa7c-cf301d14989e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:53.712709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e4bf6f27-d6ec-4f83-aa7c-cf301d14989e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:53.713888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e4bf6f27-d6ec-4f83-aa7c-cf301d14989e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f" status: 200 len: 1342 microversion: 2.20 time: 0.090110 Nov 02 23:31:53.714531 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 1999/2574] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:31:53 2021] GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f => generated 1342 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:31:53.963357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-baaac6d7-262d-4b03-9154-2ab6beacd178 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:31:53.964066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-baaac6d7-262d-4b03-9154-2ab6beacd178 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:31:53.970909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-baaac6d7-262d-4b03-9154-2ab6beacd178 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:53.971403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-baaac6d7-262d-4b03-9154-2ab6beacd178 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:53.972168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-baaac6d7-262d-4b03-9154-2ab6beacd178 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:53.972601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-baaac6d7-262d-4b03-9154-2ab6beacd178 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:54.036863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-baaac6d7-262d-4b03-9154-2ab6beacd178 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:54.044953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-baaac6d7-262d-4b03-9154-2ab6beacd178 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.085290 Nov 02 23:31:54.045535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2000/2575] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:31:53 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:31:54.732214 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-67b8a633-7e8b-41dc-8c85-bd31599503a2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:31:54.732923 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-67b8a633-7e8b-41dc-8c85-bd31599503a2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:31:54.739406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67b8a633-7e8b-41dc-8c85-bd31599503a2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:54.739850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67b8a633-7e8b-41dc-8c85-bd31599503a2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:54.740618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67b8a633-7e8b-41dc-8c85-bd31599503a2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:54.741053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67b8a633-7e8b-41dc-8c85-bd31599503a2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:54.882611 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-67b8a633-7e8b-41dc-8c85-bd31599503a2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:54.891953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-67b8a633-7e8b-41dc-8c85-bd31599503a2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:54.893488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-67b8a633-7e8b-41dc-8c85-bd31599503a2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:54.894622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-67b8a633-7e8b-41dc-8c85-bd31599503a2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f" status: 200 len: 1407 microversion: 2.20 time: 0.166127 Nov 02 23:31:54.895256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2001/2576] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:31:54 2021] GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:31:55.061468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9daacae6-f9c7-4ac0-86d4-d74037cf1774 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:31:55.063255 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9daacae6-f9c7-4ac0-86d4-d74037cf1774 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:31:55.069942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9daacae6-f9c7-4ac0-86d4-d74037cf1774 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:55.070385 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9daacae6-f9c7-4ac0-86d4-d74037cf1774 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:55.073431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9daacae6-f9c7-4ac0-86d4-d74037cf1774 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:55.073872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9daacae6-f9c7-4ac0-86d4-d74037cf1774 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:55.139618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9daacae6-f9c7-4ac0-86d4-d74037cf1774 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:55.148855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9daacae6-f9c7-4ac0-86d4-d74037cf1774 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.090962 Nov 02 23:31:55.149439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2002/2577] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:31:55 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:31:55.239378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-b8c5e6b0-3f0e-4222-b0bb-cadb1a429795 req-b87457c7-57bf-4b8a-a1d7-e129317ee7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef96c6ca-e054-45d7-b346-b5af72ea945f", "tag": "ee913c35-64a5-482c-a3a7-9a8299f45bd3"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:31:55.240856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:31:55.240856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:31:55.250106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-b8c5e6b0-3f0e-4222-b0bb-cadb1a429795 req-b87457c7-57bf-4b8a-a1d7-e129317ee7a0 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:55.251096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-b8c5e6b0-3f0e-4222-b0bb-cadb1a429795 req-b87457c7-57bf-4b8a-a1d7-e129317ee7a0 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:55.263624 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-b8c5e6b0-3f0e-4222-b0bb-cadb1a429795 req-b87457c7-57bf-4b8a-a1d7-e129317ee7a0 service nova] Creating event network-changed:ee913c35-64a5-482c-a3a7-9a8299f45bd3 for instance ef96c6ca-e054-45d7-b346-b5af72ea945f on hv-cinder-81584 Nov 02 23:31:55.269854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-b8c5e6b0-3f0e-4222-b0bb-cadb1a429795 req-b87457c7-57bf-4b8a-a1d7-e129317ee7a0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033906 Nov 02 23:31:55.270794 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2003/2578] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:31:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:31:55.912336 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2facd0a4-537d-48b8-a441-922eafcf0352 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:31:55.913031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2facd0a4-537d-48b8-a441-922eafcf0352 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:31:55.918880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2facd0a4-537d-48b8-a441-922eafcf0352 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:55.919350 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2facd0a4-537d-48b8-a441-922eafcf0352 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:55.920137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2facd0a4-537d-48b8-a441-922eafcf0352 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:55.920562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2facd0a4-537d-48b8-a441-922eafcf0352 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:56.050834 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2facd0a4-537d-48b8-a441-922eafcf0352 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:56.058496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2facd0a4-537d-48b8-a441-922eafcf0352 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:56.060265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2facd0a4-537d-48b8-a441-922eafcf0352 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:56.061352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2facd0a4-537d-48b8-a441-922eafcf0352 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f" status: 200 len: 1407 microversion: 2.20 time: 0.153100 Nov 02 23:31:56.061904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2004/2579] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:31:55 2021] GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:31:56.165409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-96ba0f94-4afc-475e-9ade-989e4524d6ff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:31:56.165925 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-96ba0f94-4afc-475e-9ade-989e4524d6ff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:31:56.172066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-96ba0f94-4afc-475e-9ade-989e4524d6ff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:56.173036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-96ba0f94-4afc-475e-9ade-989e4524d6ff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:56.173791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-96ba0f94-4afc-475e-9ade-989e4524d6ff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:56.174213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-96ba0f94-4afc-475e-9ade-989e4524d6ff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:56.233236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-96ba0f94-4afc-475e-9ade-989e4524d6ff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:56.241773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-96ba0f94-4afc-475e-9ade-989e4524d6ff tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.079949 Nov 02 23:31:56.242349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2005/2580] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:31:56 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:31:57.080311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a0b7be5e-7e85-4a9f-8479-2a96d5ffbca2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:31:57.081013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a0b7be5e-7e85-4a9f-8479-2a96d5ffbca2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:31:57.086681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0b7be5e-7e85-4a9f-8479-2a96d5ffbca2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:57.087162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0b7be5e-7e85-4a9f-8479-2a96d5ffbca2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:57.087928 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0b7be5e-7e85-4a9f-8479-2a96d5ffbca2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:57.088359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0b7be5e-7e85-4a9f-8479-2a96d5ffbca2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:57.221258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a0b7be5e-7e85-4a9f-8479-2a96d5ffbca2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:57.231068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a0b7be5e-7e85-4a9f-8479-2a96d5ffbca2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:57.233160 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a0b7be5e-7e85-4a9f-8479-2a96d5ffbca2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:57.234258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a0b7be5e-7e85-4a9f-8479-2a96d5ffbca2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f" status: 200 len: 1407 microversion: 2.20 time: 0.158271 Nov 02 23:31:57.234814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2006/2581] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:31:57 2021] GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:31:57.257752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f2c8bb1a-73de-412f-8352-ab0f0b929494 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:31:57.258373 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f2c8bb1a-73de-412f-8352-ab0f0b929494 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:31:57.264097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f2c8bb1a-73de-412f-8352-ab0f0b929494 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:57.264540 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f2c8bb1a-73de-412f-8352-ab0f0b929494 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:57.265298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f2c8bb1a-73de-412f-8352-ab0f0b929494 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:57.265764 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f2c8bb1a-73de-412f-8352-ab0f0b929494 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:57.324647 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f2c8bb1a-73de-412f-8352-ab0f0b929494 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:57.333043 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f2c8bb1a-73de-412f-8352-ab0f0b929494 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078521 Nov 02 23:31:57.333539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2007/2582] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:31:57 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:31:58.251776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c70f0387-9d1f-4eb8-9af3-5afaab66a65a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:31:58.252528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c70f0387-9d1f-4eb8-9af3-5afaab66a65a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:31:58.258583 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c70f0387-9d1f-4eb8-9af3-5afaab66a65a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:58.259065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c70f0387-9d1f-4eb8-9af3-5afaab66a65a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:58.259823 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c70f0387-9d1f-4eb8-9af3-5afaab66a65a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:58.260258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c70f0387-9d1f-4eb8-9af3-5afaab66a65a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:58.386462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c70f0387-9d1f-4eb8-9af3-5afaab66a65a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:58.394525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c70f0387-9d1f-4eb8-9af3-5afaab66a65a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:58.396029 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c70f0387-9d1f-4eb8-9af3-5afaab66a65a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:58.397103 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c70f0387-9d1f-4eb8-9af3-5afaab66a65a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f" status: 200 len: 1407 microversion: 2.20 time: 0.149029 Nov 02 23:31:58.397657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2008/2583] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:31:58 2021] GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:31:58.401896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f727bfa9-94a9-4505-b345-6a2aff14459e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:31:58.402482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f727bfa9-94a9-4505-b345-6a2aff14459e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:31:58.407783 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f727bfa9-94a9-4505-b345-6a2aff14459e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:58.408876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f727bfa9-94a9-4505-b345-6a2aff14459e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:58.409628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f727bfa9-94a9-4505-b345-6a2aff14459e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:58.410054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f727bfa9-94a9-4505-b345-6a2aff14459e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:58.468615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f727bfa9-94a9-4505-b345-6a2aff14459e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:58.477586 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f727bfa9-94a9-4505-b345-6a2aff14459e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078956 Nov 02 23:31:58.478149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2009/2584] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:31:58 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:31:59.414493 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-85a1f731-5a03-40b0-8e15-8da07dcbb838 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:31:59.415168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-85a1f731-5a03-40b0-8e15-8da07dcbb838 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:31:59.421277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85a1f731-5a03-40b0-8e15-8da07dcbb838 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:59.421715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85a1f731-5a03-40b0-8e15-8da07dcbb838 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:59.422464 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85a1f731-5a03-40b0-8e15-8da07dcbb838 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:59.422889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85a1f731-5a03-40b0-8e15-8da07dcbb838 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:59.555963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-85a1f731-5a03-40b0-8e15-8da07dcbb838 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:59.565366 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-85a1f731-5a03-40b0-8e15-8da07dcbb838 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:59.567359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-85a1f731-5a03-40b0-8e15-8da07dcbb838 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:59.568562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-85a1f731-5a03-40b0-8e15-8da07dcbb838 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f" status: 200 len: 1407 microversion: 2.20 time: 0.157794 Nov 02 23:31:59.569122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2010/2585] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:31:59 2021] GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:31:59.573440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-51747c08-4deb-4e2a-9460-4ce5e351cbfb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:31:59.574032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-51747c08-4deb-4e2a-9460-4ce5e351cbfb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:31:59.579919 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-51747c08-4deb-4e2a-9460-4ce5e351cbfb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:59.580357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-51747c08-4deb-4e2a-9460-4ce5e351cbfb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:59.581148 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-51747c08-4deb-4e2a-9460-4ce5e351cbfb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:31:59.581557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-51747c08-4deb-4e2a-9460-4ce5e351cbfb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:31:59.641658 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-51747c08-4deb-4e2a-9460-4ce5e351cbfb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:31:59.652334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-51747c08-4deb-4e2a-9460-4ce5e351cbfb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082204 Nov 02 23:31:59.652915 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2011/2586] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:31:59 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:32:00.586596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9c874ea1-049f-4369-aba7-c94644b5a710 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:00.587305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9c874ea1-049f-4369-aba7-c94644b5a710 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:00.593143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c874ea1-049f-4369-aba7-c94644b5a710 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:00.593575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c874ea1-049f-4369-aba7-c94644b5a710 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:00.594325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c874ea1-049f-4369-aba7-c94644b5a710 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:00.594747 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c874ea1-049f-4369-aba7-c94644b5a710 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:00.724699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9c874ea1-049f-4369-aba7-c94644b5a710 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:00.732302 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9c874ea1-049f-4369-aba7-c94644b5a710 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:00.733779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9c874ea1-049f-4369-aba7-c94644b5a710 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:00.734860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9c874ea1-049f-4369-aba7-c94644b5a710 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f" status: 200 len: 1407 microversion: 2.20 time: 0.152477 Nov 02 23:32:00.735445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2012/2587] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:32:00 2021] GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:32:00.739703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-45c42cdb-82a9-4b48-9b4e-fcd63900820a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:00.740260 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-45c42cdb-82a9-4b48-9b4e-fcd63900820a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:00.745919 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45c42cdb-82a9-4b48-9b4e-fcd63900820a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:00.746360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45c42cdb-82a9-4b48-9b4e-fcd63900820a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:00.747151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45c42cdb-82a9-4b48-9b4e-fcd63900820a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:00.747590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45c42cdb-82a9-4b48-9b4e-fcd63900820a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:00.815524 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-45c42cdb-82a9-4b48-9b4e-fcd63900820a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:00.823719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-45c42cdb-82a9-4b48-9b4e-fcd63900820a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.087264 Nov 02 23:32:00.824311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2013/2588] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:00 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:32:00.985341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-68a20b5b-b852-4e60-8e41-e5bdab9b936e req-b83f2ff4-a2fc-4709-ad95-9fa2c83d3a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef96c6ca-e054-45d7-b346-b5af72ea945f", "name": "network-vif-plugged", "status": "completed", "tag": "ee913c35-64a5-482c-a3a7-9a8299f45bd3"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:00.987143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:32:00.987143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:32:00.994211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-68a20b5b-b852-4e60-8e41-e5bdab9b936e req-b83f2ff4-a2fc-4709-ad95-9fa2c83d3a92 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:00.994651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-68a20b5b-b852-4e60-8e41-e5bdab9b936e req-b83f2ff4-a2fc-4709-ad95-9fa2c83d3a92 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:01.006668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-68a20b5b-b852-4e60-8e41-e5bdab9b936e req-b83f2ff4-a2fc-4709-ad95-9fa2c83d3a92 service nova] Creating event network-vif-plugged:ee913c35-64a5-482c-a3a7-9a8299f45bd3 for instance ef96c6ca-e054-45d7-b346-b5af72ea945f on hv-cinder-81584 Nov 02 23:32:01.011820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-68a20b5b-b852-4e60-8e41-e5bdab9b936e req-b83f2ff4-a2fc-4709-ad95-9fa2c83d3a92 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090332 Nov 02 23:32:01.012508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2014/2589] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:32:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:32:01.753266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2d6da7a2-8892-4bb4-8cd9-b203b89abb14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:01.753982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2d6da7a2-8892-4bb4-8cd9-b203b89abb14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:01.760003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d6da7a2-8892-4bb4-8cd9-b203b89abb14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:01.760443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d6da7a2-8892-4bb4-8cd9-b203b89abb14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:01.761198 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d6da7a2-8892-4bb4-8cd9-b203b89abb14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:01.761627 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d6da7a2-8892-4bb4-8cd9-b203b89abb14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:01.890869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2d6da7a2-8892-4bb4-8cd9-b203b89abb14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:01.899054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2d6da7a2-8892-4bb4-8cd9-b203b89abb14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:01.900529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2d6da7a2-8892-4bb4-8cd9-b203b89abb14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:01.901602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2d6da7a2-8892-4bb4-8cd9-b203b89abb14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f" status: 200 len: 1407 microversion: 2.20 time: 0.152810 Nov 02 23:32:01.902148 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2015/2590] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:32:01 2021] GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:32:01.906274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-450645f0-196b-4477-9efe-efff9236f366 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:01.906857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-450645f0-196b-4477-9efe-efff9236f366 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:01.912931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-450645f0-196b-4477-9efe-efff9236f366 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:01.913371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-450645f0-196b-4477-9efe-efff9236f366 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:01.914121 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-450645f0-196b-4477-9efe-efff9236f366 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:01.914544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-450645f0-196b-4477-9efe-efff9236f366 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:01.972074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-450645f0-196b-4477-9efe-efff9236f366 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:01.979550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-450645f0-196b-4477-9efe-efff9236f366 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.076458 Nov 02 23:32:01.980177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2016/2591] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:01 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:32:02.919965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bba9213a-2f33-4b64-9630-da48239a2695 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:02.920658 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bba9213a-2f33-4b64-9630-da48239a2695 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:02.929500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bba9213a-2f33-4b64-9630-da48239a2695 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:02.929948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bba9213a-2f33-4b64-9630-da48239a2695 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:02.930726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bba9213a-2f33-4b64-9630-da48239a2695 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:02.931194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bba9213a-2f33-4b64-9630-da48239a2695 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:03.072490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bba9213a-2f33-4b64-9630-da48239a2695 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:03.080415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bba9213a-2f33-4b64-9630-da48239a2695 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:03.081900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bba9213a-2f33-4b64-9630-da48239a2695 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:03.083077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bba9213a-2f33-4b64-9630-da48239a2695 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f" status: 200 len: 1599 microversion: 2.20 time: 0.166909 Nov 02 23:32:03.083630 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2017/2592] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:32:02 2021] GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:32:03.087851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-53b88899-87fa-4b8d-92a3-fffe810a1bd2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:03.088450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-53b88899-87fa-4b8d-92a3-fffe810a1bd2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:03.094533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53b88899-87fa-4b8d-92a3-fffe810a1bd2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:03.095010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53b88899-87fa-4b8d-92a3-fffe810a1bd2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:03.095798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53b88899-87fa-4b8d-92a3-fffe810a1bd2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:03.096230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53b88899-87fa-4b8d-92a3-fffe810a1bd2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:03.156814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-53b88899-87fa-4b8d-92a3-fffe810a1bd2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:03.165248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-53b88899-87fa-4b8d-92a3-fffe810a1bd2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080638 Nov 02 23:32:03.165821 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2018/2593] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:03 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:32:03.170236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e99fb067-7dd3-4d6c-afad-b652eb919bf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:03.170721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e99fb067-7dd3-4d6c-afad-b652eb919bf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:03.180847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e99fb067-7dd3-4d6c-afad-b652eb919bf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:03.181506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e99fb067-7dd3-4d6c-afad-b652eb919bf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:03.182755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e99fb067-7dd3-4d6c-afad-b652eb919bf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:03.183602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e99fb067-7dd3-4d6c-afad-b652eb919bf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:03.285271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e99fb067-7dd3-4d6c-afad-b652eb919bf2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.117775 Nov 02 23:32:03.285880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2019/2594] 10.222.0.41 () {60 vars in 1315 bytes} [Tue Nov 2 23:32:03 2021] GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:32:04.184618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-55f5472d-997c-47df-95af-44cfca1a4620 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:04.185672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-55f5472d-997c-47df-95af-44cfca1a4620 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:04.192358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55f5472d-997c-47df-95af-44cfca1a4620 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:04.192793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55f5472d-997c-47df-95af-44cfca1a4620 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:04.193570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55f5472d-997c-47df-95af-44cfca1a4620 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:04.193994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55f5472d-997c-47df-95af-44cfca1a4620 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:04.426551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-55f5472d-997c-47df-95af-44cfca1a4620 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:04.434621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-55f5472d-997c-47df-95af-44cfca1a4620 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.254368 Nov 02 23:32:04.435323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2020/2595] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:04 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:04.483370 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-177d2e8f-2004-4edd-a9fe-32dc29b2ebb9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:04.484333 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-177d2e8f-2004-4edd-a9fe-32dc29b2ebb9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:04.491173 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-177d2e8f-2004-4edd-a9fe-32dc29b2ebb9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:04.491582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-177d2e8f-2004-4edd-a9fe-32dc29b2ebb9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:04.492338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-177d2e8f-2004-4edd-a9fe-32dc29b2ebb9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:04.492761 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-177d2e8f-2004-4edd-a9fe-32dc29b2ebb9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:04.579091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-177d2e8f-2004-4edd-a9fe-32dc29b2ebb9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 14 microversion: 2.20 time: 0.099261 Nov 02 23:32:04.582627 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2021/2596] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:04 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:04.584760 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-2e05e577-860b-4db0-b47f-831321128da3 req-89b578cf-9acc-4ef7-871d-b8be964f639a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef96c6ca-e054-45d7-b346-b5af72ea945f", "tag": "ee913c35-64a5-482c-a3a7-9a8299f45bd3"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:04.586220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:32:04.586220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:32:04.593991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-2e05e577-860b-4db0-b47f-831321128da3 req-89b578cf-9acc-4ef7-871d-b8be964f639a service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:04.594430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-2e05e577-860b-4db0-b47f-831321128da3 req-89b578cf-9acc-4ef7-871d-b8be964f639a service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:04.605672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-2e05e577-860b-4db0-b47f-831321128da3 req-89b578cf-9acc-4ef7-871d-b8be964f639a service nova] Creating event network-changed:ee913c35-64a5-482c-a3a7-9a8299f45bd3 for instance ef96c6ca-e054-45d7-b346-b5af72ea945f on hv-cinder-81584 Nov 02 23:32:04.610463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-2e05e577-860b-4db0-b47f-831321128da3 req-89b578cf-9acc-4ef7-871d-b8be964f639a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029365 Nov 02 23:32:04.611255 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2022/2597] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:32:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:32:05.452510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4a5be8e6-abad-425d-ae01-b5678d7cf63e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:05.453209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4a5be8e6-abad-425d-ae01-b5678d7cf63e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:05.459722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a5be8e6-abad-425d-ae01-b5678d7cf63e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:05.460162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a5be8e6-abad-425d-ae01-b5678d7cf63e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:05.460917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a5be8e6-abad-425d-ae01-b5678d7cf63e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:05.461346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a5be8e6-abad-425d-ae01-b5678d7cf63e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:05.531848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4a5be8e6-abad-425d-ae01-b5678d7cf63e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:05.547116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4a5be8e6-abad-425d-ae01-b5678d7cf63e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.098616 Nov 02 23:32:05.548179 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2023/2598] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:05 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:05.589760 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-81266823-87e9-4a7a-a87d-955e6b707681 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:05.590682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-81266823-87e9-4a7a-a87d-955e6b707681 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:05.597239 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81266823-87e9-4a7a-a87d-955e6b707681 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:05.597686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81266823-87e9-4a7a-a87d-955e6b707681 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:05.598460 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81266823-87e9-4a7a-a87d-955e6b707681 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:05.598908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81266823-87e9-4a7a-a87d-955e6b707681 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:05.686896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-81266823-87e9-4a7a-a87d-955e6b707681 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 14 microversion: 2.20 time: 0.100302 Nov 02 23:32:05.690035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2024/2599] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:05 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:32:06.572779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-517d9a4d-a2f2-4e83-837f-885503b2b138 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:06.573454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-517d9a4d-a2f2-4e83-837f-885503b2b138 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:06.580251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-517d9a4d-a2f2-4e83-837f-885503b2b138 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:06.580699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-517d9a4d-a2f2-4e83-837f-885503b2b138 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:06.581942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-517d9a4d-a2f2-4e83-837f-885503b2b138 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:06.582368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-517d9a4d-a2f2-4e83-837f-885503b2b138 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:06.641537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-517d9a4d-a2f2-4e83-837f-885503b2b138 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:06.650175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-517d9a4d-a2f2-4e83-837f-885503b2b138 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081403 Nov 02 23:32:06.650734 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2025/2600] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:06 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:06.698686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7911de09-03dd-45c4-8df0-58590cb79c27 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:06.699899 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7911de09-03dd-45c4-8df0-58590cb79c27 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:06.710850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7911de09-03dd-45c4-8df0-58590cb79c27 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:06.711333 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7911de09-03dd-45c4-8df0-58590cb79c27 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:06.712117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7911de09-03dd-45c4-8df0-58590cb79c27 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:06.712575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7911de09-03dd-45c4-8df0-58590cb79c27 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:06.795750 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7911de09-03dd-45c4-8df0-58590cb79c27 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 14 microversion: 2.20 time: 0.100595 Nov 02 23:32:06.796719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2026/2601] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:06 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:07.668244 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-27133b5e-f415-4a38-9a7a-1926a9fadeb5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:07.668978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-27133b5e-f415-4a38-9a7a-1926a9fadeb5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:07.676383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27133b5e-f415-4a38-9a7a-1926a9fadeb5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:07.676827 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27133b5e-f415-4a38-9a7a-1926a9fadeb5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:07.677588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27133b5e-f415-4a38-9a7a-1926a9fadeb5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:07.678019 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27133b5e-f415-4a38-9a7a-1926a9fadeb5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:07.738252 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-27133b5e-f415-4a38-9a7a-1926a9fadeb5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:07.749230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-27133b5e-f415-4a38-9a7a-1926a9fadeb5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.084972 Nov 02 23:32:07.749811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2027/2602] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:07 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:07.806400 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3c57b051-e6c7-461c-863e-2aaa0b9bcb69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:07.807322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3c57b051-e6c7-461c-863e-2aaa0b9bcb69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:07.813812 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c57b051-e6c7-461c-863e-2aaa0b9bcb69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:07.814242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c57b051-e6c7-461c-863e-2aaa0b9bcb69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:07.815027 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c57b051-e6c7-461c-863e-2aaa0b9bcb69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:07.815464 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c57b051-e6c7-461c-863e-2aaa0b9bcb69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:07.901632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3c57b051-e6c7-461c-863e-2aaa0b9bcb69 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 14 microversion: 2.20 time: 0.098565 Nov 02 23:32:07.902281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2028/2603] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:07 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:08.766211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fdade49c-0348-4c5e-b663-13f6b05d0f10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:08.766970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fdade49c-0348-4c5e-b663-13f6b05d0f10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:08.774214 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fdade49c-0348-4c5e-b663-13f6b05d0f10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:08.774657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fdade49c-0348-4c5e-b663-13f6b05d0f10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:08.775454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fdade49c-0348-4c5e-b663-13f6b05d0f10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:08.775888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fdade49c-0348-4c5e-b663-13f6b05d0f10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:08.835522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fdade49c-0348-4c5e-b663-13f6b05d0f10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:08.843600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fdade49c-0348-4c5e-b663-13f6b05d0f10 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081444 Nov 02 23:32:08.844162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2029/2604] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:08 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:08.912799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bec47272-bc94-4d0a-b600-dd87114c78c8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:08.913700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bec47272-bc94-4d0a-b600-dd87114c78c8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:08.919813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bec47272-bc94-4d0a-b600-dd87114c78c8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:08.920254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bec47272-bc94-4d0a-b600-dd87114c78c8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:08.921008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bec47272-bc94-4d0a-b600-dd87114c78c8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:08.921433 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bec47272-bc94-4d0a-b600-dd87114c78c8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:09.012970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bec47272-bc94-4d0a-b600-dd87114c78c8 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 14 microversion: 2.20 time: 0.104117 Nov 02 23:32:09.013609 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2030/2605] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:08 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:09.861777 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5d0be658-3f28-4567-a29c-04b55ce5d416 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:09.863060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5d0be658-3f28-4567-a29c-04b55ce5d416 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:09.870017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d0be658-3f28-4567-a29c-04b55ce5d416 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:09.870460 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d0be658-3f28-4567-a29c-04b55ce5d416 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:09.871250 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d0be658-3f28-4567-a29c-04b55ce5d416 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:09.871724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d0be658-3f28-4567-a29c-04b55ce5d416 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:09.932372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5d0be658-3f28-4567-a29c-04b55ce5d416 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:09.940743 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5d0be658-3f28-4567-a29c-04b55ce5d416 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082976 Nov 02 23:32:09.941298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2031/2606] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:09 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:10.023239 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9d2b1c35-46ac-4474-8247-557ab7ee82cc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:10.024142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9d2b1c35-46ac-4474-8247-557ab7ee82cc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:10.030257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d2b1c35-46ac-4474-8247-557ab7ee82cc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:10.030717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d2b1c35-46ac-4474-8247-557ab7ee82cc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:10.031504 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d2b1c35-46ac-4474-8247-557ab7ee82cc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:10.031932 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d2b1c35-46ac-4474-8247-557ab7ee82cc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:10.117329 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9d2b1c35-46ac-4474-8247-557ab7ee82cc tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 14 microversion: 2.20 time: 0.097369 Nov 02 23:32:10.117910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2032/2607] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:10 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:10.957410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8daa3d31-ff29-4c75-a14d-2217f4254759 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:10.958128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8daa3d31-ff29-4c75-a14d-2217f4254759 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:10.965058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8daa3d31-ff29-4c75-a14d-2217f4254759 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:10.965505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8daa3d31-ff29-4c75-a14d-2217f4254759 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:10.966273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8daa3d31-ff29-4c75-a14d-2217f4254759 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:10.966700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8daa3d31-ff29-4c75-a14d-2217f4254759 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:11.029156 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8daa3d31-ff29-4c75-a14d-2217f4254759 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:11.037401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8daa3d31-ff29-4c75-a14d-2217f4254759 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.084001 Nov 02 23:32:11.037967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2033/2608] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:10 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:11.129652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-21531227-b473-4c0a-82ce-3813d37f216c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:11.130575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-21531227-b473-4c0a-82ce-3813d37f216c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:11.136969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21531227-b473-4c0a-82ce-3813d37f216c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:11.137409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21531227-b473-4c0a-82ce-3813d37f216c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:11.138161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21531227-b473-4c0a-82ce-3813d37f216c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:11.138585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21531227-b473-4c0a-82ce-3813d37f216c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:11.219961 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-21531227-b473-4c0a-82ce-3813d37f216c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 14 microversion: 2.20 time: 0.094392 Nov 02 23:32:11.220613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2034/2609] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:11 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:12.055364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-508f90a0-9ca3-4ae3-8f41-5d1c89659709 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:12.056077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-508f90a0-9ca3-4ae3-8f41-5d1c89659709 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:12.063340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-508f90a0-9ca3-4ae3-8f41-5d1c89659709 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:12.063782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-508f90a0-9ca3-4ae3-8f41-5d1c89659709 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:12.064549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-508f90a0-9ca3-4ae3-8f41-5d1c89659709 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:12.064979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-508f90a0-9ca3-4ae3-8f41-5d1c89659709 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:12.130847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-508f90a0-9ca3-4ae3-8f41-5d1c89659709 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:12.139486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-508f90a0-9ca3-4ae3-8f41-5d1c89659709 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.088151 Nov 02 23:32:12.140064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2035/2610] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:12 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:12.231190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-21ac893f-3f5e-4693-a30d-09b422e13e62 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:12.232106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-21ac893f-3f5e-4693-a30d-09b422e13e62 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:12.239338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21ac893f-3f5e-4693-a30d-09b422e13e62 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:12.239338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21ac893f-3f5e-4693-a30d-09b422e13e62 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:12.240084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21ac893f-3f5e-4693-a30d-09b422e13e62 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:12.240515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21ac893f-3f5e-4693-a30d-09b422e13e62 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:12.333589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-21ac893f-3f5e-4693-a30d-09b422e13e62 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 14 microversion: 2.20 time: 0.105939 Nov 02 23:32:12.334162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2036/2611] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:12 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:13.157318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-06ba67f7-fe80-420d-a0dd-dbe5e801a77d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:13.158022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-06ba67f7-fe80-420d-a0dd-dbe5e801a77d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:13.165707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06ba67f7-fe80-420d-a0dd-dbe5e801a77d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:13.166152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06ba67f7-fe80-420d-a0dd-dbe5e801a77d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:13.166935 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06ba67f7-fe80-420d-a0dd-dbe5e801a77d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:13.167378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06ba67f7-fe80-420d-a0dd-dbe5e801a77d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:13.227782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-06ba67f7-fe80-420d-a0dd-dbe5e801a77d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:13.235879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-06ba67f7-fe80-420d-a0dd-dbe5e801a77d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082628 Nov 02 23:32:13.236445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2037/2612] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:13 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:13.344175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a7836e0b-cb7a-4fef-93b2-6aed06417351 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:13.345064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a7836e0b-cb7a-4fef-93b2-6aed06417351 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:13.351921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a7836e0b-cb7a-4fef-93b2-6aed06417351 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:13.352355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a7836e0b-cb7a-4fef-93b2-6aed06417351 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:13.353107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a7836e0b-cb7a-4fef-93b2-6aed06417351 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:13.353535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a7836e0b-cb7a-4fef-93b2-6aed06417351 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:13.441994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a7836e0b-cb7a-4fef-93b2-6aed06417351 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 14 microversion: 2.20 time: 0.100639 Nov 02 23:32:13.442511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2038/2613] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:13 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:14.252169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d105597e-21c7-4724-8785-1b23b6c4a387 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:14.252849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d105597e-21c7-4724-8785-1b23b6c4a387 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:14.260001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d105597e-21c7-4724-8785-1b23b6c4a387 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:14.260444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d105597e-21c7-4724-8785-1b23b6c4a387 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:14.261217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d105597e-21c7-4724-8785-1b23b6c4a387 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:14.261672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d105597e-21c7-4724-8785-1b23b6c4a387 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:14.323848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d105597e-21c7-4724-8785-1b23b6c4a387 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:14.332267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d105597e-21c7-4724-8785-1b23b6c4a387 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.084124 Nov 02 23:32:14.332830 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2039/2614] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:14 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:14.452959 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-daeb4a32-67da-4ef1-888a-212277c7b30a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:14.453873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-daeb4a32-67da-4ef1-888a-212277c7b30a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:14.460391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-daeb4a32-67da-4ef1-888a-212277c7b30a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:14.460772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-daeb4a32-67da-4ef1-888a-212277c7b30a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:14.461539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-daeb4a32-67da-4ef1-888a-212277c7b30a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:14.461970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-daeb4a32-67da-4ef1-888a-212277c7b30a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:14.551189 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-daeb4a32-67da-4ef1-888a-212277c7b30a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 14 microversion: 2.20 time: 0.101760 Nov 02 23:32:14.551807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2040/2615] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:14 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:32:15.397891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2a2af67d-4e4c-4c03-800b-ddf2ae19a33d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:15.398624 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2a2af67d-4e4c-4c03-800b-ddf2ae19a33d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:15.405608 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a2af67d-4e4c-4c03-800b-ddf2ae19a33d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:15.406045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a2af67d-4e4c-4c03-800b-ddf2ae19a33d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:15.406810 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a2af67d-4e4c-4c03-800b-ddf2ae19a33d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:15.407262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a2af67d-4e4c-4c03-800b-ddf2ae19a33d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:15.467314 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2a2af67d-4e4c-4c03-800b-ddf2ae19a33d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:15.475072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2a2af67d-4e4c-4c03-800b-ddf2ae19a33d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.129461 Nov 02 23:32:15.475664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2041/2616] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:15 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:15.561688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-26b2c34b-41a5-4fea-a71a-2256ba133f8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:15.562965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-26b2c34b-41a5-4fea-a71a-2256ba133f8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:15.570332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26b2c34b-41a5-4fea-a71a-2256ba133f8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:15.570777 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26b2c34b-41a5-4fea-a71a-2256ba133f8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:15.571578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26b2c34b-41a5-4fea-a71a-2256ba133f8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:15.572004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26b2c34b-41a5-4fea-a71a-2256ba133f8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:15.665976 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-26b2c34b-41a5-4fea-a71a-2256ba133f8f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 12758 microversion: 2.20 time: 0.107689 Nov 02 23:32:15.666544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2042/2617] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:15 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 12758 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:16.492234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7ac3c1a3-db71-45ed-bc08-9de140742e82 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:16.492951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7ac3c1a3-db71-45ed-bc08-9de140742e82 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:16.500356 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ac3c1a3-db71-45ed-bc08-9de140742e82 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:16.500943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ac3c1a3-db71-45ed-bc08-9de140742e82 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:16.501767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ac3c1a3-db71-45ed-bc08-9de140742e82 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:16.502237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ac3c1a3-db71-45ed-bc08-9de140742e82 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:16.566983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7ac3c1a3-db71-45ed-bc08-9de140742e82 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:16.575632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7ac3c1a3-db71-45ed-bc08-9de140742e82 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.087288 Nov 02 23:32:16.576210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2043/2618] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:16 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:16.676862 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fa27ca52-94d2-474d-a20b-e9bcb1ee4362 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:16.677775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fa27ca52-94d2-474d-a20b-e9bcb1ee4362 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:16.684230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fa27ca52-94d2-474d-a20b-e9bcb1ee4362 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:16.684679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fa27ca52-94d2-474d-a20b-e9bcb1ee4362 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:16.685473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fa27ca52-94d2-474d-a20b-e9bcb1ee4362 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:16.685904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fa27ca52-94d2-474d-a20b-e9bcb1ee4362 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:16.784399 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fa27ca52-94d2-474d-a20b-e9bcb1ee4362 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 18449 microversion: 2.20 time: 0.111087 Nov 02 23:32:16.784961 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2044/2619] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:16 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 18449 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:17.592991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c6779969-5106-4a40-92da-b368ce45d249 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:17.593731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c6779969-5106-4a40-92da-b368ce45d249 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:17.603208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6779969-5106-4a40-92da-b368ce45d249 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:17.603651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6779969-5106-4a40-92da-b368ce45d249 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:17.604435 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6779969-5106-4a40-92da-b368ce45d249 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:17.604856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6779969-5106-4a40-92da-b368ce45d249 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:17.670658 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c6779969-5106-4a40-92da-b368ce45d249 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:17.679243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c6779969-5106-4a40-92da-b368ce45d249 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.090310 Nov 02 23:32:17.679825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2045/2620] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:17 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:17.796863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-33a8d64f-d673-4407-9ff8-044fa8655cf4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:17.797784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-33a8d64f-d673-4407-9ff8-044fa8655cf4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:17.804438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-33a8d64f-d673-4407-9ff8-044fa8655cf4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:17.804886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-33a8d64f-d673-4407-9ff8-044fa8655cf4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:17.805673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-33a8d64f-d673-4407-9ff8-044fa8655cf4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:17.806108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-33a8d64f-d673-4407-9ff8-044fa8655cf4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:17.904077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-33a8d64f-d673-4407-9ff8-044fa8655cf4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 19342 microversion: 2.20 time: 0.110639 Nov 02 23:32:17.904650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2046/2621] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:17 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 19342 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:18.699352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-69dd81fe-70dc-4738-b084-d624bbd41092 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:18.700077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-69dd81fe-70dc-4738-b084-d624bbd41092 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:18.707181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-69dd81fe-70dc-4738-b084-d624bbd41092 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:18.707629 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-69dd81fe-70dc-4738-b084-d624bbd41092 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:18.708422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-69dd81fe-70dc-4738-b084-d624bbd41092 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:18.708854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-69dd81fe-70dc-4738-b084-d624bbd41092 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:18.775522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-69dd81fe-70dc-4738-b084-d624bbd41092 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:18.783897 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-69dd81fe-70dc-4738-b084-d624bbd41092 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.088606 Nov 02 23:32:18.784479 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2047/2622] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:18 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:18.917437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-62956ab4-6ea8-4347-b378-1ae3f2754650 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:18.918355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-62956ab4-6ea8-4347-b378-1ae3f2754650 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:18.924709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-62956ab4-6ea8-4347-b378-1ae3f2754650 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:18.925154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-62956ab4-6ea8-4347-b378-1ae3f2754650 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:18.926524 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-62956ab4-6ea8-4347-b378-1ae3f2754650 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:18.926987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-62956ab4-6ea8-4347-b378-1ae3f2754650 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:19.021935 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-62956ab4-6ea8-4347-b378-1ae3f2754650 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 22070 microversion: 2.20 time: 0.108048 Nov 02 23:32:19.022592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2048/2623] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:18 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 22070 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:19.803912 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ad51731a-8153-4487-94ea-087cb1da5c30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:19.804689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ad51731a-8153-4487-94ea-087cb1da5c30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:19.811887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad51731a-8153-4487-94ea-087cb1da5c30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:19.812348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad51731a-8153-4487-94ea-087cb1da5c30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:19.813436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad51731a-8153-4487-94ea-087cb1da5c30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:19.813868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad51731a-8153-4487-94ea-087cb1da5c30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:19.879889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ad51731a-8153-4487-94ea-087cb1da5c30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:19.890991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ad51731a-8153-4487-94ea-087cb1da5c30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.091628 Nov 02 23:32:19.891579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2049/2624] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:19 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:20.036809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-297022f1-3241-4e69-86a5-8b7e02ceac6b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:20.038400 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-297022f1-3241-4e69-86a5-8b7e02ceac6b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:20.046890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-297022f1-3241-4e69-86a5-8b7e02ceac6b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:20.047374 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-297022f1-3241-4e69-86a5-8b7e02ceac6b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:20.048161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-297022f1-3241-4e69-86a5-8b7e02ceac6b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:20.048593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-297022f1-3241-4e69-86a5-8b7e02ceac6b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:20.155237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-297022f1-3241-4e69-86a5-8b7e02ceac6b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 23235 microversion: 2.20 time: 0.124632 Nov 02 23:32:20.155817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2050/2625] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:20 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 23235 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:20.908118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4eda5990-be33-4ec5-ad2b-27b8e087dc3c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:20.909001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4eda5990-be33-4ec5-ad2b-27b8e087dc3c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:20.916518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4eda5990-be33-4ec5-ad2b-27b8e087dc3c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:20.916968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4eda5990-be33-4ec5-ad2b-27b8e087dc3c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:20.917787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4eda5990-be33-4ec5-ad2b-27b8e087dc3c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:20.918221 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4eda5990-be33-4ec5-ad2b-27b8e087dc3c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:20.985500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4eda5990-be33-4ec5-ad2b-27b8e087dc3c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:20.997674 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4eda5990-be33-4ec5-ad2b-27b8e087dc3c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.093784 Nov 02 23:32:20.998256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2051/2626] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:20 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:21.167230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6ee080a2-c8f5-40ec-a6cc-a9b149e37c84 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:21.168059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6ee080a2-c8f5-40ec-a6cc-a9b149e37c84 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:21.174320 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ee080a2-c8f5-40ec-a6cc-a9b149e37c84 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:21.174756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ee080a2-c8f5-40ec-a6cc-a9b149e37c84 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:21.175550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ee080a2-c8f5-40ec-a6cc-a9b149e37c84 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:21.175973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6ee080a2-c8f5-40ec-a6cc-a9b149e37c84 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:21.306676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6ee080a2-c8f5-40ec-a6cc-a9b149e37c84 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 24917 microversion: 2.20 time: 0.143112 Nov 02 23:32:21.307369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2052/2627] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:21 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 24917 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:22.015173 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ad5da542-eee9-4494-94bd-d54c7f371796 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:22.015901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ad5da542-eee9-4494-94bd-d54c7f371796 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:22.023622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad5da542-eee9-4494-94bd-d54c7f371796 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:22.024065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad5da542-eee9-4494-94bd-d54c7f371796 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:22.024847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad5da542-eee9-4494-94bd-d54c7f371796 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:22.025280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ad5da542-eee9-4494-94bd-d54c7f371796 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:22.089107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ad5da542-eee9-4494-94bd-d54c7f371796 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:22.098057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ad5da542-eee9-4494-94bd-d54c7f371796 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.086300 Nov 02 23:32:22.098638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2053/2628] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:22 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:22.318123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2b57198e-3661-4a71-8754-3b578d1cf51d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:22.319015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2b57198e-3661-4a71-8754-3b578d1cf51d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:22.325897 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b57198e-3661-4a71-8754-3b578d1cf51d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:22.326342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b57198e-3661-4a71-8754-3b578d1cf51d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:22.327155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b57198e-3661-4a71-8754-3b578d1cf51d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:22.327582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b57198e-3661-4a71-8754-3b578d1cf51d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:22.434540 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2b57198e-3661-4a71-8754-3b578d1cf51d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 26527 microversion: 2.20 time: 0.120079 Nov 02 23:32:22.435381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2054/2629] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:22 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 26527 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:23.116187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5a18bab5-cf51-4334-90b6-d7ac64a3b768 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:23.116973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5a18bab5-cf51-4334-90b6-d7ac64a3b768 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:23.123917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a18bab5-cf51-4334-90b6-d7ac64a3b768 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:23.124361 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a18bab5-cf51-4334-90b6-d7ac64a3b768 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:23.125137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a18bab5-cf51-4334-90b6-d7ac64a3b768 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:23.125569 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a18bab5-cf51-4334-90b6-d7ac64a3b768 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:23.189639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5a18bab5-cf51-4334-90b6-d7ac64a3b768 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:23.198201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5a18bab5-cf51-4334-90b6-d7ac64a3b768 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.086502 Nov 02 23:32:23.198782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2055/2630] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:23 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:23.446350 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d6449d2e-82b3-498d-a80e-2799a4e52bb5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:23.447235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d6449d2e-82b3-498d-a80e-2799a4e52bb5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:23.454005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6449d2e-82b3-498d-a80e-2799a4e52bb5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:23.454543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6449d2e-82b3-498d-a80e-2799a4e52bb5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:23.455605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6449d2e-82b3-498d-a80e-2799a4e52bb5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:23.456092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6449d2e-82b3-498d-a80e-2799a4e52bb5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:23.592749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d6449d2e-82b3-498d-a80e-2799a4e52bb5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 27614 microversion: 2.20 time: 0.150309 Nov 02 23:32:23.593429 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2056/2631] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:23 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 27614 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:24.215327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-54d8b416-cf68-4d43-a3cb-90eaa916d0cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:24.216043 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-54d8b416-cf68-4d43-a3cb-90eaa916d0cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:24.223844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-54d8b416-cf68-4d43-a3cb-90eaa916d0cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:24.224296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-54d8b416-cf68-4d43-a3cb-90eaa916d0cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:24.225108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-54d8b416-cf68-4d43-a3cb-90eaa916d0cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:24.225564 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-54d8b416-cf68-4d43-a3cb-90eaa916d0cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:24.289420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-54d8b416-cf68-4d43-a3cb-90eaa916d0cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:24.297916 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-54d8b416-cf68-4d43-a3cb-90eaa916d0cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.086775 Nov 02 23:32:24.298501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2057/2632] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:24 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:32:24.683730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b787fa26-4282-49fe-83a1-e0b5dc606d60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:24.684635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b787fa26-4282-49fe-83a1-e0b5dc606d60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:24.690827 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b787fa26-4282-49fe-83a1-e0b5dc606d60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:24.692034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b787fa26-4282-49fe-83a1-e0b5dc606d60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:24.692810 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b787fa26-4282-49fe-83a1-e0b5dc606d60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:24.693246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b787fa26-4282-49fe-83a1-e0b5dc606d60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:24.798398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b787fa26-4282-49fe-83a1-e0b5dc606d60 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 27925 microversion: 2.20 time: 0.196997 Nov 02 23:32:24.799353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2058/2633] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:24 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 27925 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:32:25.315192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b7e47751-b8d2-4d12-ba5a-b0c3096a1226 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:25.315875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b7e47751-b8d2-4d12-ba5a-b0c3096a1226 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:25.322759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b7e47751-b8d2-4d12-ba5a-b0c3096a1226 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:25.323236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b7e47751-b8d2-4d12-ba5a-b0c3096a1226 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:25.324010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b7e47751-b8d2-4d12-ba5a-b0c3096a1226 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:25.324444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b7e47751-b8d2-4d12-ba5a-b0c3096a1226 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:25.389323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b7e47751-b8d2-4d12-ba5a-b0c3096a1226 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:25.398231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b7e47751-b8d2-4d12-ba5a-b0c3096a1226 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.087269 Nov 02 23:32:25.398799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2059/2634] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:25 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:25.810498 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7ef479a5-07f2-4d1d-af93-59f3af812f5c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:25.811466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7ef479a5-07f2-4d1d-af93-59f3af812f5c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:25.818447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ef479a5-07f2-4d1d-af93-59f3af812f5c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:25.818898 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ef479a5-07f2-4d1d-af93-59f3af812f5c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:25.819685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ef479a5-07f2-4d1d-af93-59f3af812f5c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:25.820116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ef479a5-07f2-4d1d-af93-59f3af812f5c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:25.924179 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7ef479a5-07f2-4d1d-af93-59f3af812f5c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28160 microversion: 2.20 time: 0.117216 Nov 02 23:32:25.924826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2060/2635] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:25 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28160 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:26.415302 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0981588d-85a8-4d92-b521-9b20fee1197d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:26.415987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0981588d-85a8-4d92-b521-9b20fee1197d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:26.422729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0981588d-85a8-4d92-b521-9b20fee1197d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:26.423197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0981588d-85a8-4d92-b521-9b20fee1197d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:26.423942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0981588d-85a8-4d92-b521-9b20fee1197d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:26.424366 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0981588d-85a8-4d92-b521-9b20fee1197d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:26.484086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0981588d-85a8-4d92-b521-9b20fee1197d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:26.492544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0981588d-85a8-4d92-b521-9b20fee1197d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081307 Nov 02 23:32:26.493097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2061/2636] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:26 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:26.935539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8bf3e869-d815-4bcf-9c02-629e51e54ddb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:26.936440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8bf3e869-d815-4bcf-9c02-629e51e54ddb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:26.942942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bf3e869-d815-4bcf-9c02-629e51e54ddb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:26.943398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bf3e869-d815-4bcf-9c02-629e51e54ddb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:26.944154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bf3e869-d815-4bcf-9c02-629e51e54ddb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:26.944606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bf3e869-d815-4bcf-9c02-629e51e54ddb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:27.034659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8bf3e869-d815-4bcf-9c02-629e51e54ddb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28160 microversion: 2.20 time: 0.102776 Nov 02 23:32:27.035652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2062/2637] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:26 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28160 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:27.509853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2ec357d8-1658-4a0a-bebe-5cad6e6f0e9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:27.510544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2ec357d8-1658-4a0a-bebe-5cad6e6f0e9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:27.517337 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ec357d8-1658-4a0a-bebe-5cad6e6f0e9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:27.517781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ec357d8-1658-4a0a-bebe-5cad6e6f0e9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:27.518538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ec357d8-1658-4a0a-bebe-5cad6e6f0e9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:27.518993 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ec357d8-1658-4a0a-bebe-5cad6e6f0e9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:27.579956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2ec357d8-1658-4a0a-bebe-5cad6e6f0e9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:27.588768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2ec357d8-1658-4a0a-bebe-5cad6e6f0e9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082853 Nov 02 23:32:27.589346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2063/2638] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:27 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:28.046698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e46a5201-d5e8-44c7-afac-52569b8df024 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:28.047632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e46a5201-d5e8-44c7-afac-52569b8df024 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:28.054896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e46a5201-d5e8-44c7-afac-52569b8df024 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:28.055292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e46a5201-d5e8-44c7-afac-52569b8df024 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:28.056066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e46a5201-d5e8-44c7-afac-52569b8df024 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:28.056500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e46a5201-d5e8-44c7-afac-52569b8df024 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:28.146334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e46a5201-d5e8-44c7-afac-52569b8df024 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28160 microversion: 2.20 time: 0.103296 Nov 02 23:32:28.147024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2064/2639] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:28 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28160 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:28.605930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5e9c7890-9a5f-46cf-83f7-c03e9807cee0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:28.606640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5e9c7890-9a5f-46cf-83f7-c03e9807cee0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:28.613705 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5e9c7890-9a5f-46cf-83f7-c03e9807cee0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:28.614158 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5e9c7890-9a5f-46cf-83f7-c03e9807cee0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:28.614953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5e9c7890-9a5f-46cf-83f7-c03e9807cee0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:28.615390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5e9c7890-9a5f-46cf-83f7-c03e9807cee0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:28.678039 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5e9c7890-9a5f-46cf-83f7-c03e9807cee0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:28.686766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5e9c7890-9a5f-46cf-83f7-c03e9807cee0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.084779 Nov 02 23:32:28.687374 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2065/2640] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:28 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:29.157425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-47ff06c7-5802-4367-86d8-2b3940e55d5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:29.159369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-47ff06c7-5802-4367-86d8-2b3940e55d5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:29.165769 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47ff06c7-5802-4367-86d8-2b3940e55d5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:29.166215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47ff06c7-5802-4367-86d8-2b3940e55d5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:29.167020 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47ff06c7-5802-4367-86d8-2b3940e55d5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:29.167452 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47ff06c7-5802-4367-86d8-2b3940e55d5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:29.274854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-47ff06c7-5802-4367-86d8-2b3940e55d5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28160 microversion: 2.20 time: 0.120908 Nov 02 23:32:29.275548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2066/2641] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:29 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28160 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:29.704214 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-87237987-aadd-4997-b0f5-8a3638581125 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:29.704917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-87237987-aadd-4997-b0f5-8a3638581125 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:29.711808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87237987-aadd-4997-b0f5-8a3638581125 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:29.712239 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87237987-aadd-4997-b0f5-8a3638581125 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:29.713000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87237987-aadd-4997-b0f5-8a3638581125 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:29.713434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87237987-aadd-4997-b0f5-8a3638581125 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:29.773218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-87237987-aadd-4997-b0f5-8a3638581125 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:29.781367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-87237987-aadd-4997-b0f5-8a3638581125 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081181 Nov 02 23:32:29.781933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2067/2642] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:29 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:30.286811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-700abb75-91e9-4621-82b1-e7a66659d1b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:30.287659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-700abb75-91e9-4621-82b1-e7a66659d1b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:30.293970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-700abb75-91e9-4621-82b1-e7a66659d1b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:30.294485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-700abb75-91e9-4621-82b1-e7a66659d1b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:30.295349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-700abb75-91e9-4621-82b1-e7a66659d1b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:30.295795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-700abb75-91e9-4621-82b1-e7a66659d1b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:30.386355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-700abb75-91e9-4621-82b1-e7a66659d1b5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28160 microversion: 2.20 time: 0.103127 Nov 02 23:32:30.387041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2068/2643] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:30 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28160 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:30.799161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-59dee2b2-1d1c-4f67-af5b-de31426a1807 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:30.799874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-59dee2b2-1d1c-4f67-af5b-de31426a1807 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:30.807399 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59dee2b2-1d1c-4f67-af5b-de31426a1807 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:30.807847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59dee2b2-1d1c-4f67-af5b-de31426a1807 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:30.808613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59dee2b2-1d1c-4f67-af5b-de31426a1807 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:30.809039 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-59dee2b2-1d1c-4f67-af5b-de31426a1807 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:30.876133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-59dee2b2-1d1c-4f67-af5b-de31426a1807 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:30.885355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-59dee2b2-1d1c-4f67-af5b-de31426a1807 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.090072 Nov 02 23:32:30.885951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2069/2644] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:30 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:31.398783 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6c458728-0b1c-4990-8a25-fad7015aea14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:31.399634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6c458728-0b1c-4990-8a25-fad7015aea14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:31.406140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c458728-0b1c-4990-8a25-fad7015aea14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:31.406582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c458728-0b1c-4990-8a25-fad7015aea14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:31.407389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c458728-0b1c-4990-8a25-fad7015aea14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:31.407815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6c458728-0b1c-4990-8a25-fad7015aea14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:31.503543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6c458728-0b1c-4990-8a25-fad7015aea14 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28160 microversion: 2.20 time: 0.108821 Nov 02 23:32:31.504219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2070/2645] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:31 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28160 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:31.902895 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2de2e741-1558-44ad-9ae4-520d72cbb6d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:31.903921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2de2e741-1558-44ad-9ae4-520d72cbb6d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:31.911431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2de2e741-1558-44ad-9ae4-520d72cbb6d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:31.912014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2de2e741-1558-44ad-9ae4-520d72cbb6d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:31.912911 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2de2e741-1558-44ad-9ae4-520d72cbb6d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:31.913443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2de2e741-1558-44ad-9ae4-520d72cbb6d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:31.981701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2de2e741-1558-44ad-9ae4-520d72cbb6d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:31.990482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2de2e741-1558-44ad-9ae4-520d72cbb6d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.091550 Nov 02 23:32:31.991087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2071/2646] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:31 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:32.515582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-30308797-e053-4a50-b190-8579b287d17e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:32.516486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-30308797-e053-4a50-b190-8579b287d17e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:32.522628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30308797-e053-4a50-b190-8579b287d17e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:32.523103 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30308797-e053-4a50-b190-8579b287d17e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:32.523859 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30308797-e053-4a50-b190-8579b287d17e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:32.524283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30308797-e053-4a50-b190-8579b287d17e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:32.615076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-30308797-e053-4a50-b190-8579b287d17e tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28160 microversion: 2.20 time: 0.102472 Nov 02 23:32:32.615744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2072/2647] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:32 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28160 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:33.008660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e7398697-6a27-4c00-890f-e704068636c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:33.009376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e7398697-6a27-4c00-890f-e704068636c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:33.016445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e7398697-6a27-4c00-890f-e704068636c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:33.016897 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e7398697-6a27-4c00-890f-e704068636c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:33.017676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e7398697-6a27-4c00-890f-e704068636c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:33.018114 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e7398697-6a27-4c00-890f-e704068636c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:33.082240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e7398697-6a27-4c00-890f-e704068636c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:33.091206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e7398697-6a27-4c00-890f-e704068636c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.086927 Nov 02 23:32:33.091778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2073/2648] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:33 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:33.627008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c1b7e50b-0d98-4377-8151-add47d7e37b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:33.627918 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c1b7e50b-0d98-4377-8151-add47d7e37b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:33.634713 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c1b7e50b-0d98-4377-8151-add47d7e37b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:33.635194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c1b7e50b-0d98-4377-8151-add47d7e37b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:33.635959 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c1b7e50b-0d98-4377-8151-add47d7e37b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:33.636414 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c1b7e50b-0d98-4377-8151-add47d7e37b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:33.734626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c1b7e50b-0d98-4377-8151-add47d7e37b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28160 microversion: 2.20 time: 0.111606 Nov 02 23:32:33.735320 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2074/2649] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:33 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28160 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:34.109241 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2079b536-df15-4296-ab1c-74a545a852ac tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:34.110001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2079b536-df15-4296-ab1c-74a545a852ac tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:34.117627 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2079b536-df15-4296-ab1c-74a545a852ac tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:34.118070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2079b536-df15-4296-ab1c-74a545a852ac tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:34.118846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2079b536-df15-4296-ab1c-74a545a852ac tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:34.119319 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2079b536-df15-4296-ab1c-74a545a852ac tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:34.182888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2079b536-df15-4296-ab1c-74a545a852ac tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:34.191577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2079b536-df15-4296-ab1c-74a545a852ac tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.086305 Nov 02 23:32:34.192168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2075/2650] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:34 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:34.746474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5a7c19ba-1fc2-4fbc-b60b-e32cb1bb7722 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:34.747432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5a7c19ba-1fc2-4fbc-b60b-e32cb1bb7722 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:34.754054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a7c19ba-1fc2-4fbc-b60b-e32cb1bb7722 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:34.755069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a7c19ba-1fc2-4fbc-b60b-e32cb1bb7722 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:34.755852 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a7c19ba-1fc2-4fbc-b60b-e32cb1bb7722 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:34.756272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a7c19ba-1fc2-4fbc-b60b-e32cb1bb7722 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:34.853342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5a7c19ba-1fc2-4fbc-b60b-e32cb1bb7722 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28160 microversion: 2.20 time: 0.110358 Nov 02 23:32:34.854011 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2076/2651] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:34 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28160 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:35.209063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-30da3af6-42b7-4049-91d4-eeecbd2645d0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:35.209562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-30da3af6-42b7-4049-91d4-eeecbd2645d0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:35.216119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30da3af6-42b7-4049-91d4-eeecbd2645d0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:35.216556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30da3af6-42b7-4049-91d4-eeecbd2645d0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:35.217320 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30da3af6-42b7-4049-91d4-eeecbd2645d0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:35.217742 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-30da3af6-42b7-4049-91d4-eeecbd2645d0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:35.281550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-30da3af6-42b7-4049-91d4-eeecbd2645d0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:35.291874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-30da3af6-42b7-4049-91d4-eeecbd2645d0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.087444 Nov 02 23:32:35.292601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2077/2652] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:35 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:35.866097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9ed2ae85-379b-4dd0-98f7-aa28012e983b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:35.867051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9ed2ae85-379b-4dd0-98f7-aa28012e983b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:35.873634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ed2ae85-379b-4dd0-98f7-aa28012e983b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:35.874078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ed2ae85-379b-4dd0-98f7-aa28012e983b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:35.874861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ed2ae85-379b-4dd0-98f7-aa28012e983b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:35.875315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ed2ae85-379b-4dd0-98f7-aa28012e983b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:35.969686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9ed2ae85-379b-4dd0-98f7-aa28012e983b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28160 microversion: 2.20 time: 0.107665 Nov 02 23:32:35.970353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2078/2653] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:35 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28160 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:36.309361 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7e96a10c-ed0c-496c-bd2c-cfaf03792f9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:36.310052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7e96a10c-ed0c-496c-bd2c-cfaf03792f9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:36.318066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7e96a10c-ed0c-496c-bd2c-cfaf03792f9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:36.318516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7e96a10c-ed0c-496c-bd2c-cfaf03792f9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:36.319325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7e96a10c-ed0c-496c-bd2c-cfaf03792f9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:36.319759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7e96a10c-ed0c-496c-bd2c-cfaf03792f9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:36.381725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7e96a10c-ed0c-496c-bd2c-cfaf03792f9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:36.389650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7e96a10c-ed0c-496c-bd2c-cfaf03792f9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.084353 Nov 02 23:32:36.390286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2079/2654] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:36 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:36.982339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9a73a986-bed1-428e-9aa5-9a9cbcd63186 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:36.983347 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9a73a986-bed1-428e-9aa5-9a9cbcd63186 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:36.990285 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a73a986-bed1-428e-9aa5-9a9cbcd63186 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:36.990727 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a73a986-bed1-428e-9aa5-9a9cbcd63186 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:36.991524 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a73a986-bed1-428e-9aa5-9a9cbcd63186 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:36.991958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a73a986-bed1-428e-9aa5-9a9cbcd63186 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:37.078378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9a73a986-bed1-428e-9aa5-9a9cbcd63186 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28160 microversion: 2.20 time: 0.099903 Nov 02 23:32:37.079060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2080/2655] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:36 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28160 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:37.408165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9a39f49e-4f39-46bc-810f-3f1650f06b5d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:37.408836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9a39f49e-4f39-46bc-810f-3f1650f06b5d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:37.416793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a39f49e-4f39-46bc-810f-3f1650f06b5d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:37.417286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a39f49e-4f39-46bc-810f-3f1650f06b5d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:37.418084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a39f49e-4f39-46bc-810f-3f1650f06b5d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:37.418520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9a39f49e-4f39-46bc-810f-3f1650f06b5d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:37.487708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9a39f49e-4f39-46bc-810f-3f1650f06b5d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:37.495697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9a39f49e-4f39-46bc-810f-3f1650f06b5d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.091990 Nov 02 23:32:37.496282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2081/2656] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:37 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:38.090394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-823c3b5b-00c2-41e3-bd00-90777f528de6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:38.091324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-823c3b5b-00c2-41e3-bd00-90777f528de6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:38.097518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-823c3b5b-00c2-41e3-bd00-90777f528de6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:38.097960 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-823c3b5b-00c2-41e3-bd00-90777f528de6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:38.098717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-823c3b5b-00c2-41e3-bd00-90777f528de6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:38.099172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-823c3b5b-00c2-41e3-bd00-90777f528de6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:38.189472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-823c3b5b-00c2-41e3-bd00-90777f528de6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28160 microversion: 2.20 time: 0.102619 Nov 02 23:32:38.190124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2082/2657] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:38 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28160 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:38.512447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6607b991-3894-48a1-921b-4e5d9d840214 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:38.513154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6607b991-3894-48a1-921b-4e5d9d840214 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:38.520417 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6607b991-3894-48a1-921b-4e5d9d840214 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:38.520862 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6607b991-3894-48a1-921b-4e5d9d840214 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:38.521655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6607b991-3894-48a1-921b-4e5d9d840214 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:38.522088 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6607b991-3894-48a1-921b-4e5d9d840214 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:38.589887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6607b991-3894-48a1-921b-4e5d9d840214 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:38.598656 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6607b991-3894-48a1-921b-4e5d9d840214 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.090185 Nov 02 23:32:38.599284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2083/2658] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:38 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:39.201937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f95bac75-7b0f-4e01-8ffa-490e82cdaac4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:39.202749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f95bac75-7b0f-4e01-8ffa-490e82cdaac4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:39.210833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f95bac75-7b0f-4e01-8ffa-490e82cdaac4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:39.210833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f95bac75-7b0f-4e01-8ffa-490e82cdaac4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:39.211516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f95bac75-7b0f-4e01-8ffa-490e82cdaac4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:39.211989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f95bac75-7b0f-4e01-8ffa-490e82cdaac4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:39.315816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f95bac75-7b0f-4e01-8ffa-490e82cdaac4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28451 microversion: 2.20 time: 0.117515 Nov 02 23:32:39.318865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2084/2659] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:39 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28451 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:39.616430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-27ce1d32-1d7e-4df8-b01f-167a2b1aea29 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:39.617146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-27ce1d32-1d7e-4df8-b01f-167a2b1aea29 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:39.624032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27ce1d32-1d7e-4df8-b01f-167a2b1aea29 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:39.624474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27ce1d32-1d7e-4df8-b01f-167a2b1aea29 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:39.625227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27ce1d32-1d7e-4df8-b01f-167a2b1aea29 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:39.625659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27ce1d32-1d7e-4df8-b01f-167a2b1aea29 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:39.690206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-27ce1d32-1d7e-4df8-b01f-167a2b1aea29 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:39.699292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-27ce1d32-1d7e-4df8-b01f-167a2b1aea29 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.087344 Nov 02 23:32:39.699865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2085/2660] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:39 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:40.328069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e7a7e1ba-3517-4077-ad83-f7c0b458b9e7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:40.328986 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e7a7e1ba-3517-4077-ad83-f7c0b458b9e7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:40.339363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e7a7e1ba-3517-4077-ad83-f7c0b458b9e7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:40.340224 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e7a7e1ba-3517-4077-ad83-f7c0b458b9e7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:40.341552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e7a7e1ba-3517-4077-ad83-f7c0b458b9e7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:40.342296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e7a7e1ba-3517-4077-ad83-f7c0b458b9e7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:40.433230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e7a7e1ba-3517-4077-ad83-f7c0b458b9e7 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28451 microversion: 2.20 time: 0.108663 Nov 02 23:32:40.434236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2086/2661] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:40 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28451 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:40.716327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a63946cf-e381-4d45-ac13-42f9dc7b9a67 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:40.717017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a63946cf-e381-4d45-ac13-42f9dc7b9a67 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:40.725031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a63946cf-e381-4d45-ac13-42f9dc7b9a67 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:40.725483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a63946cf-e381-4d45-ac13-42f9dc7b9a67 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:40.726237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a63946cf-e381-4d45-ac13-42f9dc7b9a67 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:40.726662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a63946cf-e381-4d45-ac13-42f9dc7b9a67 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:40.790521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a63946cf-e381-4d45-ac13-42f9dc7b9a67 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:40.799505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a63946cf-e381-4d45-ac13-42f9dc7b9a67 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.087094 Nov 02 23:32:40.800089 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2087/2662] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:40 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:41.447025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a9b750a8-3b9d-48d8-a4ee-0fd30869f7b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:41.447854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a9b750a8-3b9d-48d8-a4ee-0fd30869f7b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:41.453975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9b750a8-3b9d-48d8-a4ee-0fd30869f7b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:41.454401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9b750a8-3b9d-48d8-a4ee-0fd30869f7b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:41.455185 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9b750a8-3b9d-48d8-a4ee-0fd30869f7b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:41.455613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9b750a8-3b9d-48d8-a4ee-0fd30869f7b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:41.549016 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a9b750a8-3b9d-48d8-a4ee-0fd30869f7b0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.106159 Nov 02 23:32:41.549672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2088/2663] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:41 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:41.817277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e24eeb46-6fa6-4fb3-a221-daa4f7f5870b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:41.817975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e24eeb46-6fa6-4fb3-a221-daa4f7f5870b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:41.824813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e24eeb46-6fa6-4fb3-a221-daa4f7f5870b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:41.825252 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e24eeb46-6fa6-4fb3-a221-daa4f7f5870b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:41.826016 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e24eeb46-6fa6-4fb3-a221-daa4f7f5870b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:41.826440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e24eeb46-6fa6-4fb3-a221-daa4f7f5870b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:41.887970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e24eeb46-6fa6-4fb3-a221-daa4f7f5870b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:41.895745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e24eeb46-6fa6-4fb3-a221-daa4f7f5870b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082459 Nov 02 23:32:41.896866 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2089/2664] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:41 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:42.561430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9089997b-a789-497f-b388-5bcdbfddd014 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:42.562572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9089997b-a789-497f-b388-5bcdbfddd014 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:42.569348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9089997b-a789-497f-b388-5bcdbfddd014 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:42.569786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9089997b-a789-497f-b388-5bcdbfddd014 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:42.570717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9089997b-a789-497f-b388-5bcdbfddd014 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:42.571188 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9089997b-a789-497f-b388-5bcdbfddd014 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:42.655253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9089997b-a789-497f-b388-5bcdbfddd014 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.097324 Nov 02 23:32:42.655889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2090/2665] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:42 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:42.912936 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ce6dc7ff-a84e-4ed0-bf0d-23c7676f0160 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:42.913581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ce6dc7ff-a84e-4ed0-bf0d-23c7676f0160 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:42.920275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce6dc7ff-a84e-4ed0-bf0d-23c7676f0160 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:42.920710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce6dc7ff-a84e-4ed0-bf0d-23c7676f0160 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:42.921465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce6dc7ff-a84e-4ed0-bf0d-23c7676f0160 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:42.921890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ce6dc7ff-a84e-4ed0-bf0d-23c7676f0160 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:42.982014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ce6dc7ff-a84e-4ed0-bf0d-23c7676f0160 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:42.989657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ce6dc7ff-a84e-4ed0-bf0d-23c7676f0160 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080884 Nov 02 23:32:42.990876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2091/2666] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:42 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:43.666767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c4052642-7e12-4f03-90ac-a7d9e201dd5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:43.667721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c4052642-7e12-4f03-90ac-a7d9e201dd5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:43.674106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4052642-7e12-4f03-90ac-a7d9e201dd5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:43.674550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4052642-7e12-4f03-90ac-a7d9e201dd5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:43.675348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4052642-7e12-4f03-90ac-a7d9e201dd5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:43.675772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4052642-7e12-4f03-90ac-a7d9e201dd5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:43.760901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c4052642-7e12-4f03-90ac-a7d9e201dd5f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.097668 Nov 02 23:32:43.761554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2092/2667] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:43 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:44.007531 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2740a222-cfb5-4238-9ce7-a37eb4b0c265 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:44.008272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2740a222-cfb5-4238-9ce7-a37eb4b0c265 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:44.015218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2740a222-cfb5-4238-9ce7-a37eb4b0c265 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:44.015660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2740a222-cfb5-4238-9ce7-a37eb4b0c265 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:44.016430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2740a222-cfb5-4238-9ce7-a37eb4b0c265 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:44.016858 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2740a222-cfb5-4238-9ce7-a37eb4b0c265 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:44.079386 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2740a222-cfb5-4238-9ce7-a37eb4b0c265 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:44.088335 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2740a222-cfb5-4238-9ce7-a37eb4b0c265 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.085293 Nov 02 23:32:44.088917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2093/2668] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:44 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:44.772773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aa3a285d-4c37-43e4-b60d-e03fb1a24dbf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:44.773738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aa3a285d-4c37-43e4-b60d-e03fb1a24dbf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:44.781118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa3a285d-4c37-43e4-b60d-e03fb1a24dbf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:44.781570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa3a285d-4c37-43e4-b60d-e03fb1a24dbf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:44.782357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa3a285d-4c37-43e4-b60d-e03fb1a24dbf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:44.782795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa3a285d-4c37-43e4-b60d-e03fb1a24dbf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:44.875820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aa3a285d-4c37-43e4-b60d-e03fb1a24dbf tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.106696 Nov 02 23:32:44.876485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2094/2669] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:44 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:45.106419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a6f49611-3ec0-4d02-93ef-e8a4e2a54f30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:45.107096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a6f49611-3ec0-4d02-93ef-e8a4e2a54f30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:45.113936 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a6f49611-3ec0-4d02-93ef-e8a4e2a54f30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:45.114352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a6f49611-3ec0-4d02-93ef-e8a4e2a54f30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:45.115154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a6f49611-3ec0-4d02-93ef-e8a4e2a54f30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:45.115581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a6f49611-3ec0-4d02-93ef-e8a4e2a54f30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:45.181607 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a6f49611-3ec0-4d02-93ef-e8a4e2a54f30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:45.190215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a6f49611-3ec0-4d02-93ef-e8a4e2a54f30 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.088466 Nov 02 23:32:45.190789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2095/2670] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:45 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:45.888905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c4857fcb-1325-4366-a7d6-32d80515dd63 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:45.889850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c4857fcb-1325-4366-a7d6-32d80515dd63 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:45.896525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4857fcb-1325-4366-a7d6-32d80515dd63 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:45.896969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4857fcb-1325-4366-a7d6-32d80515dd63 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:45.897749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4857fcb-1325-4366-a7d6-32d80515dd63 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:45.898179 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4857fcb-1325-4366-a7d6-32d80515dd63 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:46.025568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c4857fcb-1325-4366-a7d6-32d80515dd63 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.140544 Nov 02 23:32:46.026519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2096/2671] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:45 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:46.207213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4f1880d0-dd4e-4a72-bc66-41ca59bd4deb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:46.207890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4f1880d0-dd4e-4a72-bc66-41ca59bd4deb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:46.215716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f1880d0-dd4e-4a72-bc66-41ca59bd4deb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:46.216194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f1880d0-dd4e-4a72-bc66-41ca59bd4deb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:46.216978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f1880d0-dd4e-4a72-bc66-41ca59bd4deb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:46.217409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f1880d0-dd4e-4a72-bc66-41ca59bd4deb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:46.280862 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4f1880d0-dd4e-4a72-bc66-41ca59bd4deb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:46.289381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4f1880d0-dd4e-4a72-bc66-41ca59bd4deb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.086342 Nov 02 23:32:46.289974 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2097/2672] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:46 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:47.036541 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7a88d1e7-c1a1-469b-8bae-630279da7564 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:47.037455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7a88d1e7-c1a1-469b-8bae-630279da7564 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:47.044382 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7a88d1e7-c1a1-469b-8bae-630279da7564 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:47.044837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7a88d1e7-c1a1-469b-8bae-630279da7564 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:47.045597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7a88d1e7-c1a1-469b-8bae-630279da7564 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:47.046032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7a88d1e7-c1a1-469b-8bae-630279da7564 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:47.130280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7a88d1e7-c1a1-469b-8bae-630279da7564 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.097281 Nov 02 23:32:47.130966 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2098/2673] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:47 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:47.307524 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e17dbd76-83c8-409e-9a1f-fec6a4d4d5df tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:47.308206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e17dbd76-83c8-409e-9a1f-fec6a4d4d5df tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:47.314814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e17dbd76-83c8-409e-9a1f-fec6a4d4d5df tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:47.315292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e17dbd76-83c8-409e-9a1f-fec6a4d4d5df tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:47.316075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e17dbd76-83c8-409e-9a1f-fec6a4d4d5df tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:47.316499 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e17dbd76-83c8-409e-9a1f-fec6a4d4d5df tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:47.378321 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e17dbd76-83c8-409e-9a1f-fec6a4d4d5df tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:47.387419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e17dbd76-83c8-409e-9a1f-fec6a4d4d5df tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.084725 Nov 02 23:32:47.387992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2099/2674] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:47 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:48.141925 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f818ee69-da9b-4ba8-a8ac-17fff2bf2cd4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:48.142876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f818ee69-da9b-4ba8-a8ac-17fff2bf2cd4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:48.149315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f818ee69-da9b-4ba8-a8ac-17fff2bf2cd4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:48.149766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f818ee69-da9b-4ba8-a8ac-17fff2bf2cd4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:48.150579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f818ee69-da9b-4ba8-a8ac-17fff2bf2cd4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:48.151041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f818ee69-da9b-4ba8-a8ac-17fff2bf2cd4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:48.247965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f818ee69-da9b-4ba8-a8ac-17fff2bf2cd4 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.109574 Nov 02 23:32:48.248618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2100/2675] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:48 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:48.413359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-372ff151-95a1-4cee-991d-6f05963961e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:48.414432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-372ff151-95a1-4cee-991d-6f05963961e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:48.423469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-372ff151-95a1-4cee-991d-6f05963961e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:48.424135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-372ff151-95a1-4cee-991d-6f05963961e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:48.425056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-372ff151-95a1-4cee-991d-6f05963961e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:48.425491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-372ff151-95a1-4cee-991d-6f05963961e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:48.497671 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-372ff151-95a1-4cee-991d-6f05963961e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:48.509050 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-372ff151-95a1-4cee-991d-6f05963961e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.101312 Nov 02 23:32:48.509642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2101/2676] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:48 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:49.260257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-38dbed13-6423-4c32-bdb8-f02098e4411f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:49.261156 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-38dbed13-6423-4c32-bdb8-f02098e4411f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:49.267531 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-38dbed13-6423-4c32-bdb8-f02098e4411f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:49.267971 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-38dbed13-6423-4c32-bdb8-f02098e4411f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:49.269316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-38dbed13-6423-4c32-bdb8-f02098e4411f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:49.269316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-38dbed13-6423-4c32-bdb8-f02098e4411f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:49.486709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-38dbed13-6423-4c32-bdb8-f02098e4411f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.230624 Nov 02 23:32:49.487446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2102/2677] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:49 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:49.533633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-001c6db1-6a80-44f2-a5a5-5f63011eea34 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:49.534332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-001c6db1-6a80-44f2-a5a5-5f63011eea34 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:49.541535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-001c6db1-6a80-44f2-a5a5-5f63011eea34 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:49.542002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-001c6db1-6a80-44f2-a5a5-5f63011eea34 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:49.542774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-001c6db1-6a80-44f2-a5a5-5f63011eea34 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:49.543235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-001c6db1-6a80-44f2-a5a5-5f63011eea34 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:49.605481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-001c6db1-6a80-44f2-a5a5-5f63011eea34 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:49.613232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-001c6db1-6a80-44f2-a5a5-5f63011eea34 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.083626 Nov 02 23:32:49.613784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2103/2678] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:49 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:50.498511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aca06cfb-ea44-4457-b0cf-380651eaa5b3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:50.499453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aca06cfb-ea44-4457-b0cf-380651eaa5b3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:50.505800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aca06cfb-ea44-4457-b0cf-380651eaa5b3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:50.506274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aca06cfb-ea44-4457-b0cf-380651eaa5b3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:50.507074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aca06cfb-ea44-4457-b0cf-380651eaa5b3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:50.507510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aca06cfb-ea44-4457-b0cf-380651eaa5b3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:50.592471 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aca06cfb-ea44-4457-b0cf-380651eaa5b3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.097511 Nov 02 23:32:50.593118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2104/2679] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:50 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:50.630646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e43b4829-5ceb-4eec-80f9-2df607ca7f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:50.631376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e43b4829-5ceb-4eec-80f9-2df607ca7f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:50.638677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e43b4829-5ceb-4eec-80f9-2df607ca7f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:50.639187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e43b4829-5ceb-4eec-80f9-2df607ca7f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:50.639953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e43b4829-5ceb-4eec-80f9-2df607ca7f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:50.640387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e43b4829-5ceb-4eec-80f9-2df607ca7f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:50.700554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e43b4829-5ceb-4eec-80f9-2df607ca7f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:50.708701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e43b4829-5ceb-4eec-80f9-2df607ca7f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081967 Nov 02 23:32:50.709268 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2105/2680] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:50 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:51.604188 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d6ea9548-108a-4960-a741-a1c318f38b20 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:51.605095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d6ea9548-108a-4960-a741-a1c318f38b20 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:51.611325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6ea9548-108a-4960-a741-a1c318f38b20 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:51.611773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6ea9548-108a-4960-a741-a1c318f38b20 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:51.612530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6ea9548-108a-4960-a741-a1c318f38b20 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:51.612959 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6ea9548-108a-4960-a741-a1c318f38b20 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:51.699166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d6ea9548-108a-4960-a741-a1c318f38b20 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.099518 Nov 02 23:32:51.699799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2106/2681] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:51 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:51.725318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fcdcd835-f9d0-4075-ab89-f8356fdd37c4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:51.726000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fcdcd835-f9d0-4075-ab89-f8356fdd37c4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:51.733515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fcdcd835-f9d0-4075-ab89-f8356fdd37c4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:51.733964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fcdcd835-f9d0-4075-ab89-f8356fdd37c4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:51.734749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fcdcd835-f9d0-4075-ab89-f8356fdd37c4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:51.735209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fcdcd835-f9d0-4075-ab89-f8356fdd37c4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:51.798669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fcdcd835-f9d0-4075-ab89-f8356fdd37c4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:51.806694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fcdcd835-f9d0-4075-ab89-f8356fdd37c4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.085137 Nov 02 23:32:51.807290 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2107/2682] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:51 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:52.711260 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8eff8d9c-fdd4-45f2-bff4-082466d24988 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:52.712239 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8eff8d9c-fdd4-45f2-bff4-082466d24988 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:52.718446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8eff8d9c-fdd4-45f2-bff4-082466d24988 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:52.718887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8eff8d9c-fdd4-45f2-bff4-082466d24988 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:52.719676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8eff8d9c-fdd4-45f2-bff4-082466d24988 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:52.720103 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8eff8d9c-fdd4-45f2-bff4-082466d24988 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:52.808343 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8eff8d9c-fdd4-45f2-bff4-082466d24988 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.100952 Nov 02 23:32:52.808991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2108/2683] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:52 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:52.822598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aa73f218-c1fb-4ef8-a372-1a924f0646b7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:52.823366 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aa73f218-c1fb-4ef8-a372-1a924f0646b7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:52.830164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa73f218-c1fb-4ef8-a372-1a924f0646b7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:52.830599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa73f218-c1fb-4ef8-a372-1a924f0646b7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:52.831390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa73f218-c1fb-4ef8-a372-1a924f0646b7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:52.831816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa73f218-c1fb-4ef8-a372-1a924f0646b7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:52.892219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aa73f218-c1fb-4ef8-a372-1a924f0646b7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:52.899889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aa73f218-c1fb-4ef8-a372-1a924f0646b7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080994 Nov 02 23:32:52.900445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2109/2684] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:52 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:32:53.820540 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3da2419d-40a6-458a-b8ae-ef972a3efecb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:53.821898 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3da2419d-40a6-458a-b8ae-ef972a3efecb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:53.828887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3da2419d-40a6-458a-b8ae-ef972a3efecb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:53.829325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3da2419d-40a6-458a-b8ae-ef972a3efecb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:53.830085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3da2419d-40a6-458a-b8ae-ef972a3efecb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:53.830510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3da2419d-40a6-458a-b8ae-ef972a3efecb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:53.920574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3da2419d-40a6-458a-b8ae-ef972a3efecb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.103890 Nov 02 23:32:53.921228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2110/2685] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:53 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:53.926085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-17e82096-57da-4170-bcd2-d16d7ced1985 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:53.926761 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-17e82096-57da-4170-bcd2-d16d7ced1985 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:53.933971 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17e82096-57da-4170-bcd2-d16d7ced1985 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:53.934406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17e82096-57da-4170-bcd2-d16d7ced1985 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:53.935186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17e82096-57da-4170-bcd2-d16d7ced1985 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:53.935613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17e82096-57da-4170-bcd2-d16d7ced1985 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:53.996091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-17e82096-57da-4170-bcd2-d16d7ced1985 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:54.003814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-17e82096-57da-4170-bcd2-d16d7ced1985 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081363 Nov 02 23:32:54.004377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2111/2686] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:53 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:32:54.931986 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ecb745ee-7fd1-420a-b9ae-d675e4633016 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:54.932921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ecb745ee-7fd1-420a-b9ae-d675e4633016 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:54.939392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ecb745ee-7fd1-420a-b9ae-d675e4633016 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:54.939845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ecb745ee-7fd1-420a-b9ae-d675e4633016 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:54.940626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ecb745ee-7fd1-420a-b9ae-d675e4633016 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:54.941063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ecb745ee-7fd1-420a-b9ae-d675e4633016 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:55.036071 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ecb745ee-7fd1-420a-b9ae-d675e4633016 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.107571 Nov 02 23:32:55.036744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2112/2687] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:54 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:55.041552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a2710c61-0935-4969-b87f-adbc5393cd2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:55.042254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a2710c61-0935-4969-b87f-adbc5393cd2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:55.049614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2710c61-0935-4969-b87f-adbc5393cd2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:55.050063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2710c61-0935-4969-b87f-adbc5393cd2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:55.050842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2710c61-0935-4969-b87f-adbc5393cd2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:55.051317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2710c61-0935-4969-b87f-adbc5393cd2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:55.112960 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a2710c61-0935-4969-b87f-adbc5393cd2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:55.121129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a2710c61-0935-4969-b87f-adbc5393cd2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.083299 Nov 02 23:32:55.121694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2113/2688] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:55 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:32:56.047936 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f96125c2-4cb7-4ac7-b246-0243461fa493 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:56.048835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f96125c2-4cb7-4ac7-b246-0243461fa493 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:56.055107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f96125c2-4cb7-4ac7-b246-0243461fa493 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:56.055554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f96125c2-4cb7-4ac7-b246-0243461fa493 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:56.056881 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f96125c2-4cb7-4ac7-b246-0243461fa493 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:56.057308 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f96125c2-4cb7-4ac7-b246-0243461fa493 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:56.149528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f96125c2-4cb7-4ac7-b246-0243461fa493 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.105189 Nov 02 23:32:56.150158 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2114/2689] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:56 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:56.154833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5965f97c-ae76-4fa6-b613-e6f61c506aab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:56.155551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5965f97c-ae76-4fa6-b613-e6f61c506aab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:56.162508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5965f97c-ae76-4fa6-b613-e6f61c506aab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:56.162981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5965f97c-ae76-4fa6-b613-e6f61c506aab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:56.163744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5965f97c-ae76-4fa6-b613-e6f61c506aab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:56.164175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5965f97c-ae76-4fa6-b613-e6f61c506aab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:56.225469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5965f97c-ae76-4fa6-b613-e6f61c506aab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:56.233682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5965f97c-ae76-4fa6-b613-e6f61c506aab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082414 Nov 02 23:32:56.234246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2115/2690] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:56 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:32:57.161162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4a9edd24-6cbc-4dc2-8907-81e7163812ff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:57.162073 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4a9edd24-6cbc-4dc2-8907-81e7163812ff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:57.168555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a9edd24-6cbc-4dc2-8907-81e7163812ff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:57.169002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a9edd24-6cbc-4dc2-8907-81e7163812ff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:57.169808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a9edd24-6cbc-4dc2-8907-81e7163812ff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:57.170240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a9edd24-6cbc-4dc2-8907-81e7163812ff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:57.260438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4a9edd24-6cbc-4dc2-8907-81e7163812ff tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.102213 Nov 02 23:32:57.261100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2116/2691] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:57 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:57.265826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3eb61a87-46cd-41db-8dae-6e333a2a1f52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:57.266514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3eb61a87-46cd-41db-8dae-6e333a2a1f52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:57.273255 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3eb61a87-46cd-41db-8dae-6e333a2a1f52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:57.273696 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3eb61a87-46cd-41db-8dae-6e333a2a1f52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:57.274464 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3eb61a87-46cd-41db-8dae-6e333a2a1f52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:57.274888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3eb61a87-46cd-41db-8dae-6e333a2a1f52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:57.335309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3eb61a87-46cd-41db-8dae-6e333a2a1f52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:57.343759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3eb61a87-46cd-41db-8dae-6e333a2a1f52 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081576 Nov 02 23:32:57.344318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2117/2692] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:57 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:32:58.271358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-185044c5-bb3f-4177-a995-7f144dc77ed0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:58.272256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-185044c5-bb3f-4177-a995-7f144dc77ed0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:58.278996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-185044c5-bb3f-4177-a995-7f144dc77ed0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:58.279444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-185044c5-bb3f-4177-a995-7f144dc77ed0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:58.280201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-185044c5-bb3f-4177-a995-7f144dc77ed0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:58.280633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-185044c5-bb3f-4177-a995-7f144dc77ed0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:58.372377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-185044c5-bb3f-4177-a995-7f144dc77ed0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.104530 Nov 02 23:32:58.373034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2118/2693] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:58 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:58.377722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f92fc2d4-23e6-41ff-a5e2-294443efeb2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:58.378438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f92fc2d4-23e6-41ff-a5e2-294443efeb2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:58.385202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f92fc2d4-23e6-41ff-a5e2-294443efeb2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:58.385650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f92fc2d4-23e6-41ff-a5e2-294443efeb2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:58.386409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f92fc2d4-23e6-41ff-a5e2-294443efeb2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:58.386840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f92fc2d4-23e6-41ff-a5e2-294443efeb2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:58.450884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f92fc2d4-23e6-41ff-a5e2-294443efeb2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:58.459194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f92fc2d4-23e6-41ff-a5e2-294443efeb2e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.084967 Nov 02 23:32:58.459701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2119/2694] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:58 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:32:59.383978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9e79d4f4-74f8-4b19-bcd0-10dd0dffeb49 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:32:59.384874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9e79d4f4-74f8-4b19-bcd0-10dd0dffeb49 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:59.391135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e79d4f4-74f8-4b19-bcd0-10dd0dffeb49 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:59.391585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e79d4f4-74f8-4b19-bcd0-10dd0dffeb49 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:59.392353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e79d4f4-74f8-4b19-bcd0-10dd0dffeb49 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:59.392781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e79d4f4-74f8-4b19-bcd0-10dd0dffeb49 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:59.483364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9e79d4f4-74f8-4b19-bcd0-10dd0dffeb49 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.102857 Nov 02 23:32:59.484000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2120/2695] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:32:59 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:32:59.488693 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-51aac207-4f9e-445f-ad85-2e5dea8c1a35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:32:59.489379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-51aac207-4f9e-445f-ad85-2e5dea8c1a35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:32:59.496845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-51aac207-4f9e-445f-ad85-2e5dea8c1a35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:59.497282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-51aac207-4f9e-445f-ad85-2e5dea8c1a35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:59.498049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-51aac207-4f9e-445f-ad85-2e5dea8c1a35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:32:59.498478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-51aac207-4f9e-445f-ad85-2e5dea8c1a35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:32:59.559429 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-51aac207-4f9e-445f-ad85-2e5dea8c1a35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:32:59.567326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-51aac207-4f9e-445f-ad85-2e5dea8c1a35 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082219 Nov 02 23:32:59.567885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2121/2696] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:32:59 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:00.495793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-14483da7-1ee5-4619-94d7-f957b78922c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:00.496694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-14483da7-1ee5-4619-94d7-f957b78922c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:00.503174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14483da7-1ee5-4619-94d7-f957b78922c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:00.503653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14483da7-1ee5-4619-94d7-f957b78922c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:00.504445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14483da7-1ee5-4619-94d7-f957b78922c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:00.504871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14483da7-1ee5-4619-94d7-f957b78922c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:00.616836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-14483da7-1ee5-4619-94d7-f957b78922c9 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.124986 Nov 02 23:33:00.617477 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2122/2697] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:00 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:33:00.622773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2d6069a3-2dd8-4c0c-bdc4-1c81171f79c8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:00.623492 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2d6069a3-2dd8-4c0c-bdc4-1c81171f79c8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:00.630297 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d6069a3-2dd8-4c0c-bdc4-1c81171f79c8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:00.630735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d6069a3-2dd8-4c0c-bdc4-1c81171f79c8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:00.631547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d6069a3-2dd8-4c0c-bdc4-1c81171f79c8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:00.631973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d6069a3-2dd8-4c0c-bdc4-1c81171f79c8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:00.691804 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2d6069a3-2dd8-4c0c-bdc4-1c81171f79c8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:00.700628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2d6069a3-2dd8-4c0c-bdc4-1c81171f79c8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082064 Nov 02 23:33:00.701186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2123/2698] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:00 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:01.629102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-55c30aef-72ad-4ec6-a34e-75150ef221a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:01.630010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-55c30aef-72ad-4ec6-a34e-75150ef221a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:01.636821 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55c30aef-72ad-4ec6-a34e-75150ef221a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:01.637266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55c30aef-72ad-4ec6-a34e-75150ef221a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:01.638024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55c30aef-72ad-4ec6-a34e-75150ef221a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:01.638452 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-55c30aef-72ad-4ec6-a34e-75150ef221a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:01.803629 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-55c30aef-72ad-4ec6-a34e-75150ef221a0 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.178042 Nov 02 23:33:01.807528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2124/2699] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:01 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:33:01.808995 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e291ff4b-5913-42de-804d-74d809189630 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:01.809678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e291ff4b-5913-42de-804d-74d809189630 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:01.816703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e291ff4b-5913-42de-804d-74d809189630 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:01.817144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e291ff4b-5913-42de-804d-74d809189630 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:01.817902 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e291ff4b-5913-42de-804d-74d809189630 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:01.818335 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e291ff4b-5913-42de-804d-74d809189630 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:01.877653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e291ff4b-5913-42de-804d-74d809189630 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:01.886320 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e291ff4b-5913-42de-804d-74d809189630 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080882 Nov 02 23:33:01.886813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2125/2700] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:01 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:02.815341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a01dd100-4bd6-47ee-b896-e89541207bda tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:02.816251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a01dd100-4bd6-47ee-b896-e89541207bda tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:02.822532 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a01dd100-4bd6-47ee-b896-e89541207bda tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:02.823000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a01dd100-4bd6-47ee-b896-e89541207bda tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:02.823757 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a01dd100-4bd6-47ee-b896-e89541207bda tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:02.824182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a01dd100-4bd6-47ee-b896-e89541207bda tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:02.930510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a01dd100-4bd6-47ee-b896-e89541207bda tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.118928 Nov 02 23:33:02.931187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2126/2701] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:02 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:33:02.936127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d5c10f32-73e2-4a20-8168-d21193441cb4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:02.936810 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d5c10f32-73e2-4a20-8168-d21193441cb4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:02.943977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d5c10f32-73e2-4a20-8168-d21193441cb4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:02.944360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d5c10f32-73e2-4a20-8168-d21193441cb4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:02.945112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d5c10f32-73e2-4a20-8168-d21193441cb4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:02.945535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d5c10f32-73e2-4a20-8168-d21193441cb4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:03.005726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d5c10f32-73e2-4a20-8168-d21193441cb4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:03.013317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d5c10f32-73e2-4a20-8168-d21193441cb4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081048 Nov 02 23:33:03.013874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2127/2702] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:02 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:03.941551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0d8a842d-f9a2-4f71-9afa-7e9d820d4a5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:03.942447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0d8a842d-f9a2-4f71-9afa-7e9d820d4a5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:03.949287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d8a842d-f9a2-4f71-9afa-7e9d820d4a5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:03.949725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d8a842d-f9a2-4f71-9afa-7e9d820d4a5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:03.950523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d8a842d-f9a2-4f71-9afa-7e9d820d4a5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:03.950940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d8a842d-f9a2-4f71-9afa-7e9d820d4a5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:04.041351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0d8a842d-f9a2-4f71-9afa-7e9d820d4a5a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.102813 Nov 02 23:33:04.042191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2128/2703] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:03 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:33:04.048554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-12594f61-e35e-4f3c-a9f6-56387547f9a8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:04.049391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-12594f61-e35e-4f3c-a9f6-56387547f9a8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:04.057562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-12594f61-e35e-4f3c-a9f6-56387547f9a8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:04.058009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-12594f61-e35e-4f3c-a9f6-56387547f9a8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:04.058782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-12594f61-e35e-4f3c-a9f6-56387547f9a8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:04.059246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-12594f61-e35e-4f3c-a9f6-56387547f9a8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:04.118861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-12594f61-e35e-4f3c-a9f6-56387547f9a8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:04.127696 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-12594f61-e35e-4f3c-a9f6-56387547f9a8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.084143 Nov 02 23:33:04.128272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2129/2704] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:04 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:05.053546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2ccb7647-85ce-4291-85ef-8e4440297ce3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:05.054471 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2ccb7647-85ce-4291-85ef-8e4440297ce3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:05.061164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ccb7647-85ce-4291-85ef-8e4440297ce3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:05.061608 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ccb7647-85ce-4291-85ef-8e4440297ce3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:05.062643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ccb7647-85ce-4291-85ef-8e4440297ce3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:05.063104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2ccb7647-85ce-4291-85ef-8e4440297ce3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:05.173779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2ccb7647-85ce-4291-85ef-8e4440297ce3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.123727 Nov 02 23:33:05.174459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2130/2705] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:05 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:33:05.179239 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b6243ea8-6a0d-40d0-83d9-922353b8d6a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:05.179968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b6243ea8-6a0d-40d0-83d9-922353b8d6a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:05.187558 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6243ea8-6a0d-40d0-83d9-922353b8d6a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:05.188001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6243ea8-6a0d-40d0-83d9-922353b8d6a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:05.188768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6243ea8-6a0d-40d0-83d9-922353b8d6a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:05.189200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6243ea8-6a0d-40d0-83d9-922353b8d6a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:05.253074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b6243ea8-6a0d-40d0-83d9-922353b8d6a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:05.261867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b6243ea8-6a0d-40d0-83d9-922353b8d6a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.086295 Nov 02 23:33:05.262431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2131/2706] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:05 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:06.185200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7f13272f-c653-40af-8aab-650e0efda905 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:06.186107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7f13272f-c653-40af-8aab-650e0efda905 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:06.192710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f13272f-c653-40af-8aab-650e0efda905 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:06.193153 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f13272f-c653-40af-8aab-650e0efda905 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:06.193912 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f13272f-c653-40af-8aab-650e0efda905 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:06.194336 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f13272f-c653-40af-8aab-650e0efda905 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:06.290636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7f13272f-c653-40af-8aab-650e0efda905 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.108941 Nov 02 23:33:06.291397 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2132/2707] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:06 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:33:06.296380 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e039bc31-1312-45b2-84bd-6d6a4e86f345 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:06.297070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e039bc31-1312-45b2-84bd-6d6a4e86f345 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:06.303995 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e039bc31-1312-45b2-84bd-6d6a4e86f345 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:06.304462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e039bc31-1312-45b2-84bd-6d6a4e86f345 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:06.305239 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e039bc31-1312-45b2-84bd-6d6a4e86f345 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:06.305672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e039bc31-1312-45b2-84bd-6d6a4e86f345 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:06.369500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e039bc31-1312-45b2-84bd-6d6a4e86f345 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:06.378473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e039bc31-1312-45b2-84bd-6d6a4e86f345 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.085744 Nov 02 23:33:06.379091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2133/2708] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:06 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:07.302557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-176ad0a4-2e6d-4b85-8ce3-a7ea7aa03f86 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:07.303495 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-176ad0a4-2e6d-4b85-8ce3-a7ea7aa03f86 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:07.309892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-176ad0a4-2e6d-4b85-8ce3-a7ea7aa03f86 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:07.310344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-176ad0a4-2e6d-4b85-8ce3-a7ea7aa03f86 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:07.311152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-176ad0a4-2e6d-4b85-8ce3-a7ea7aa03f86 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:07.311588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-176ad0a4-2e6d-4b85-8ce3-a7ea7aa03f86 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:07.420038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-176ad0a4-2e6d-4b85-8ce3-a7ea7aa03f86 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.121048 Nov 02 23:33:07.420702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2134/2709] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:07 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:33:07.425450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-93493b44-6aac-4589-b275-167455deb404 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:07.426140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-93493b44-6aac-4589-b275-167455deb404 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:07.433145 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93493b44-6aac-4589-b275-167455deb404 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:07.433598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93493b44-6aac-4589-b275-167455deb404 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:07.434360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93493b44-6aac-4589-b275-167455deb404 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:07.434795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93493b44-6aac-4589-b275-167455deb404 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:07.494607 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-93493b44-6aac-4589-b275-167455deb404 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:07.502876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-93493b44-6aac-4589-b275-167455deb404 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081083 Nov 02 23:33:07.503468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2135/2710] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:07 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:08.432546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bf9af2aa-3822-401b-977e-41064d0bc1d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:08.433454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bf9af2aa-3822-401b-977e-41064d0bc1d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:08.439963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf9af2aa-3822-401b-977e-41064d0bc1d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:08.440415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf9af2aa-3822-401b-977e-41064d0bc1d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:08.441178 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf9af2aa-3822-401b-977e-41064d0bc1d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:08.441613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf9af2aa-3822-401b-977e-41064d0bc1d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:08.533486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bf9af2aa-3822-401b-977e-41064d0bc1d6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.105142 Nov 02 23:33:08.537338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2136/2711] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:08 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:33:08.539045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c65c3294-4e0b-4841-b974-37217c93c00e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:08.539723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c65c3294-4e0b-4841-b974-37217c93c00e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:08.546874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c65c3294-4e0b-4841-b974-37217c93c00e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:08.547359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c65c3294-4e0b-4841-b974-37217c93c00e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:08.548116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c65c3294-4e0b-4841-b974-37217c93c00e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:08.548542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c65c3294-4e0b-4841-b974-37217c93c00e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:08.608671 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c65c3294-4e0b-4841-b974-37217c93c00e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:08.616743 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c65c3294-4e0b-4841-b974-37217c93c00e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081340 Nov 02 23:33:08.617300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2137/2712] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:08 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:09.544104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8b7146c3-6bf8-4ba7-95b6-f63c7a5a81df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:09.545007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8b7146c3-6bf8-4ba7-95b6-f63c7a5a81df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:09.551211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8b7146c3-6bf8-4ba7-95b6-f63c7a5a81df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:09.551647 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8b7146c3-6bf8-4ba7-95b6-f63c7a5a81df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:09.552399 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8b7146c3-6bf8-4ba7-95b6-f63c7a5a81df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:09.552824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8b7146c3-6bf8-4ba7-95b6-f63c7a5a81df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:09.653669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8b7146c3-6bf8-4ba7-95b6-f63c7a5a81df tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.113011 Nov 02 23:33:09.654309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2138/2713] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:09 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:33:09.659175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-830dbde3-36a6-4cfa-b524-da0a51d170d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:09.659854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-830dbde3-36a6-4cfa-b524-da0a51d170d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:09.666463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-830dbde3-36a6-4cfa-b524-da0a51d170d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:09.666905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-830dbde3-36a6-4cfa-b524-da0a51d170d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:09.667683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-830dbde3-36a6-4cfa-b524-da0a51d170d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:09.668109 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-830dbde3-36a6-4cfa-b524-da0a51d170d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:09.729574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-830dbde3-36a6-4cfa-b524-da0a51d170d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:09.737187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-830dbde3-36a6-4cfa-b524-da0a51d170d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081617 Nov 02 23:33:09.737742 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2139/2714] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:09 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:10.665303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a139f3b1-b6b0-4823-94b9-491ec66228c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:10.666202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a139f3b1-b6b0-4823-94b9-491ec66228c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:10.672431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a139f3b1-b6b0-4823-94b9-491ec66228c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:10.672869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a139f3b1-b6b0-4823-94b9-491ec66228c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:10.673621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a139f3b1-b6b0-4823-94b9-491ec66228c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:10.674041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a139f3b1-b6b0-4823-94b9-491ec66228c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:10.905622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a139f3b1-b6b0-4823-94b9-491ec66228c1 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.243802 Nov 02 23:33:10.909559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2140/2715] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:10 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:33:10.911223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-03ab590d-00fc-4275-b4d9-78ebcfd89b47 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:10.911904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-03ab590d-00fc-4275-b4d9-78ebcfd89b47 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:10.918577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03ab590d-00fc-4275-b4d9-78ebcfd89b47 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:10.919015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03ab590d-00fc-4275-b4d9-78ebcfd89b47 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:10.919780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03ab590d-00fc-4275-b4d9-78ebcfd89b47 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:10.920207 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03ab590d-00fc-4275-b4d9-78ebcfd89b47 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:10.980052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-03ab590d-00fc-4275-b4d9-78ebcfd89b47 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:10.988337 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-03ab590d-00fc-4275-b4d9-78ebcfd89b47 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080782 Nov 02 23:33:10.988908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2141/2716] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:10 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:11.917882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3f37e72d-5d53-4be6-b039-a8f637c8e75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:11.918774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3f37e72d-5d53-4be6-b039-a8f637c8e75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:11.925193 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f37e72d-5d53-4be6-b039-a8f637c8e75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:11.925631 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f37e72d-5d53-4be6-b039-a8f637c8e75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:11.926395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f37e72d-5d53-4be6-b039-a8f637c8e75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:11.926829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f37e72d-5d53-4be6-b039-a8f637c8e75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:12.024184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3f37e72d-5d53-4be6-b039-a8f637c8e75c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.110595 Nov 02 23:33:12.025328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2142/2717] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:11 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:33:12.030145 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6879b8ad-06ed-483f-84cb-5460de8628c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:12.030825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6879b8ad-06ed-483f-84cb-5460de8628c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:12.037475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6879b8ad-06ed-483f-84cb-5460de8628c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:12.037920 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6879b8ad-06ed-483f-84cb-5460de8628c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:12.038670 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6879b8ad-06ed-483f-84cb-5460de8628c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:12.039129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6879b8ad-06ed-483f-84cb-5460de8628c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:12.101950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6879b8ad-06ed-483f-84cb-5460de8628c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:12.110909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6879b8ad-06ed-483f-84cb-5460de8628c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.084327 Nov 02 23:33:12.111509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2143/2718] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:12 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:13.036296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-03b254f0-f079-4104-944f-164221a6b8a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:13.037202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-03b254f0-f079-4104-944f-164221a6b8a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:13.043943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03b254f0-f079-4104-944f-164221a6b8a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:13.044392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03b254f0-f079-4104-944f-164221a6b8a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:13.045159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03b254f0-f079-4104-944f-164221a6b8a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:13.045591 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-03b254f0-f079-4104-944f-164221a6b8a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:13.146262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-03b254f0-f079-4104-944f-164221a6b8a5 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 28619 microversion: 2.20 time: 0.113532 Nov 02 23:33:13.146937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2144/2719] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:13 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 28619 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:33:13.151811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-74aa1304-d9fb-4ed4-a47e-87d56aaef96a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:13.152500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-74aa1304-d9fb-4ed4-a47e-87d56aaef96a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:13.159231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74aa1304-d9fb-4ed4-a47e-87d56aaef96a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:13.159681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74aa1304-d9fb-4ed4-a47e-87d56aaef96a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:13.160442 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74aa1304-d9fb-4ed4-a47e-87d56aaef96a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:13.160876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74aa1304-d9fb-4ed4-a47e-87d56aaef96a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:13.221095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-74aa1304-d9fb-4ed4-a47e-87d56aaef96a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:13.229381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-74aa1304-d9fb-4ed4-a47e-87d56aaef96a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081177 Nov 02 23:33:13.229956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2145/2720] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:13 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:14.157861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8a87a9a2-f385-462f-a63a-4fa4abcd12ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:14.158756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8a87a9a2-f385-462f-a63a-4fa4abcd12ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:14.164939 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a87a9a2-f385-462f-a63a-4fa4abcd12ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:14.165378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a87a9a2-f385-462f-a63a-4fa4abcd12ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:14.166132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a87a9a2-f385-462f-a63a-4fa4abcd12ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:14.166558 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a87a9a2-f385-462f-a63a-4fa4abcd12ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:14.264172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8a87a9a2-f385-462f-a63a-4fa4abcd12ba tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 29904 microversion: 2.20 time: 0.109875 Nov 02 23:33:14.264811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2146/2721] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:14 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 29904 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:33:14.269688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-391cdbc1-382d-46ab-bf2c-fb35ac163ae2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:14.270365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-391cdbc1-382d-46ab-bf2c-fb35ac163ae2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:14.277096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-391cdbc1-382d-46ab-bf2c-fb35ac163ae2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:14.277535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-391cdbc1-382d-46ab-bf2c-fb35ac163ae2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:14.278291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-391cdbc1-382d-46ab-bf2c-fb35ac163ae2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:14.278714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-391cdbc1-382d-46ab-bf2c-fb35ac163ae2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:14.338494 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-391cdbc1-382d-46ab-bf2c-fb35ac163ae2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:14.346563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-391cdbc1-382d-46ab-bf2c-fb35ac163ae2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080531 Nov 02 23:33:14.347146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2147/2722] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:14 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:15.276082 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8184df94-4ae0-44ac-8789-62dd264d4478 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:15.276999 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8184df94-4ae0-44ac-8789-62dd264d4478 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:15.283330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8184df94-4ae0-44ac-8789-62dd264d4478 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:15.283782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8184df94-4ae0-44ac-8789-62dd264d4478 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:15.284550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8184df94-4ae0-44ac-8789-62dd264d4478 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:15.284983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8184df94-4ae0-44ac-8789-62dd264d4478 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:15.386199 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8184df94-4ae0-44ac-8789-62dd264d4478 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 31988 microversion: 2.20 time: 0.114192 Nov 02 23:33:15.386835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2148/2723] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:15 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 31988 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:33:15.391781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3be0a0e4-ba4c-400e-9033-e5b35b2643bf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:15.392461 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3be0a0e4-ba4c-400e-9033-e5b35b2643bf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:15.399448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3be0a0e4-ba4c-400e-9033-e5b35b2643bf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:15.400454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3be0a0e4-ba4c-400e-9033-e5b35b2643bf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:15.401219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3be0a0e4-ba4c-400e-9033-e5b35b2643bf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:15.401649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3be0a0e4-ba4c-400e-9033-e5b35b2643bf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:15.463670 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3be0a0e4-ba4c-400e-9033-e5b35b2643bf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:15.471952 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3be0a0e4-ba4c-400e-9033-e5b35b2643bf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.083835 Nov 02 23:33:15.472522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2149/2724] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:15 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:16.397659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-58418b84-b481-4f31-8943-535a4682757a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:16.398557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-58418b84-b481-4f31-8943-535a4682757a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:16.405346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58418b84-b481-4f31-8943-535a4682757a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:16.405786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58418b84-b481-4f31-8943-535a4682757a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:16.406532 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58418b84-b481-4f31-8943-535a4682757a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:16.406984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58418b84-b481-4f31-8943-535a4682757a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:16.517633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-58418b84-b481-4f31-8943-535a4682757a tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 33395 microversion: 2.20 time: 0.123470 Nov 02 23:33:16.518280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2150/2725] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:16 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 33395 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 23:33:16.523136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6826f311-7bc4-4f51-95d2-92d1d2999aab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:16.523814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6826f311-7bc4-4f51-95d2-92d1d2999aab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:16.530973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6826f311-7bc4-4f51-95d2-92d1d2999aab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:16.531425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6826f311-7bc4-4f51-95d2-92d1d2999aab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:16.532179 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6826f311-7bc4-4f51-95d2-92d1d2999aab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:16.532605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6826f311-7bc4-4f51-95d2-92d1d2999aab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:16.592061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6826f311-7bc4-4f51-95d2-92d1d2999aab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:16.600069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6826f311-7bc4-4f51-95d2-92d1d2999aab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080523 Nov 02 23:33:16.600627 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2151/2726] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:16 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:17.529164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9dbf9abd-1b87-4361-a0ae-67e649127c59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:17.530067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9dbf9abd-1b87-4361-a0ae-67e649127c59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:17.536284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9dbf9abd-1b87-4361-a0ae-67e649127c59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:17.536725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9dbf9abd-1b87-4361-a0ae-67e649127c59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:17.537477 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9dbf9abd-1b87-4361-a0ae-67e649127c59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:17.537904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9dbf9abd-1b87-4361-a0ae-67e649127c59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:17.639872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9dbf9abd-1b87-4361-a0ae-67e649127c59 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 34469 microversion: 2.20 time: 0.114183 Nov 02 23:33:17.640738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2152/2727] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:17 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 34469 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:33:17.645388 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-28ec9c85-e6c4-4160-b53d-c91870fda960 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:17.646069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-28ec9c85-e6c4-4160-b53d-c91870fda960 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:17.652894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-28ec9c85-e6c4-4160-b53d-c91870fda960 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:17.653331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-28ec9c85-e6c4-4160-b53d-c91870fda960 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:17.654089 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-28ec9c85-e6c4-4160-b53d-c91870fda960 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:17.654519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-28ec9c85-e6c4-4160-b53d-c91870fda960 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:17.714092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-28ec9c85-e6c4-4160-b53d-c91870fda960 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:17.722178 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-28ec9c85-e6c4-4160-b53d-c91870fda960 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080422 Nov 02 23:33:17.722748 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2153/2728] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:17 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:18.651362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-eb7d10f2-1b85-4465-a59b-982f95a3b794 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:18.652259 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-eb7d10f2-1b85-4465-a59b-982f95a3b794 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:18.658484 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb7d10f2-1b85-4465-a59b-982f95a3b794 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:18.658955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb7d10f2-1b85-4465-a59b-982f95a3b794 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:18.659699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb7d10f2-1b85-4465-a59b-982f95a3b794 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:18.660129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb7d10f2-1b85-4465-a59b-982f95a3b794 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:18.767045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-eb7d10f2-1b85-4465-a59b-982f95a3b794 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 35631 microversion: 2.20 time: 0.119243 Nov 02 23:33:18.767702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2154/2729] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:18 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 35631 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:33:18.772570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-037cdd35-c89a-4bb9-a4cd-d89207f11a59 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:18.773248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-037cdd35-c89a-4bb9-a4cd-d89207f11a59 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:18.779979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-037cdd35-c89a-4bb9-a4cd-d89207f11a59 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:18.780420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-037cdd35-c89a-4bb9-a4cd-d89207f11a59 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:18.781171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-037cdd35-c89a-4bb9-a4cd-d89207f11a59 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:18.781599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-037cdd35-c89a-4bb9-a4cd-d89207f11a59 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:18.844064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-037cdd35-c89a-4bb9-a4cd-d89207f11a59 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:18.852393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-037cdd35-c89a-4bb9-a4cd-d89207f11a59 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.083370 Nov 02 23:33:18.853506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2155/2730] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:18 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:19.779437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3c12843d-c733-49da-84d9-50240c0a1604 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:19.780339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3c12843d-c733-49da-84d9-50240c0a1604 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:19.786529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c12843d-c733-49da-84d9-50240c0a1604 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:19.787010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c12843d-c733-49da-84d9-50240c0a1604 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:19.787772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c12843d-c733-49da-84d9-50240c0a1604 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:19.788209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3c12843d-c733-49da-84d9-50240c0a1604 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:19.891697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3c12843d-c733-49da-84d9-50240c0a1604 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 37046 microversion: 2.20 time: 0.116438 Nov 02 23:33:19.892340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2156/2731] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:19 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 37046 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:33:19.897020 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f9909b72-a890-4eba-8e4d-efd2cea99955 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:19.897708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f9909b72-a890-4eba-8e4d-efd2cea99955 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:19.904413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f9909b72-a890-4eba-8e4d-efd2cea99955 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:19.904889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f9909b72-a890-4eba-8e4d-efd2cea99955 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:19.905645 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f9909b72-a890-4eba-8e4d-efd2cea99955 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:19.906077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f9909b72-a890-4eba-8e4d-efd2cea99955 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:19.966466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f9909b72-a890-4eba-8e4d-efd2cea99955 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:19.974152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f9909b72-a890-4eba-8e4d-efd2cea99955 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080735 Nov 02 23:33:19.974713 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2157/2732] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:19 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:20.903381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3a01f346-f42a-4986-8782-4e715eea9530 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:20.904279 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3a01f346-f42a-4986-8782-4e715eea9530 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:20.910452 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a01f346-f42a-4986-8782-4e715eea9530 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:20.910891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a01f346-f42a-4986-8782-4e715eea9530 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:20.911671 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a01f346-f42a-4986-8782-4e715eea9530 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:20.912095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a01f346-f42a-4986-8782-4e715eea9530 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:21.010673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3a01f346-f42a-4986-8782-4e715eea9530 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 38174 microversion: 2.20 time: 0.110756 Nov 02 23:33:21.011371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2158/2733] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:20 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 38174 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:33:21.016356 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5d1ce248-656c-407b-96af-dbae987f7b36 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:21.017041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5d1ce248-656c-407b-96af-dbae987f7b36 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:21.023791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d1ce248-656c-407b-96af-dbae987f7b36 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:21.024233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d1ce248-656c-407b-96af-dbae987f7b36 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:21.024995 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d1ce248-656c-407b-96af-dbae987f7b36 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:21.025424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d1ce248-656c-407b-96af-dbae987f7b36 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:21.084891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5d1ce248-656c-407b-96af-dbae987f7b36 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:21.093066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5d1ce248-656c-407b-96af-dbae987f7b36 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080441 Nov 02 23:33:21.093628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2159/2734] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:21 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:22.022496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b3c654b7-ad6e-4f92-be87-3823d39f1718 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:22.023424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b3c654b7-ad6e-4f92-be87-3823d39f1718 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:22.030198 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3c654b7-ad6e-4f92-be87-3823d39f1718 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:22.030638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3c654b7-ad6e-4f92-be87-3823d39f1718 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:22.031426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3c654b7-ad6e-4f92-be87-3823d39f1718 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:22.031854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3c654b7-ad6e-4f92-be87-3823d39f1718 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:22.121413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b3c654b7-ad6e-4f92-be87-3823d39f1718 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 38174 microversion: 2.20 time: 0.102479 Nov 02 23:33:22.122064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2160/2735] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:22 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 38174 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:33:22.126946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b2fac32e-ee37-4a5e-a108-a51e4e78169a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:22.127622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b2fac32e-ee37-4a5e-a108-a51e4e78169a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:22.134793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b2fac32e-ee37-4a5e-a108-a51e4e78169a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:22.135270 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b2fac32e-ee37-4a5e-a108-a51e4e78169a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:22.136022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b2fac32e-ee37-4a5e-a108-a51e4e78169a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:22.136449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b2fac32e-ee37-4a5e-a108-a51e4e78169a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:22.197139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b2fac32e-ee37-4a5e-a108-a51e4e78169a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:22.204910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b2fac32e-ee37-4a5e-a108-a51e4e78169a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081579 Nov 02 23:33:22.205468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2161/2736] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:22 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:23.133177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5653c5f7-7d78-41ec-8c0f-82c9e42f65f6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:23.134646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5653c5f7-7d78-41ec-8c0f-82c9e42f65f6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:23.140895 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5653c5f7-7d78-41ec-8c0f-82c9e42f65f6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:23.141337 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5653c5f7-7d78-41ec-8c0f-82c9e42f65f6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:23.142088 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5653c5f7-7d78-41ec-8c0f-82c9e42f65f6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:23.142509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5653c5f7-7d78-41ec-8c0f-82c9e42f65f6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:23.231398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5653c5f7-7d78-41ec-8c0f-82c9e42f65f6 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 38174 microversion: 2.20 time: 0.101711 Nov 02 23:33:23.232394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2162/2737] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:23 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 38174 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:33:23.236808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d6c45dea-a97c-439b-8226-1fc8f74a9d6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:23.237529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d6c45dea-a97c-439b-8226-1fc8f74a9d6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:23.244741 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6c45dea-a97c-439b-8226-1fc8f74a9d6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:23.245176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6c45dea-a97c-439b-8226-1fc8f74a9d6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:23.245927 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6c45dea-a97c-439b-8226-1fc8f74a9d6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:23.246349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6c45dea-a97c-439b-8226-1fc8f74a9d6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:23.306189 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d6c45dea-a97c-439b-8226-1fc8f74a9d6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:23.314637 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d6c45dea-a97c-439b-8226-1fc8f74a9d6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081513 Nov 02 23:33:23.315234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2163/2738] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:23 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:24.243281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-61844fdb-9793-4f71-a89a-c215fc574cb3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:24.244240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-61844fdb-9793-4f71-a89a-c215fc574cb3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:24.250612 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-61844fdb-9793-4f71-a89a-c215fc574cb3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:24.251096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-61844fdb-9793-4f71-a89a-c215fc574cb3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:24.251878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-61844fdb-9793-4f71-a89a-c215fc574cb3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:24.252309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-61844fdb-9793-4f71-a89a-c215fc574cb3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:24.350092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-61844fdb-9793-4f71-a89a-c215fc574cb3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 38174 microversion: 2.20 time: 0.110373 Nov 02 23:33:24.350744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2164/2739] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:24 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 38174 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:33:24.355501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c8449fe8-fb56-41a5-8410-94ee32d374e3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:24.356191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c8449fe8-fb56-41a5-8410-94ee32d374e3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:24.362944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8449fe8-fb56-41a5-8410-94ee32d374e3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:24.363416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8449fe8-fb56-41a5-8410-94ee32d374e3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:24.364190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8449fe8-fb56-41a5-8410-94ee32d374e3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:24.364628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8449fe8-fb56-41a5-8410-94ee32d374e3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:24.425325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c8449fe8-fb56-41a5-8410-94ee32d374e3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:24.433083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c8449fe8-fb56-41a5-8410-94ee32d374e3 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081212 Nov 02 23:33:24.433629 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2165/2740] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:24 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:25.362111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0d622a59-8c38-48d4-8bfd-eac1b445051b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:33:25.363044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0d622a59-8c38-48d4-8bfd-eac1b445051b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:25.369700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d622a59-8c38-48d4-8bfd-eac1b445051b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:25.370140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d622a59-8c38-48d4-8bfd-eac1b445051b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:25.370961 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d622a59-8c38-48d4-8bfd-eac1b445051b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:25.371394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d622a59-8c38-48d4-8bfd-eac1b445051b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:25.485596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0d622a59-8c38-48d4-8bfd-eac1b445051b tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action" status: 200 len: 38317 microversion: 2.20 time: 0.126950 Nov 02 23:33:25.486292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2166/2741] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 2 23:33:25 2021] POST /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/action => generated 38317 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:33:25.491685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7637ff61-fcb0-4b28-96af-e7018bf63a0b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:25.492377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7637ff61-fcb0-4b28-96af-e7018bf63a0b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:25.500000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7637ff61-fcb0-4b28-96af-e7018bf63a0b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:25.500509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7637ff61-fcb0-4b28-96af-e7018bf63a0b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:25.501301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7637ff61-fcb0-4b28-96af-e7018bf63a0b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:25.501726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7637ff61-fcb0-4b28-96af-e7018bf63a0b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:25.570547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7637ff61-fcb0-4b28-96af-e7018bf63a0b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:25.579245 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7637ff61-fcb0-4b28-96af-e7018bf63a0b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.091423 Nov 02 23:33:25.579837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2167/2742] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:25 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:33:25.584586 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-86b445f1-28d9-4753-addd-9301125feeb3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:25.585072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-86b445f1-28d9-4753-addd-9301125feeb3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:25.592269 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86b445f1-28d9-4753-addd-9301125feeb3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:25.592724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86b445f1-28d9-4753-addd-9301125feeb3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:25.593528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86b445f1-28d9-4753-addd-9301125feeb3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:25.593964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86b445f1-28d9-4753-addd-9301125feeb3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:25.619704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-86b445f1-28d9-4753-addd-9301125feeb3 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/ips" status: 200 len: 151 microversion: 2.20 time: 0.038802 Nov 02 23:33:25.620283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2168/2743] 10.222.0.41 () {60 vars in 1288 bytes} [Tue Nov 2 23:33:25 2021] GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 23:33:26.596737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-89a0cd87-4830-40cb-ab77-f7b1d6c93093 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:26.597475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-89a0cd87-4830-40cb-ab77-f7b1d6c93093 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:26.604065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-89a0cd87-4830-40cb-ab77-f7b1d6c93093 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:26.604509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-89a0cd87-4830-40cb-ab77-f7b1d6c93093 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:26.605269 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-89a0cd87-4830-40cb-ab77-f7b1d6c93093 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:26.605699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-89a0cd87-4830-40cb-ab77-f7b1d6c93093 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:26.663102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-89a0cd87-4830-40cb-ab77-f7b1d6c93093 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:26.671272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-89a0cd87-4830-40cb-ab77-f7b1d6c93093 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078189 Nov 02 23:33:26.671838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2169/2744] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:26 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:27.689429 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ae3b0ab4-3ed1-4944-b8fe-3b9876887e4d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:27.690135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ae3b0ab4-3ed1-4944-b8fe-3b9876887e4d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:27.697107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ae3b0ab4-3ed1-4944-b8fe-3b9876887e4d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:27.697550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ae3b0ab4-3ed1-4944-b8fe-3b9876887e4d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:27.698323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ae3b0ab4-3ed1-4944-b8fe-3b9876887e4d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:27.698751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ae3b0ab4-3ed1-4944-b8fe-3b9876887e4d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:27.760034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ae3b0ab4-3ed1-4944-b8fe-3b9876887e4d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:27.768182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ae3b0ab4-3ed1-4944-b8fe-3b9876887e4d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082694 Nov 02 23:33:27.768751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2170/2745] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:27 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:28.784726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4134a686-c1f0-4283-94e4-cc84254abade tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:28.785431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4134a686-c1f0-4283-94e4-cc84254abade tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:28.791588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4134a686-c1f0-4283-94e4-cc84254abade tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:28.792024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4134a686-c1f0-4283-94e4-cc84254abade tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:28.792785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4134a686-c1f0-4283-94e4-cc84254abade tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:28.793210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4134a686-c1f0-4283-94e4-cc84254abade tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:28.851715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4134a686-c1f0-4283-94e4-cc84254abade tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:28.859405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4134a686-c1f0-4283-94e4-cc84254abade tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078420 Nov 02 23:33:28.859973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2171/2746] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:28 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:29.875152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c89d8ae7-8fba-469e-b3bc-c51f14031536 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:29.875844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c89d8ae7-8fba-469e-b3bc-c51f14031536 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:29.881947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c89d8ae7-8fba-469e-b3bc-c51f14031536 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:29.882419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c89d8ae7-8fba-469e-b3bc-c51f14031536 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:29.883200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c89d8ae7-8fba-469e-b3bc-c51f14031536 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:29.883633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c89d8ae7-8fba-469e-b3bc-c51f14031536 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:29.941704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c89d8ae7-8fba-469e-b3bc-c51f14031536 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:29.949405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c89d8ae7-8fba-469e-b3bc-c51f14031536 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.077954 Nov 02 23:33:29.949959 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2172/2747] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:29 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:30.966504 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-563ceedd-4c27-4acc-9bb8-85f9e5c30c38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:30.967218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-563ceedd-4c27-4acc-9bb8-85f9e5c30c38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:30.975628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-563ceedd-4c27-4acc-9bb8-85f9e5c30c38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:30.976071 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-563ceedd-4c27-4acc-9bb8-85f9e5c30c38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:30.976846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-563ceedd-4c27-4acc-9bb8-85f9e5c30c38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:30.977278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-563ceedd-4c27-4acc-9bb8-85f9e5c30c38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:31.037303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-563ceedd-4c27-4acc-9bb8-85f9e5c30c38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:31.045135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-563ceedd-4c27-4acc-9bb8-85f9e5c30c38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082975 Nov 02 23:33:31.045703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2173/2748] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:30 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:32.061206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-74ee2fa9-7c3e-4278-8cc8-150cebda23c6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:32.062337 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-74ee2fa9-7c3e-4278-8cc8-150cebda23c6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:32.068408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74ee2fa9-7c3e-4278-8cc8-150cebda23c6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:32.068852 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74ee2fa9-7c3e-4278-8cc8-150cebda23c6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:32.069627 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74ee2fa9-7c3e-4278-8cc8-150cebda23c6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:32.070061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-74ee2fa9-7c3e-4278-8cc8-150cebda23c6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:32.134318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-74ee2fa9-7c3e-4278-8cc8-150cebda23c6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:32.142367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-74ee2fa9-7c3e-4278-8cc8-150cebda23c6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.084783 Nov 02 23:33:32.142979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2174/2749] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:32 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:33.158946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0acb6694-8895-4786-8788-9a01bc682355 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:33.159647 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0acb6694-8895-4786-8788-9a01bc682355 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:33.165903 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0acb6694-8895-4786-8788-9a01bc682355 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:33.166858 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0acb6694-8895-4786-8788-9a01bc682355 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:33.167648 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0acb6694-8895-4786-8788-9a01bc682355 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:33.168086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0acb6694-8895-4786-8788-9a01bc682355 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:33.231467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0acb6694-8895-4786-8788-9a01bc682355 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:33.241511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0acb6694-8895-4786-8788-9a01bc682355 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.086152 Nov 02 23:33:33.242126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2175/2750] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:33 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:34.258946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0eee8950-de03-4289-aad2-9b3331a66e03 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:34.259637 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0eee8950-de03-4289-aad2-9b3331a66e03 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:34.266412 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0eee8950-de03-4289-aad2-9b3331a66e03 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:34.266849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0eee8950-de03-4289-aad2-9b3331a66e03 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:34.267660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0eee8950-de03-4289-aad2-9b3331a66e03 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:34.268091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0eee8950-de03-4289-aad2-9b3331a66e03 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:34.330133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0eee8950-de03-4289-aad2-9b3331a66e03 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:34.339016 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0eee8950-de03-4289-aad2-9b3331a66e03 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.083711 Nov 02 23:33:34.339537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2176/2751] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:34 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:35.355589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7ce875b5-3fd1-4c38-8ad7-7819359b8445 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:35.356249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7ce875b5-3fd1-4c38-8ad7-7819359b8445 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:35.362369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ce875b5-3fd1-4c38-8ad7-7819359b8445 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:35.362809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ce875b5-3fd1-4c38-8ad7-7819359b8445 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:35.363600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ce875b5-3fd1-4c38-8ad7-7819359b8445 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:35.364026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7ce875b5-3fd1-4c38-8ad7-7819359b8445 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:35.423512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7ce875b5-3fd1-4c38-8ad7-7819359b8445 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:35.431478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7ce875b5-3fd1-4c38-8ad7-7819359b8445 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.079623 Nov 02 23:33:35.432042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2177/2752] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:35 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:36.448218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5f1fbb41-96f8-4605-a977-f86ac988d852 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:36.448897 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5f1fbb41-96f8-4605-a977-f86ac988d852 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:36.455220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f1fbb41-96f8-4605-a977-f86ac988d852 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:36.455665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f1fbb41-96f8-4605-a977-f86ac988d852 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:36.456417 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f1fbb41-96f8-4605-a977-f86ac988d852 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:36.456844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f1fbb41-96f8-4605-a977-f86ac988d852 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:36.515777 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5f1fbb41-96f8-4605-a977-f86ac988d852 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:36.523360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5f1fbb41-96f8-4605-a977-f86ac988d852 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078783 Nov 02 23:33:36.523922 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2178/2753] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:36 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:37.540006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f2a4a17c-7f2d-413f-bbd2-2cc2bb75ad18 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:37.540706 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f2a4a17c-7f2d-413f-bbd2-2cc2bb75ad18 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:37.546948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f2a4a17c-7f2d-413f-bbd2-2cc2bb75ad18 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:37.547390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f2a4a17c-7f2d-413f-bbd2-2cc2bb75ad18 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:37.548161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f2a4a17c-7f2d-413f-bbd2-2cc2bb75ad18 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:37.548593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f2a4a17c-7f2d-413f-bbd2-2cc2bb75ad18 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:37.611311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f2a4a17c-7f2d-413f-bbd2-2cc2bb75ad18 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:37.619985 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f2a4a17c-7f2d-413f-bbd2-2cc2bb75ad18 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082950 Nov 02 23:33:37.620568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2179/2754] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:37 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:38.637054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1bf9d413-ad28-4e99-9ef0-9dd233bbb8ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:38.637789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1bf9d413-ad28-4e99-9ef0-9dd233bbb8ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:38.644634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1bf9d413-ad28-4e99-9ef0-9dd233bbb8ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:38.645087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1bf9d413-ad28-4e99-9ef0-9dd233bbb8ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:38.645865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1bf9d413-ad28-4e99-9ef0-9dd233bbb8ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:38.646299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1bf9d413-ad28-4e99-9ef0-9dd233bbb8ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:38.711646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1bf9d413-ad28-4e99-9ef0-9dd233bbb8ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:38.724787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1bf9d413-ad28-4e99-9ef0-9dd233bbb8ee tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.091485 Nov 02 23:33:38.725727 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2180/2755] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:38 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:39.744983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d35e500d-e667-4ce7-bd4f-7f343d356a11 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:39.745706 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d35e500d-e667-4ce7-bd4f-7f343d356a11 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:39.751947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d35e500d-e667-4ce7-bd4f-7f343d356a11 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:39.752397 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d35e500d-e667-4ce7-bd4f-7f343d356a11 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:39.753171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d35e500d-e667-4ce7-bd4f-7f343d356a11 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:39.753604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d35e500d-e667-4ce7-bd4f-7f343d356a11 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:39.813132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d35e500d-e667-4ce7-bd4f-7f343d356a11 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:39.821707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d35e500d-e667-4ce7-bd4f-7f343d356a11 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080565 Nov 02 23:33:39.822822 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2181/2756] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:39 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:40.838547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3946592f-e6cf-4a72-8292-13db6b4ae4cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:40.839184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3946592f-e6cf-4a72-8292-13db6b4ae4cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:40.845420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3946592f-e6cf-4a72-8292-13db6b4ae4cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:40.845861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3946592f-e6cf-4a72-8292-13db6b4ae4cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:40.846623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3946592f-e6cf-4a72-8292-13db6b4ae4cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:40.847086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3946592f-e6cf-4a72-8292-13db6b4ae4cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:40.907094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3946592f-e6cf-4a72-8292-13db6b4ae4cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:40.914885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3946592f-e6cf-4a72-8292-13db6b4ae4cd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.079978 Nov 02 23:33:40.915482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2182/2757] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:40 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:41.931429 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-43da1b9c-bef3-4f1f-a327-c29595fa4087 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:41.932632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-43da1b9c-bef3-4f1f-a327-c29595fa4087 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:41.939069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-43da1b9c-bef3-4f1f-a327-c29595fa4087 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:41.939513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-43da1b9c-bef3-4f1f-a327-c29595fa4087 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:41.940275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-43da1b9c-bef3-4f1f-a327-c29595fa4087 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:41.940705 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-43da1b9c-bef3-4f1f-a327-c29595fa4087 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:41.999122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-43da1b9c-bef3-4f1f-a327-c29595fa4087 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:42.006793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-43da1b9c-bef3-4f1f-a327-c29595fa4087 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.079082 Nov 02 23:33:42.007391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2183/2758] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:41 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:43.024007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3d95bb1d-747b-49fc-96f5-0f8c3938197f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:43.024724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3d95bb1d-747b-49fc-96f5-0f8c3938197f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:43.031618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3d95bb1d-747b-49fc-96f5-0f8c3938197f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:43.032044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3d95bb1d-747b-49fc-96f5-0f8c3938197f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:43.032826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3d95bb1d-747b-49fc-96f5-0f8c3938197f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:43.033253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3d95bb1d-747b-49fc-96f5-0f8c3938197f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:43.093083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3d95bb1d-747b-49fc-96f5-0f8c3938197f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:43.100951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3d95bb1d-747b-49fc-96f5-0f8c3938197f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080653 Nov 02 23:33:43.101527 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2184/2759] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:43 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:44.117252 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e5f6162e-f7d5-4fe4-a23a-1615c385ff79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:44.117945 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e5f6162e-f7d5-4fe4-a23a-1615c385ff79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:44.124105 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e5f6162e-f7d5-4fe4-a23a-1615c385ff79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:44.124548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e5f6162e-f7d5-4fe4-a23a-1615c385ff79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:44.125298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e5f6162e-f7d5-4fe4-a23a-1615c385ff79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:44.125722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e5f6162e-f7d5-4fe4-a23a-1615c385ff79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:44.183681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e5f6162e-f7d5-4fe4-a23a-1615c385ff79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:44.191556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e5f6162e-f7d5-4fe4-a23a-1615c385ff79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.077973 Nov 02 23:33:44.192110 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2185/2760] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:44 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:45.207933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d63c7d01-0432-467e-9058-1ad5177bf173 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:45.208581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d63c7d01-0432-467e-9058-1ad5177bf173 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:45.214691 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d63c7d01-0432-467e-9058-1ad5177bf173 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:45.215162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d63c7d01-0432-467e-9058-1ad5177bf173 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:45.215917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d63c7d01-0432-467e-9058-1ad5177bf173 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:45.216342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d63c7d01-0432-467e-9058-1ad5177bf173 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:45.277467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d63c7d01-0432-467e-9058-1ad5177bf173 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:45.285079 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d63c7d01-0432-467e-9058-1ad5177bf173 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080840 Nov 02 23:33:45.285631 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2186/2761] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:45 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:46.302526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-31f908d7-c5fa-49a3-b98a-bab86780954a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:46.303225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-31f908d7-c5fa-49a3-b98a-bab86780954a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:46.309872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-31f908d7-c5fa-49a3-b98a-bab86780954a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:46.310316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-31f908d7-c5fa-49a3-b98a-bab86780954a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:46.311106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-31f908d7-c5fa-49a3-b98a-bab86780954a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:46.311538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-31f908d7-c5fa-49a3-b98a-bab86780954a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:46.370217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-31f908d7-c5fa-49a3-b98a-bab86780954a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:46.377869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-31f908d7-c5fa-49a3-b98a-bab86780954a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.079000 Nov 02 23:33:46.378445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2187/2762] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:46 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:47.395173 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-367abcab-b6a0-4015-989e-0e9260398593 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:47.396019 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-367abcab-b6a0-4015-989e-0e9260398593 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:47.402091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-367abcab-b6a0-4015-989e-0e9260398593 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:47.402528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-367abcab-b6a0-4015-989e-0e9260398593 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:47.403330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-367abcab-b6a0-4015-989e-0e9260398593 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:47.403753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-367abcab-b6a0-4015-989e-0e9260398593 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:47.464930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-367abcab-b6a0-4015-989e-0e9260398593 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:47.472776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-367abcab-b6a0-4015-989e-0e9260398593 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081250 Nov 02 23:33:47.473344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2188/2763] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:47 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:48.489991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e630866c-1888-467c-b0dc-2ebb71e2f4aa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:48.490713 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e630866c-1888-467c-b0dc-2ebb71e2f4aa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:48.498341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e630866c-1888-467c-b0dc-2ebb71e2f4aa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:48.498787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e630866c-1888-467c-b0dc-2ebb71e2f4aa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:48.499633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e630866c-1888-467c-b0dc-2ebb71e2f4aa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:48.500284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e630866c-1888-467c-b0dc-2ebb71e2f4aa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:48.563797 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e630866c-1888-467c-b0dc-2ebb71e2f4aa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:48.571458 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e630866c-1888-467c-b0dc-2ebb71e2f4aa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.085125 Nov 02 23:33:48.572052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2189/2764] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:48 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:49.588957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c4d9473c-754e-4879-8c30-ce0063b1c1c6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:49.590265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c4d9473c-754e-4879-8c30-ce0063b1c1c6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:49.596371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4d9473c-754e-4879-8c30-ce0063b1c1c6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:49.596814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4d9473c-754e-4879-8c30-ce0063b1c1c6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:49.597573 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4d9473c-754e-4879-8c30-ce0063b1c1c6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:49.598014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c4d9473c-754e-4879-8c30-ce0063b1c1c6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:49.657744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c4d9473c-754e-4879-8c30-ce0063b1c1c6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:49.665647 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c4d9473c-754e-4879-8c30-ce0063b1c1c6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080442 Nov 02 23:33:49.666202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2190/2765] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:49 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:50.682038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a48b3a81-0dff-4e52-b14e-509afde84fc4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:50.682748 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a48b3a81-0dff-4e52-b14e-509afde84fc4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:50.689059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a48b3a81-0dff-4e52-b14e-509afde84fc4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:50.689499 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a48b3a81-0dff-4e52-b14e-509afde84fc4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:50.690261 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a48b3a81-0dff-4e52-b14e-509afde84fc4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:50.690688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a48b3a81-0dff-4e52-b14e-509afde84fc4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:50.749514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a48b3a81-0dff-4e52-b14e-509afde84fc4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:50.757355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a48b3a81-0dff-4e52-b14e-509afde84fc4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078979 Nov 02 23:33:50.757922 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2191/2766] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:50 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:51.774057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d2ecb6a4-2f28-4386-a779-8a95cdf09a7e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:51.775436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d2ecb6a4-2f28-4386-a779-8a95cdf09a7e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:51.782534 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2ecb6a4-2f28-4386-a779-8a95cdf09a7e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:51.783006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2ecb6a4-2f28-4386-a779-8a95cdf09a7e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:51.783811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2ecb6a4-2f28-4386-a779-8a95cdf09a7e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:51.784239 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2ecb6a4-2f28-4386-a779-8a95cdf09a7e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:51.847438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d2ecb6a4-2f28-4386-a779-8a95cdf09a7e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:51.855896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d2ecb6a4-2f28-4386-a779-8a95cdf09a7e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.085607 Nov 02 23:33:51.856564 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2192/2767] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:51 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:52.871671 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b304bf3e-7f61-45a3-8281-180194da23a5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:52.872437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b304bf3e-7f61-45a3-8281-180194da23a5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:52.878647 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b304bf3e-7f61-45a3-8281-180194da23a5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:52.879119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b304bf3e-7f61-45a3-8281-180194da23a5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:52.879903 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b304bf3e-7f61-45a3-8281-180194da23a5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:52.880326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b304bf3e-7f61-45a3-8281-180194da23a5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:52.940987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b304bf3e-7f61-45a3-8281-180194da23a5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:52.949528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b304bf3e-7f61-45a3-8281-180194da23a5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080926 Nov 02 23:33:52.950099 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2193/2768] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:52 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:53.967029 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aca5ee5f-e64e-4b26-9209-d3245565aa5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:53.967758 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aca5ee5f-e64e-4b26-9209-d3245565aa5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:53.974263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aca5ee5f-e64e-4b26-9209-d3245565aa5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:53.974969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aca5ee5f-e64e-4b26-9209-d3245565aa5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:53.975857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aca5ee5f-e64e-4b26-9209-d3245565aa5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:53.976290 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aca5ee5f-e64e-4b26-9209-d3245565aa5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:54.038304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aca5ee5f-e64e-4b26-9209-d3245565aa5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:54.047124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aca5ee5f-e64e-4b26-9209-d3245565aa5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.084215 Nov 02 23:33:54.047711 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2194/2769] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:53 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:55.063994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-849e6541-a250-471b-bd10-9010af617334 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:55.064711 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-849e6541-a250-471b-bd10-9010af617334 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:55.070851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-849e6541-a250-471b-bd10-9010af617334 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:55.071323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-849e6541-a250-471b-bd10-9010af617334 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:55.072084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-849e6541-a250-471b-bd10-9010af617334 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:55.072512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-849e6541-a250-471b-bd10-9010af617334 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:55.134265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-849e6541-a250-471b-bd10-9010af617334 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:55.142505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-849e6541-a250-471b-bd10-9010af617334 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082388 Nov 02 23:33:55.143102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2195/2770] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:55 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:56.158819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d9d5794a-120e-4ad6-939a-62ee9994b589 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:56.159549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d9d5794a-120e-4ad6-939a-62ee9994b589 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:56.165661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9d5794a-120e-4ad6-939a-62ee9994b589 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:56.166099 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9d5794a-120e-4ad6-939a-62ee9994b589 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:56.166855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9d5794a-120e-4ad6-939a-62ee9994b589 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:56.167940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9d5794a-120e-4ad6-939a-62ee9994b589 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:56.278963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d9d5794a-120e-4ad6-939a-62ee9994b589 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:56.286575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d9d5794a-120e-4ad6-939a-62ee9994b589 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.131392 Nov 02 23:33:56.287162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2196/2771] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:56 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:57.303589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-68c55e25-29fe-4709-b8da-2f6e2e382c4e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:57.304242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-68c55e25-29fe-4709-b8da-2f6e2e382c4e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:57.311039 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-68c55e25-29fe-4709-b8da-2f6e2e382c4e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:57.311734 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-68c55e25-29fe-4709-b8da-2f6e2e382c4e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:57.312490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-68c55e25-29fe-4709-b8da-2f6e2e382c4e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:57.312915 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-68c55e25-29fe-4709-b8da-2f6e2e382c4e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:57.370701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-68c55e25-29fe-4709-b8da-2f6e2e382c4e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:57.379366 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-68c55e25-29fe-4709-b8da-2f6e2e382c4e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.079337 Nov 02 23:33:57.379945 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2197/2772] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:57 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:57.692074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:33:57.692340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:33:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 23:33:58.396044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6f5d3e35-2bbe-4269-aca3-73939d379229 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:58.396741 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6f5d3e35-2bbe-4269-aca3-73939d379229 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:58.402850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f5d3e35-2bbe-4269-aca3-73939d379229 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:58.403334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f5d3e35-2bbe-4269-aca3-73939d379229 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:58.404098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f5d3e35-2bbe-4269-aca3-73939d379229 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:58.404531 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f5d3e35-2bbe-4269-aca3-73939d379229 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:58.467521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6f5d3e35-2bbe-4269-aca3-73939d379229 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:58.475535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6f5d3e35-2bbe-4269-aca3-73939d379229 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.083150 Nov 02 23:33:58.476128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2198/2773] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:58 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:33:59.491518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dfe9ee9f-f75e-4845-b413-6737c145ef0e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:33:59.492190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dfe9ee9f-f75e-4845-b413-6737c145ef0e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:33:59.498305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dfe9ee9f-f75e-4845-b413-6737c145ef0e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:59.498747 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dfe9ee9f-f75e-4845-b413-6737c145ef0e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:59.499558 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dfe9ee9f-f75e-4845-b413-6737c145ef0e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:33:59.499989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dfe9ee9f-f75e-4845-b413-6737c145ef0e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:33:59.558763 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dfe9ee9f-f75e-4845-b413-6737c145ef0e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:33:59.566851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dfe9ee9f-f75e-4845-b413-6737c145ef0e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.079114 Nov 02 23:33:59.567439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2199/2774] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:33:59 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:00.584532 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4ce0cde4-8a83-441c-94e2-f05e35f8b82b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:00.585223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4ce0cde4-8a83-441c-94e2-f05e35f8b82b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:00.591694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ce0cde4-8a83-441c-94e2-f05e35f8b82b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:00.592132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ce0cde4-8a83-441c-94e2-f05e35f8b82b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:00.592898 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ce0cde4-8a83-441c-94e2-f05e35f8b82b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:00.593323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ce0cde4-8a83-441c-94e2-f05e35f8b82b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:00.654296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4ce0cde4-8a83-441c-94e2-f05e35f8b82b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:00.661930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4ce0cde4-8a83-441c-94e2-f05e35f8b82b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081473 Nov 02 23:34:00.662495 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2200/2775] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:00 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:01.679328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3e15a8f8-7663-4a89-8c70-66394aa7f363 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:01.680052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3e15a8f8-7663-4a89-8c70-66394aa7f363 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:01.687295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e15a8f8-7663-4a89-8c70-66394aa7f363 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:01.687746 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e15a8f8-7663-4a89-8c70-66394aa7f363 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:01.688517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e15a8f8-7663-4a89-8c70-66394aa7f363 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:01.688956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e15a8f8-7663-4a89-8c70-66394aa7f363 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:01.750482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3e15a8f8-7663-4a89-8c70-66394aa7f363 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:01.769060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3e15a8f8-7663-4a89-8c70-66394aa7f363 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.093328 Nov 02 23:34:01.769636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2201/2776] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:01 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:02.785380 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-48c25d58-1f09-41e9-bf94-cbdc66388b79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:02.786265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-48c25d58-1f09-41e9-bf94-cbdc66388b79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:02.792127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48c25d58-1f09-41e9-bf94-cbdc66388b79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:02.792576 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48c25d58-1f09-41e9-bf94-cbdc66388b79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:02.793344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48c25d58-1f09-41e9-bf94-cbdc66388b79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:02.793779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48c25d58-1f09-41e9-bf94-cbdc66388b79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:02.851941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-48c25d58-1f09-41e9-bf94-cbdc66388b79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:02.859731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-48c25d58-1f09-41e9-bf94-cbdc66388b79 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078063 Nov 02 23:34:02.860404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2202/2777] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:02 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:03.876854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ddeba944-80ba-45d7-a5af-a2bf846e5636 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:03.877589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ddeba944-80ba-45d7-a5af-a2bf846e5636 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:03.884041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddeba944-80ba-45d7-a5af-a2bf846e5636 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:03.884495 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddeba944-80ba-45d7-a5af-a2bf846e5636 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:03.885278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddeba944-80ba-45d7-a5af-a2bf846e5636 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:03.885715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddeba944-80ba-45d7-a5af-a2bf846e5636 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:03.946330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ddeba944-80ba-45d7-a5af-a2bf846e5636 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:03.954394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ddeba944-80ba-45d7-a5af-a2bf846e5636 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081203 Nov 02 23:34:03.954996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2203/2778] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:03 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:04.971464 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c53c7442-c622-4999-be32-173b792cc8a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:04.972189 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c53c7442-c622-4999-be32-173b792cc8a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:04.978268 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c53c7442-c622-4999-be32-173b792cc8a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:04.978706 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c53c7442-c622-4999-be32-173b792cc8a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:04.979496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c53c7442-c622-4999-be32-173b792cc8a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:04.979925 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c53c7442-c622-4999-be32-173b792cc8a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:05.043616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c53c7442-c622-4999-be32-173b792cc8a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:05.051735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c53c7442-c622-4999-be32-173b792cc8a2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.083876 Nov 02 23:34:05.052324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2204/2779] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:04 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:06.069231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e0aa2bab-51bd-4331-aea5-cd55b64c774f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:06.069943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e0aa2bab-51bd-4331-aea5-cd55b64c774f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:06.076166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0aa2bab-51bd-4331-aea5-cd55b64c774f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:06.076614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0aa2bab-51bd-4331-aea5-cd55b64c774f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:06.077387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0aa2bab-51bd-4331-aea5-cd55b64c774f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:06.077817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e0aa2bab-51bd-4331-aea5-cd55b64c774f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:06.136634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e0aa2bab-51bd-4331-aea5-cd55b64c774f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:06.144326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e0aa2bab-51bd-4331-aea5-cd55b64c774f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078784 Nov 02 23:34:06.144894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2205/2780] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:06 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:07.160966 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a5424e34-8824-41a7-a2e2-00076e5d6899 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:07.161825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a5424e34-8824-41a7-a2e2-00076e5d6899 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:07.168943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5424e34-8824-41a7-a2e2-00076e5d6899 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:07.169394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5424e34-8824-41a7-a2e2-00076e5d6899 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:07.170183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5424e34-8824-41a7-a2e2-00076e5d6899 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:07.170619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5424e34-8824-41a7-a2e2-00076e5d6899 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:07.237839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a5424e34-8824-41a7-a2e2-00076e5d6899 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:07.247244 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a5424e34-8824-41a7-a2e2-00076e5d6899 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.089921 Nov 02 23:34:07.247841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2206/2781] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:07 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:08.263716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-79fad790-c9ec-4cba-9a2f-1cee9528b968 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:08.264502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-79fad790-c9ec-4cba-9a2f-1cee9528b968 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:08.270748 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79fad790-c9ec-4cba-9a2f-1cee9528b968 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:08.271229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79fad790-c9ec-4cba-9a2f-1cee9528b968 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:08.272014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79fad790-c9ec-4cba-9a2f-1cee9528b968 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:08.272447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-79fad790-c9ec-4cba-9a2f-1cee9528b968 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:08.333981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-79fad790-c9ec-4cba-9a2f-1cee9528b968 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:08.344051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-79fad790-c9ec-4cba-9a2f-1cee9528b968 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.084360 Nov 02 23:34:08.344646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2207/2782] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:08 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:09.360755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-35769a31-870c-422e-b744-32445278ccb1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:09.361485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-35769a31-870c-422e-b744-32445278ccb1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:09.367918 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-35769a31-870c-422e-b744-32445278ccb1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:09.368362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-35769a31-870c-422e-b744-32445278ccb1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:09.369144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-35769a31-870c-422e-b744-32445278ccb1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:09.369575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-35769a31-870c-422e-b744-32445278ccb1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:09.435877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-35769a31-870c-422e-b744-32445278ccb1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:09.444612 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-35769a31-870c-422e-b744-32445278ccb1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.087455 Nov 02 23:34:09.445208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2208/2783] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:09 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:10.462188 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-62fd5937-786f-403e-bc71-6088fe571fa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:10.462890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-62fd5937-786f-403e-bc71-6088fe571fa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:10.469245 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-62fd5937-786f-403e-bc71-6088fe571fa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:10.469689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-62fd5937-786f-403e-bc71-6088fe571fa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:10.470476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-62fd5937-786f-403e-bc71-6088fe571fa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:10.470896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-62fd5937-786f-403e-bc71-6088fe571fa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:10.533468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-62fd5937-786f-403e-bc71-6088fe571fa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:10.541614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-62fd5937-786f-403e-bc71-6088fe571fa1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.083187 Nov 02 23:34:10.542201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2209/2784] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:10 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:11.559775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aceb879f-5b68-4e82-a71c-c0ad928aa1e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:11.560549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aceb879f-5b68-4e82-a71c-c0ad928aa1e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:11.567975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aceb879f-5b68-4e82-a71c-c0ad928aa1e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:11.569272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aceb879f-5b68-4e82-a71c-c0ad928aa1e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:11.570093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aceb879f-5b68-4e82-a71c-c0ad928aa1e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:11.571192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aceb879f-5b68-4e82-a71c-c0ad928aa1e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:11.647334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aceb879f-5b68-4e82-a71c-c0ad928aa1e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:11.656715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aceb879f-5b68-4e82-a71c-c0ad928aa1e1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.101367 Nov 02 23:34:11.657305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2210/2785] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:11 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:12.673901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1f917e63-6973-4cd0-818b-550bb61f0737 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:12.674610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1f917e63-6973-4cd0-818b-550bb61f0737 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:12.680987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f917e63-6973-4cd0-818b-550bb61f0737 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:12.681421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f917e63-6973-4cd0-818b-550bb61f0737 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:12.682189 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f917e63-6973-4cd0-818b-550bb61f0737 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:12.682616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f917e63-6973-4cd0-818b-550bb61f0737 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:12.747971 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1f917e63-6973-4cd0-818b-550bb61f0737 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:12.756451 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1f917e63-6973-4cd0-818b-550bb61f0737 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.086130 Nov 02 23:34:12.757039 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2211/2786] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:12 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:13.774171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c57df1bc-e2ac-4696-a8d8-aadc8e1b88a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:13.774853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c57df1bc-e2ac-4696-a8d8-aadc8e1b88a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:13.784830 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c57df1bc-e2ac-4696-a8d8-aadc8e1b88a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:13.785632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c57df1bc-e2ac-4696-a8d8-aadc8e1b88a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:13.787072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c57df1bc-e2ac-4696-a8d8-aadc8e1b88a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:13.787847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c57df1bc-e2ac-4696-a8d8-aadc8e1b88a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:13.877098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c57df1bc-e2ac-4696-a8d8-aadc8e1b88a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:13.885751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c57df1bc-e2ac-4696-a8d8-aadc8e1b88a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.115191 Nov 02 23:34:13.886358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2212/2787] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:13 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:14.902403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4f2ac618-7c09-4ea5-9eac-1878285f24f1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:14.903133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4f2ac618-7c09-4ea5-9eac-1878285f24f1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:14.909467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f2ac618-7c09-4ea5-9eac-1878285f24f1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:14.909910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f2ac618-7c09-4ea5-9eac-1878285f24f1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:14.910680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f2ac618-7c09-4ea5-9eac-1878285f24f1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:14.911140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f2ac618-7c09-4ea5-9eac-1878285f24f1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:14.974134 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4f2ac618-7c09-4ea5-9eac-1878285f24f1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:14.982675 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4f2ac618-7c09-4ea5-9eac-1878285f24f1 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.083952 Nov 02 23:34:14.983291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2213/2788] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:14 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:15.999233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-08a39bab-7797-4ec8-b58b-1961398d360e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:15.999943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-08a39bab-7797-4ec8-b58b-1961398d360e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:16.006360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08a39bab-7797-4ec8-b58b-1961398d360e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:16.006806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08a39bab-7797-4ec8-b58b-1961398d360e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:16.007605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08a39bab-7797-4ec8-b58b-1961398d360e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:16.008042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08a39bab-7797-4ec8-b58b-1961398d360e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:16.069316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-08a39bab-7797-4ec8-b58b-1961398d360e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:16.078006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-08a39bab-7797-4ec8-b58b-1961398d360e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082721 Nov 02 23:34:16.078586 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2214/2789] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:15 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:17.097240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-239e3b46-6901-4480-a8fb-6ec797fcf871 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:17.097955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-239e3b46-6901-4480-a8fb-6ec797fcf871 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:17.104395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-239e3b46-6901-4480-a8fb-6ec797fcf871 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:17.104844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-239e3b46-6901-4480-a8fb-6ec797fcf871 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:17.105628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-239e3b46-6901-4480-a8fb-6ec797fcf871 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:17.106055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-239e3b46-6901-4480-a8fb-6ec797fcf871 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:17.168930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-239e3b46-6901-4480-a8fb-6ec797fcf871 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:17.176920 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-239e3b46-6901-4480-a8fb-6ec797fcf871 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.083397 Nov 02 23:34:17.177500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2215/2790] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:17 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:34:18.194946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-645e1b9e-6339-4a86-9b02-e94be1701e19 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:18.195701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-645e1b9e-6339-4a86-9b02-e94be1701e19 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:18.202140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-645e1b9e-6339-4a86-9b02-e94be1701e19 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:18.202574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-645e1b9e-6339-4a86-9b02-e94be1701e19 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:18.203408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-645e1b9e-6339-4a86-9b02-e94be1701e19 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:18.203841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-645e1b9e-6339-4a86-9b02-e94be1701e19 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:18.277578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-645e1b9e-6339-4a86-9b02-e94be1701e19 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:18.288289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-645e1b9e-6339-4a86-9b02-e94be1701e19 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.097137 Nov 02 23:34:18.288904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2216/2791] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:18 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:19.307180 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-046993af-4b80-4653-b639-53f0f021407b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:19.307863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-046993af-4b80-4653-b639-53f0f021407b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:19.314476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-046993af-4b80-4653-b639-53f0f021407b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:19.314933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-046993af-4b80-4653-b639-53f0f021407b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:19.315699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-046993af-4b80-4653-b639-53f0f021407b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:19.316133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-046993af-4b80-4653-b639-53f0f021407b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:19.376322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-046993af-4b80-4653-b639-53f0f021407b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:19.384166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-046993af-4b80-4653-b639-53f0f021407b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080646 Nov 02 23:34:19.384737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2217/2792] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:19 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:20.399950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0d362c5f-e297-43c1-b661-7bb0b4f0b410 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:20.400679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0d362c5f-e297-43c1-b661-7bb0b4f0b410 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:20.407568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d362c5f-e297-43c1-b661-7bb0b4f0b410 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:20.408014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d362c5f-e297-43c1-b661-7bb0b4f0b410 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:20.408779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d362c5f-e297-43c1-b661-7bb0b4f0b410 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:20.409215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d362c5f-e297-43c1-b661-7bb0b4f0b410 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:20.472703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0d362c5f-e297-43c1-b661-7bb0b4f0b410 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:20.480637 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0d362c5f-e297-43c1-b661-7bb0b4f0b410 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.084319 Nov 02 23:34:20.481218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2218/2793] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:20 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:21.498079 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-862f3aad-2a0d-4b63-bbe4-ba2bc9c14725 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:21.498812 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-862f3aad-2a0d-4b63-bbe4-ba2bc9c14725 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:21.504979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-862f3aad-2a0d-4b63-bbe4-ba2bc9c14725 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:21.505507 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-862f3aad-2a0d-4b63-bbe4-ba2bc9c14725 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:21.506442 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-862f3aad-2a0d-4b63-bbe4-ba2bc9c14725 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:21.506893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-862f3aad-2a0d-4b63-bbe4-ba2bc9c14725 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:21.568302 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-862f3aad-2a0d-4b63-bbe4-ba2bc9c14725 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:21.576902 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-862f3aad-2a0d-4b63-bbe4-ba2bc9c14725 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.083030 Nov 02 23:34:21.577469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2219/2794] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:21 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:22.594097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3f222980-b57e-4192-be66-d5a4875e8997 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:22.594799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3f222980-b57e-4192-be66-d5a4875e8997 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:22.601113 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f222980-b57e-4192-be66-d5a4875e8997 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:22.601555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f222980-b57e-4192-be66-d5a4875e8997 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:22.602318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f222980-b57e-4192-be66-d5a4875e8997 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:22.602745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f222980-b57e-4192-be66-d5a4875e8997 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:22.664143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3f222980-b57e-4192-be66-d5a4875e8997 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:22.672343 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3f222980-b57e-4192-be66-d5a4875e8997 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082561 Nov 02 23:34:22.672933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2220/2795] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:22 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:23.689946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a9ff774e-a790-4f36-99e7-5d5022ea25b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:23.690632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a9ff774e-a790-4f36-99e7-5d5022ea25b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:23.696765 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9ff774e-a790-4f36-99e7-5d5022ea25b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:23.697204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9ff774e-a790-4f36-99e7-5d5022ea25b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:23.697955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9ff774e-a790-4f36-99e7-5d5022ea25b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:23.698381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9ff774e-a790-4f36-99e7-5d5022ea25b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:23.758146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a9ff774e-a790-4f36-99e7-5d5022ea25b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:23.766640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a9ff774e-a790-4f36-99e7-5d5022ea25b2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080540 Nov 02 23:34:23.767264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2221/2796] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:23 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:24.784021 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-77b6eb2a-e543-46e8-84ac-56d6189025f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:24.784773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-77b6eb2a-e543-46e8-84ac-56d6189025f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:24.790907 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-77b6eb2a-e543-46e8-84ac-56d6189025f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:24.791376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-77b6eb2a-e543-46e8-84ac-56d6189025f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:24.792135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-77b6eb2a-e543-46e8-84ac-56d6189025f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:24.792557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-77b6eb2a-e543-46e8-84ac-56d6189025f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:24.856303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-77b6eb2a-e543-46e8-84ac-56d6189025f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:24.864819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-77b6eb2a-e543-46e8-84ac-56d6189025f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.084444 Nov 02 23:34:24.865386 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2222/2797] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:24 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:25.881672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cdab2592-1cdb-4843-aa3a-d156d6528034 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:25.882422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cdab2592-1cdb-4843-aa3a-d156d6528034 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:25.889281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cdab2592-1cdb-4843-aa3a-d156d6528034 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:25.889724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cdab2592-1cdb-4843-aa3a-d156d6528034 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:25.890483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cdab2592-1cdb-4843-aa3a-d156d6528034 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:25.890924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cdab2592-1cdb-4843-aa3a-d156d6528034 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:25.948697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cdab2592-1cdb-4843-aa3a-d156d6528034 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:25.957157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cdab2592-1cdb-4843-aa3a-d156d6528034 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.079285 Nov 02 23:34:25.957720 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2223/2798] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:25 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:26.974069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fc51f191-3022-44c1-b420-301722bd68f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:26.974766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fc51f191-3022-44c1-b420-301722bd68f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:26.981201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc51f191-3022-44c1-b420-301722bd68f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:26.982649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc51f191-3022-44c1-b420-301722bd68f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:26.982909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc51f191-3022-44c1-b420-301722bd68f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:26.983362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc51f191-3022-44c1-b420-301722bd68f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:27.042964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fc51f191-3022-44c1-b420-301722bd68f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:27.051029 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fc51f191-3022-44c1-b420-301722bd68f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080919 Nov 02 23:34:27.051588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2224/2799] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:26 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:28.068442 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-772d4cd0-0f01-4f65-87f4-a56a63f5c27d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:28.069139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-772d4cd0-0f01-4f65-87f4-a56a63f5c27d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:28.075364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-772d4cd0-0f01-4f65-87f4-a56a63f5c27d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:28.075824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-772d4cd0-0f01-4f65-87f4-a56a63f5c27d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:28.077231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-772d4cd0-0f01-4f65-87f4-a56a63f5c27d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:28.077663 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-772d4cd0-0f01-4f65-87f4-a56a63f5c27d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:28.138618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-772d4cd0-0f01-4f65-87f4-a56a63f5c27d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:28.146887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-772d4cd0-0f01-4f65-87f4-a56a63f5c27d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082293 Nov 02 23:34:28.147471 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2225/2800] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:28 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:29.163579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-018f4ce1-ea59-4327-99f9-1fe3be49d65e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:29.164270 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-018f4ce1-ea59-4327-99f9-1fe3be49d65e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:29.170988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-018f4ce1-ea59-4327-99f9-1fe3be49d65e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:29.171434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-018f4ce1-ea59-4327-99f9-1fe3be49d65e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:29.172199 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-018f4ce1-ea59-4327-99f9-1fe3be49d65e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:29.172669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-018f4ce1-ea59-4327-99f9-1fe3be49d65e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:29.232893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-018f4ce1-ea59-4327-99f9-1fe3be49d65e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:29.240792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-018f4ce1-ea59-4327-99f9-1fe3be49d65e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080836 Nov 02 23:34:29.241357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2226/2801] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:29 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:30.257128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e26727b8-86b0-43d5-bd34-995c0302a6d4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:30.257776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e26727b8-86b0-43d5-bd34-995c0302a6d4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:30.263601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e26727b8-86b0-43d5-bd34-995c0302a6d4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:30.264548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e26727b8-86b0-43d5-bd34-995c0302a6d4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:30.265353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e26727b8-86b0-43d5-bd34-995c0302a6d4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:30.265780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e26727b8-86b0-43d5-bd34-995c0302a6d4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:30.327800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e26727b8-86b0-43d5-bd34-995c0302a6d4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:30.335627 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e26727b8-86b0-43d5-bd34-995c0302a6d4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082388 Nov 02 23:34:30.336196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2227/2802] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:30 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:31.352801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0565134c-8af6-4296-a7ee-38bb5dc1f5fb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:31.353626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0565134c-8af6-4296-a7ee-38bb5dc1f5fb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:31.360597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0565134c-8af6-4296-a7ee-38bb5dc1f5fb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:31.361089 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0565134c-8af6-4296-a7ee-38bb5dc1f5fb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:31.362031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0565134c-8af6-4296-a7ee-38bb5dc1f5fb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:31.362436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0565134c-8af6-4296-a7ee-38bb5dc1f5fb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:31.428130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0565134c-8af6-4296-a7ee-38bb5dc1f5fb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:31.437099 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0565134c-8af6-4296-a7ee-38bb5dc1f5fb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.088173 Nov 02 23:34:31.437986 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2228/2803] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:31 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:32.454489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ca902bd3-ec55-482c-a6cb-c583574edf09 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:32.455153 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ca902bd3-ec55-482c-a6cb-c583574edf09 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:32.461294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ca902bd3-ec55-482c-a6cb-c583574edf09 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:32.461741 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ca902bd3-ec55-482c-a6cb-c583574edf09 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:32.462502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ca902bd3-ec55-482c-a6cb-c583574edf09 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:32.462945 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ca902bd3-ec55-482c-a6cb-c583574edf09 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:32.522652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ca902bd3-ec55-482c-a6cb-c583574edf09 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:32.530514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ca902bd3-ec55-482c-a6cb-c583574edf09 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080246 Nov 02 23:34:32.531126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2229/2804] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:32 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:33.546341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7b680b2d-aadf-4920-ab19-25fcc7f255a7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:33.547077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7b680b2d-aadf-4920-ab19-25fcc7f255a7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:33.553272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7b680b2d-aadf-4920-ab19-25fcc7f255a7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:33.553714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7b680b2d-aadf-4920-ab19-25fcc7f255a7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:33.554486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7b680b2d-aadf-4920-ab19-25fcc7f255a7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:33.554930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7b680b2d-aadf-4920-ab19-25fcc7f255a7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:33.614764 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7b680b2d-aadf-4920-ab19-25fcc7f255a7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:33.623916 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7b680b2d-aadf-4920-ab19-25fcc7f255a7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080643 Nov 02 23:34:33.624521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2230/2805] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:33 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:34:34.640352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-523219ff-58e6-4494-b20c-025ac02b283d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:34.641051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-523219ff-58e6-4494-b20c-025ac02b283d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:34.647266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-523219ff-58e6-4494-b20c-025ac02b283d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:34.647716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-523219ff-58e6-4494-b20c-025ac02b283d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:34.648486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-523219ff-58e6-4494-b20c-025ac02b283d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:34.648919 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-523219ff-58e6-4494-b20c-025ac02b283d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:34.715194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-523219ff-58e6-4494-b20c-025ac02b283d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:34.723724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-523219ff-58e6-4494-b20c-025ac02b283d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.087622 Nov 02 23:34:34.724314 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2231/2806] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:34 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:35.740704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2c0b8e84-947b-4c5f-9035-fb9731936da5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:35.741406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2c0b8e84-947b-4c5f-9035-fb9731936da5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:35.748018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2c0b8e84-947b-4c5f-9035-fb9731936da5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:35.748468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2c0b8e84-947b-4c5f-9035-fb9731936da5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:35.749244 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2c0b8e84-947b-4c5f-9035-fb9731936da5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:35.749677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2c0b8e84-947b-4c5f-9035-fb9731936da5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:35.810407 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2c0b8e84-947b-4c5f-9035-fb9731936da5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:35.818571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2c0b8e84-947b-4c5f-9035-fb9731936da5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081716 Nov 02 23:34:35.819176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2232/2807] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:35 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:36.834985 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-64dbd765-e445-4eda-a22d-da44036c36e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:36.835682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-64dbd765-e445-4eda-a22d-da44036c36e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:36.841823 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-64dbd765-e445-4eda-a22d-da44036c36e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:36.842981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-64dbd765-e445-4eda-a22d-da44036c36e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:36.843745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-64dbd765-e445-4eda-a22d-da44036c36e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:36.844173 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-64dbd765-e445-4eda-a22d-da44036c36e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:36.901951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-64dbd765-e445-4eda-a22d-da44036c36e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:36.910581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-64dbd765-e445-4eda-a22d-da44036c36e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.079185 Nov 02 23:34:36.915262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2233/2808] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:36 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:37.934347 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-33d36aab-f89d-4e49-9e4e-778547607745 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:37.935044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-33d36aab-f89d-4e49-9e4e-778547607745 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:37.941950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-33d36aab-f89d-4e49-9e4e-778547607745 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:37.942392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-33d36aab-f89d-4e49-9e4e-778547607745 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:37.943183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-33d36aab-f89d-4e49-9e4e-778547607745 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:37.943616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-33d36aab-f89d-4e49-9e4e-778547607745 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:38.004558 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-33d36aab-f89d-4e49-9e4e-778547607745 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:38.012177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-33d36aab-f89d-4e49-9e4e-778547607745 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081452 Nov 02 23:34:38.012740 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2234/2809] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:37 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:39.029296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a0a6cc7a-4a78-4d1e-871d-098ad5238a42 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:39.030533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a0a6cc7a-4a78-4d1e-871d-098ad5238a42 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:39.036838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0a6cc7a-4a78-4d1e-871d-098ad5238a42 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:39.037287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0a6cc7a-4a78-4d1e-871d-098ad5238a42 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:39.038059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0a6cc7a-4a78-4d1e-871d-098ad5238a42 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:39.038500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a0a6cc7a-4a78-4d1e-871d-098ad5238a42 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:39.097920 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a0a6cc7a-4a78-4d1e-871d-098ad5238a42 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:39.105817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a0a6cc7a-4a78-4d1e-871d-098ad5238a42 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080182 Nov 02 23:34:39.106401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2235/2810] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:39 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:40.122962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d2bdcf85-8c9c-4487-83a3-78d7f6943bea tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:40.123785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d2bdcf85-8c9c-4487-83a3-78d7f6943bea tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:40.129875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2bdcf85-8c9c-4487-83a3-78d7f6943bea tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:40.130325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2bdcf85-8c9c-4487-83a3-78d7f6943bea tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:40.131136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2bdcf85-8c9c-4487-83a3-78d7f6943bea tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:40.131575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2bdcf85-8c9c-4487-83a3-78d7f6943bea tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:40.191724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d2bdcf85-8c9c-4487-83a3-78d7f6943bea tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:40.199483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d2bdcf85-8c9c-4487-83a3-78d7f6943bea tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080290 Nov 02 23:34:40.200056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2236/2811] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:40 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:41.215961 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-37e10d1b-2e6f-4bd0-9ccb-b41896aaff8d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:41.216589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-37e10d1b-2e6f-4bd0-9ccb-b41896aaff8d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:41.223685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-37e10d1b-2e6f-4bd0-9ccb-b41896aaff8d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:41.224123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-37e10d1b-2e6f-4bd0-9ccb-b41896aaff8d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:41.224897 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-37e10d1b-2e6f-4bd0-9ccb-b41896aaff8d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:41.225322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-37e10d1b-2e6f-4bd0-9ccb-b41896aaff8d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:41.286184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-37e10d1b-2e6f-4bd0-9ccb-b41896aaff8d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:41.294354 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-37e10d1b-2e6f-4bd0-9ccb-b41896aaff8d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082012 Nov 02 23:34:41.294955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2237/2812] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:41 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:42.312053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cc7841f8-74cb-42ea-96c2-c1a8d99f47f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:42.312728 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cc7841f8-74cb-42ea-96c2-c1a8d99f47f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:42.319116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc7841f8-74cb-42ea-96c2-c1a8d99f47f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:42.319683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc7841f8-74cb-42ea-96c2-c1a8d99f47f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:42.320439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc7841f8-74cb-42ea-96c2-c1a8d99f47f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:42.320865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc7841f8-74cb-42ea-96c2-c1a8d99f47f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:42.381733 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cc7841f8-74cb-42ea-96c2-c1a8d99f47f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:42.390432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cc7841f8-74cb-42ea-96c2-c1a8d99f47f0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082734 Nov 02 23:34:42.391030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2238/2813] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:42 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:43.407877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8dd4c1da-81ff-4700-97d3-267f724274d5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:43.408548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8dd4c1da-81ff-4700-97d3-267f724274d5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:43.414713 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8dd4c1da-81ff-4700-97d3-267f724274d5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:43.415197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8dd4c1da-81ff-4700-97d3-267f724274d5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:43.415958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8dd4c1da-81ff-4700-97d3-267f724274d5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:43.416393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8dd4c1da-81ff-4700-97d3-267f724274d5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:43.476045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8dd4c1da-81ff-4700-97d3-267f724274d5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:43.483795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8dd4c1da-81ff-4700-97d3-267f724274d5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080085 Nov 02 23:34:43.484364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2239/2814] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:43 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:44.500251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2a52738b-220a-41eb-865c-b1484c7b9e0a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:44.500960 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2a52738b-220a-41eb-865c-b1484c7b9e0a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:44.507134 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a52738b-220a-41eb-865c-b1484c7b9e0a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:44.507579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a52738b-220a-41eb-865c-b1484c7b9e0a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:44.508354 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a52738b-220a-41eb-865c-b1484c7b9e0a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:44.508787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a52738b-220a-41eb-865c-b1484c7b9e0a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:44.573022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2a52738b-220a-41eb-865c-b1484c7b9e0a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:44.580942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2a52738b-220a-41eb-865c-b1484c7b9e0a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.084937 Nov 02 23:34:44.581521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2240/2815] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:44 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:45.597332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4f0c39de-f162-47b2-9830-ea45d41a94a4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:45.598043 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4f0c39de-f162-47b2-9830-ea45d41a94a4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:45.604197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f0c39de-f162-47b2-9830-ea45d41a94a4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:45.604639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f0c39de-f162-47b2-9830-ea45d41a94a4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:45.605404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f0c39de-f162-47b2-9830-ea45d41a94a4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:45.605844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f0c39de-f162-47b2-9830-ea45d41a94a4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:45.664097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4f0c39de-f162-47b2-9830-ea45d41a94a4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:45.672348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4f0c39de-f162-47b2-9830-ea45d41a94a4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078679 Nov 02 23:34:45.672926 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2241/2816] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:45 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:46.689918 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a575f5e3-eb5a-4313-9829-f6de3119bb55 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:46.690619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a575f5e3-eb5a-4313-9829-f6de3119bb55 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:46.696827 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a575f5e3-eb5a-4313-9829-f6de3119bb55 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:46.697266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a575f5e3-eb5a-4313-9829-f6de3119bb55 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:46.698030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a575f5e3-eb5a-4313-9829-f6de3119bb55 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:46.698456 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a575f5e3-eb5a-4313-9829-f6de3119bb55 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:46.759871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a575f5e3-eb5a-4313-9829-f6de3119bb55 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:46.767678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a575f5e3-eb5a-4313-9829-f6de3119bb55 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082312 Nov 02 23:34:46.768257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2242/2817] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:46 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:47.786440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-25e51cf4-5fce-4a5d-b7cf-b15b2fe5703a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:47.787174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-25e51cf4-5fce-4a5d-b7cf-b15b2fe5703a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:47.793422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25e51cf4-5fce-4a5d-b7cf-b15b2fe5703a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:47.793861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25e51cf4-5fce-4a5d-b7cf-b15b2fe5703a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:47.794630 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25e51cf4-5fce-4a5d-b7cf-b15b2fe5703a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:47.795660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25e51cf4-5fce-4a5d-b7cf-b15b2fe5703a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:47.853251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-25e51cf4-5fce-4a5d-b7cf-b15b2fe5703a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:47.861471 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-25e51cf4-5fce-4a5d-b7cf-b15b2fe5703a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078636 Nov 02 23:34:47.862030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2243/2818] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:47 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:48.878053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-545855f0-18f6-49f3-892b-65ccebe3e065 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:48.878848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-545855f0-18f6-49f3-892b-65ccebe3e065 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:48.885142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-545855f0-18f6-49f3-892b-65ccebe3e065 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:48.885587 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-545855f0-18f6-49f3-892b-65ccebe3e065 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:48.886359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-545855f0-18f6-49f3-892b-65ccebe3e065 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:48.886790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-545855f0-18f6-49f3-892b-65ccebe3e065 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:48.946716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-545855f0-18f6-49f3-892b-65ccebe3e065 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:48.955661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-545855f0-18f6-49f3-892b-65ccebe3e065 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081184 Nov 02 23:34:48.956346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2244/2819] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:48 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:49.972427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-be23660e-a375-4644-bb6f-898b8525a4c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:49.973121 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-be23660e-a375-4644-bb6f-898b8525a4c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:49.979662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be23660e-a375-4644-bb6f-898b8525a4c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:49.980473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be23660e-a375-4644-bb6f-898b8525a4c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:49.981273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be23660e-a375-4644-bb6f-898b8525a4c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:49.981708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-be23660e-a375-4644-bb6f-898b8525a4c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:50.048625 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-be23660e-a375-4644-bb6f-898b8525a4c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:50.061831 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-be23660e-a375-4644-bb6f-898b8525a4c2 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.092657 Nov 02 23:34:50.062831 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2245/2820] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:49 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:51.079168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8e459d0c-8d03-4df3-b488-5d8a06689edf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:51.079965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8e459d0c-8d03-4df3-b488-5d8a06689edf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:51.086586 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e459d0c-8d03-4df3-b488-5d8a06689edf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:51.087101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e459d0c-8d03-4df3-b488-5d8a06689edf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:51.087921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e459d0c-8d03-4df3-b488-5d8a06689edf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:51.088387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e459d0c-8d03-4df3-b488-5d8a06689edf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:51.153433 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8e459d0c-8d03-4df3-b488-5d8a06689edf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:51.161471 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8e459d0c-8d03-4df3-b488-5d8a06689edf tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.086073 Nov 02 23:34:51.162060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2246/2821] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:51 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:52.178612 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bad68a0a-1298-44af-9c75-3e4ce54a1415 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:52.179442 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bad68a0a-1298-44af-9c75-3e4ce54a1415 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:52.186534 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bad68a0a-1298-44af-9c75-3e4ce54a1415 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:52.187029 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bad68a0a-1298-44af-9c75-3e4ce54a1415 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:52.187860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bad68a0a-1298-44af-9c75-3e4ce54a1415 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:52.188307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bad68a0a-1298-44af-9c75-3e4ce54a1415 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:52.250300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bad68a0a-1298-44af-9c75-3e4ce54a1415 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:52.258306 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bad68a0a-1298-44af-9c75-3e4ce54a1415 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.083326 Nov 02 23:34:52.258888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2247/2822] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:52 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:53.276568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5b086e7a-4c5e-4ffc-ab62-06a72d40ceeb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:53.277337 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5b086e7a-4c5e-4ffc-ab62-06a72d40ceeb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:53.283847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b086e7a-4c5e-4ffc-ab62-06a72d40ceeb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:53.284290 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b086e7a-4c5e-4ffc-ab62-06a72d40ceeb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:53.285060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b086e7a-4c5e-4ffc-ab62-06a72d40ceeb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:53.285491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b086e7a-4c5e-4ffc-ab62-06a72d40ceeb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:53.347226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5b086e7a-4c5e-4ffc-ab62-06a72d40ceeb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:53.361889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5b086e7a-4c5e-4ffc-ab62-06a72d40ceeb tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.088606 Nov 02 23:34:53.363005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2248/2823] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:53 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:54.379198 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4ec49296-ad78-4995-ac1e-80939f359a5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:54.379921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4ec49296-ad78-4995-ac1e-80939f359a5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:54.386454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ec49296-ad78-4995-ac1e-80939f359a5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:54.386897 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ec49296-ad78-4995-ac1e-80939f359a5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:54.387692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ec49296-ad78-4995-ac1e-80939f359a5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:54.388143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ec49296-ad78-4995-ac1e-80939f359a5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:54.460994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4ec49296-ad78-4995-ac1e-80939f359a5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:54.471233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4ec49296-ad78-4995-ac1e-80939f359a5c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.095934 Nov 02 23:34:54.471822 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2249/2824] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:54 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:55.487992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8c9b2c32-6479-4a1a-8aff-01166df01770 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:55.488689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8c9b2c32-6479-4a1a-8aff-01166df01770 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:55.495244 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c9b2c32-6479-4a1a-8aff-01166df01770 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:55.495686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c9b2c32-6479-4a1a-8aff-01166df01770 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:55.496455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c9b2c32-6479-4a1a-8aff-01166df01770 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:55.496954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c9b2c32-6479-4a1a-8aff-01166df01770 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:55.559238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8c9b2c32-6479-4a1a-8aff-01166df01770 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:55.567604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8c9b2c32-6479-4a1a-8aff-01166df01770 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.083361 Nov 02 23:34:55.568205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2250/2825] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:55 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:56.591234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-798ec10b-72f6-430f-bccc-dbdd02b6349a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:56.592315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-798ec10b-72f6-430f-bccc-dbdd02b6349a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:56.598731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-798ec10b-72f6-430f-bccc-dbdd02b6349a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:56.599258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-798ec10b-72f6-430f-bccc-dbdd02b6349a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:56.600046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-798ec10b-72f6-430f-bccc-dbdd02b6349a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:56.600481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-798ec10b-72f6-430f-bccc-dbdd02b6349a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:56.664416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-798ec10b-72f6-430f-bccc-dbdd02b6349a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:56.673106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-798ec10b-72f6-430f-bccc-dbdd02b6349a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.085479 Nov 02 23:34:56.673692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2251/2826] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:56 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:57.691849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b72cb6a3-90d1-475c-89ad-ee819689c229 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:57.692568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b72cb6a3-90d1-475c-89ad-ee819689c229 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:57.698832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b72cb6a3-90d1-475c-89ad-ee819689c229 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:57.699302 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b72cb6a3-90d1-475c-89ad-ee819689c229 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:57.700130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b72cb6a3-90d1-475c-89ad-ee819689c229 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:57.700568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b72cb6a3-90d1-475c-89ad-ee819689c229 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:57.765983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b72cb6a3-90d1-475c-89ad-ee819689c229 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:57.773984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b72cb6a3-90d1-475c-89ad-ee819689c229 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.087354 Nov 02 23:34:57.774556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2252/2827] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:57 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:58.791035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-399221ec-b8d7-4c66-8522-782c4260886a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:58.791766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-399221ec-b8d7-4c66-8522-782c4260886a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:58.798439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-399221ec-b8d7-4c66-8522-782c4260886a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:58.798880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-399221ec-b8d7-4c66-8522-782c4260886a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:58.799698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-399221ec-b8d7-4c66-8522-782c4260886a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:58.800126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-399221ec-b8d7-4c66-8522-782c4260886a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:58.877498 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-399221ec-b8d7-4c66-8522-782c4260886a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:58.885304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-399221ec-b8d7-4c66-8522-782c4260886a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.098119 Nov 02 23:34:58.885885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2253/2828] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:58 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:34:59.904483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ddf258e8-5890-4453-9cb5-e2c782bf2a7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:34:59.905263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ddf258e8-5890-4453-9cb5-e2c782bf2a7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:34:59.911440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddf258e8-5890-4453-9cb5-e2c782bf2a7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:59.911911 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddf258e8-5890-4453-9cb5-e2c782bf2a7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:59.912762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddf258e8-5890-4453-9cb5-e2c782bf2a7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:34:59.913242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddf258e8-5890-4453-9cb5-e2c782bf2a7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:34:59.977275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ddf258e8-5890-4453-9cb5-e2c782bf2a7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:34:59.985405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ddf258e8-5890-4453-9cb5-e2c782bf2a7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.086085 Nov 02 23:34:59.985990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2254/2829] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:34:59 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:01.003094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c118381a-41a0-46ba-b59e-ce92fd15bb38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:01.003830 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c118381a-41a0-46ba-b59e-ce92fd15bb38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:01.010208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c118381a-41a0-46ba-b59e-ce92fd15bb38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:01.010654 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c118381a-41a0-46ba-b59e-ce92fd15bb38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:01.011467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c118381a-41a0-46ba-b59e-ce92fd15bb38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:01.011903 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c118381a-41a0-46ba-b59e-ce92fd15bb38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:01.072425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c118381a-41a0-46ba-b59e-ce92fd15bb38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:01.080300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c118381a-41a0-46ba-b59e-ce92fd15bb38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080818 Nov 02 23:35:01.080888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2255/2830] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:00 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:02.097378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-605a8c22-eb42-466d-b867-c212a273e643 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:02.098076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-605a8c22-eb42-466d-b867-c212a273e643 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:02.104346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-605a8c22-eb42-466d-b867-c212a273e643 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:02.104793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-605a8c22-eb42-466d-b867-c212a273e643 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:02.105562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-605a8c22-eb42-466d-b867-c212a273e643 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:02.105996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-605a8c22-eb42-466d-b867-c212a273e643 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:02.167816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-605a8c22-eb42-466d-b867-c212a273e643 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:02.176480 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-605a8c22-eb42-466d-b867-c212a273e643 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082687 Nov 02 23:35:02.177055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2256/2831] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:02 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:03.192632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-526632f3-01eb-4bda-86e6-d080de6cfc81 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:03.193418 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-526632f3-01eb-4bda-86e6-d080de6cfc81 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:03.199576 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-526632f3-01eb-4bda-86e6-d080de6cfc81 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:03.200014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-526632f3-01eb-4bda-86e6-d080de6cfc81 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:03.201260 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-526632f3-01eb-4bda-86e6-d080de6cfc81 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:03.201686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-526632f3-01eb-4bda-86e6-d080de6cfc81 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:03.259952 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-526632f3-01eb-4bda-86e6-d080de6cfc81 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:03.268129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-526632f3-01eb-4bda-86e6-d080de6cfc81 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.079121 Nov 02 23:35:03.268698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2257/2832] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:03 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:04.284894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a2ae33f3-5e9b-473d-8338-7d24f6a83b9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:04.285598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a2ae33f3-5e9b-473d-8338-7d24f6a83b9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:04.292059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2ae33f3-5e9b-473d-8338-7d24f6a83b9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:04.292578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2ae33f3-5e9b-473d-8338-7d24f6a83b9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:04.293348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2ae33f3-5e9b-473d-8338-7d24f6a83b9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:04.293772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2ae33f3-5e9b-473d-8338-7d24f6a83b9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:04.355853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a2ae33f3-5e9b-473d-8338-7d24f6a83b9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:04.363661 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a2ae33f3-5e9b-473d-8338-7d24f6a83b9a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082611 Nov 02 23:35:04.364251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2258/2833] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:04 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:05.380874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-48804953-1371-476f-b42b-1b7bab152534 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:05.381969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-48804953-1371-476f-b42b-1b7bab152534 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:05.387829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48804953-1371-476f-b42b-1b7bab152534 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:05.388275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48804953-1371-476f-b42b-1b7bab152534 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:05.389568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48804953-1371-476f-b42b-1b7bab152534 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:05.389997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-48804953-1371-476f-b42b-1b7bab152534 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:05.449402 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-48804953-1371-476f-b42b-1b7bab152534 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:05.458469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-48804953-1371-476f-b42b-1b7bab152534 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081265 Nov 02 23:35:05.459089 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2259/2834] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:05 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:06.476037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0b22b230-c19d-4eea-a456-dd5db92e6eb8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:06.476753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0b22b230-c19d-4eea-a456-dd5db92e6eb8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:06.483713 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b22b230-c19d-4eea-a456-dd5db92e6eb8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:06.484158 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b22b230-c19d-4eea-a456-dd5db92e6eb8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:06.484937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b22b230-c19d-4eea-a456-dd5db92e6eb8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:06.485401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b22b230-c19d-4eea-a456-dd5db92e6eb8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:06.548063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0b22b230-c19d-4eea-a456-dd5db92e6eb8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:06.556643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0b22b230-c19d-4eea-a456-dd5db92e6eb8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.084253 Nov 02 23:35:06.557238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2260/2835] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:06 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:07.573580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f4de049a-8468-4fca-993f-21be29e50f1e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:07.574543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f4de049a-8468-4fca-993f-21be29e50f1e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:07.580675 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f4de049a-8468-4fca-993f-21be29e50f1e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:07.581119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f4de049a-8468-4fca-993f-21be29e50f1e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:07.581896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f4de049a-8468-4fca-993f-21be29e50f1e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:07.582358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f4de049a-8468-4fca-993f-21be29e50f1e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:07.643157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f4de049a-8468-4fca-993f-21be29e50f1e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:07.651222 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f4de049a-8468-4fca-993f-21be29e50f1e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081190 Nov 02 23:35:07.651821 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2261/2836] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:07 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:08.668616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d5f02665-c07f-4d10-8b29-ce66854f3d6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:08.669338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d5f02665-c07f-4d10-8b29-ce66854f3d6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:08.675809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d5f02665-c07f-4d10-8b29-ce66854f3d6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:08.676255 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d5f02665-c07f-4d10-8b29-ce66854f3d6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:08.677034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d5f02665-c07f-4d10-8b29-ce66854f3d6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:08.677465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d5f02665-c07f-4d10-8b29-ce66854f3d6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:08.737842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d5f02665-c07f-4d10-8b29-ce66854f3d6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:08.745786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d5f02665-c07f-4d10-8b29-ce66854f3d6e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080860 Nov 02 23:35:08.746372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2262/2837] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:08 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:09.762984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0e73c6c6-b974-4894-aa74-3d14a0afeca9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:09.763693 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0e73c6c6-b974-4894-aa74-3d14a0afeca9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:09.770317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e73c6c6-b974-4894-aa74-3d14a0afeca9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:09.770780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e73c6c6-b974-4894-aa74-3d14a0afeca9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:09.771588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e73c6c6-b974-4894-aa74-3d14a0afeca9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:09.772017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e73c6c6-b974-4894-aa74-3d14a0afeca9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:09.829935 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0e73c6c6-b974-4894-aa74-3d14a0afeca9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:09.837436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0e73c6c6-b974-4894-aa74-3d14a0afeca9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078164 Nov 02 23:35:09.837995 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2263/2838] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:09 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:10.854552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e693ab45-195a-4dac-ad9d-ca5c602cc86b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:10.855266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e693ab45-195a-4dac-ad9d-ca5c602cc86b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:10.862002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e693ab45-195a-4dac-ad9d-ca5c602cc86b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:10.862444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e693ab45-195a-4dac-ad9d-ca5c602cc86b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:10.863253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e693ab45-195a-4dac-ad9d-ca5c602cc86b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:10.863683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e693ab45-195a-4dac-ad9d-ca5c602cc86b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:10.926024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e693ab45-195a-4dac-ad9d-ca5c602cc86b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:10.933681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e693ab45-195a-4dac-ad9d-ca5c602cc86b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082845 Nov 02 23:35:10.934259 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2264/2839] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:10 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:11.951839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7266265e-e4ad-4df7-8ff6-a593c34efb42 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:11.952525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7266265e-e4ad-4df7-8ff6-a593c34efb42 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:11.960795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7266265e-e4ad-4df7-8ff6-a593c34efb42 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:11.961237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7266265e-e4ad-4df7-8ff6-a593c34efb42 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:11.962007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7266265e-e4ad-4df7-8ff6-a593c34efb42 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:11.962439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7266265e-e4ad-4df7-8ff6-a593c34efb42 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:12.023441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7266265e-e4ad-4df7-8ff6-a593c34efb42 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:12.031805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7266265e-e4ad-4df7-8ff6-a593c34efb42 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.085232 Nov 02 23:35:12.032373 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2265/2840] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:11 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:13.048894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f1344293-02f5-41fe-aca3-4af4cbc606f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:13.049668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f1344293-02f5-41fe-aca3-4af4cbc606f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:13.055707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f1344293-02f5-41fe-aca3-4af4cbc606f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:13.056148 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f1344293-02f5-41fe-aca3-4af4cbc606f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:13.056901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f1344293-02f5-41fe-aca3-4af4cbc606f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:13.057329 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f1344293-02f5-41fe-aca3-4af4cbc606f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:13.116127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f1344293-02f5-41fe-aca3-4af4cbc606f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:13.123806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f1344293-02f5-41fe-aca3-4af4cbc606f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.079295 Nov 02 23:35:13.124365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2266/2841] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:13 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:14.140865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-13ed8515-33dc-4c98-83ca-7af597d3baf9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:14.141557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-13ed8515-33dc-4c98-83ca-7af597d3baf9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:14.147720 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-13ed8515-33dc-4c98-83ca-7af597d3baf9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:14.148159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-13ed8515-33dc-4c98-83ca-7af597d3baf9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:14.148921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-13ed8515-33dc-4c98-83ca-7af597d3baf9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:14.149350 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-13ed8515-33dc-4c98-83ca-7af597d3baf9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:14.208317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-13ed8515-33dc-4c98-83ca-7af597d3baf9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:14.215570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-13ed8515-33dc-4c98-83ca-7af597d3baf9 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078974 Nov 02 23:35:14.216143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2267/2842] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:14 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:15.231930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e320abeb-9c07-4175-aff1-1ba6c476a398 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:15.232571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e320abeb-9c07-4175-aff1-1ba6c476a398 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:15.238884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e320abeb-9c07-4175-aff1-1ba6c476a398 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:15.239355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e320abeb-9c07-4175-aff1-1ba6c476a398 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:15.240114 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e320abeb-9c07-4175-aff1-1ba6c476a398 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:15.240535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e320abeb-9c07-4175-aff1-1ba6c476a398 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:15.298569 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e320abeb-9c07-4175-aff1-1ba6c476a398 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:15.306217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e320abeb-9c07-4175-aff1-1ba6c476a398 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.077966 Nov 02 23:35:15.306780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2268/2843] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:15 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:16.323305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2294c2c3-e2b9-467a-9d94-0be5e9709a6f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:16.324023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2294c2c3-e2b9-467a-9d94-0be5e9709a6f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:16.330141 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2294c2c3-e2b9-467a-9d94-0be5e9709a6f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:16.330585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2294c2c3-e2b9-467a-9d94-0be5e9709a6f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:16.331385 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2294c2c3-e2b9-467a-9d94-0be5e9709a6f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:16.331818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2294c2c3-e2b9-467a-9d94-0be5e9709a6f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:16.390170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2294c2c3-e2b9-467a-9d94-0be5e9709a6f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:16.397820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2294c2c3-e2b9-467a-9d94-0be5e9709a6f tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078189 Nov 02 23:35:16.398386 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2269/2844] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:16 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:17.415124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-397173e2-bb1c-46ee-b83a-3bdaa9532bc0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:17.415840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-397173e2-bb1c-46ee-b83a-3bdaa9532bc0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:17.422412 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-397173e2-bb1c-46ee-b83a-3bdaa9532bc0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:17.422883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-397173e2-bb1c-46ee-b83a-3bdaa9532bc0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:17.423776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-397173e2-bb1c-46ee-b83a-3bdaa9532bc0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:17.424212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-397173e2-bb1c-46ee-b83a-3bdaa9532bc0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:17.486169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-397173e2-bb1c-46ee-b83a-3bdaa9532bc0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:17.493927 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-397173e2-bb1c-46ee-b83a-3bdaa9532bc0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082476 Nov 02 23:35:17.494486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2270/2845] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:17 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:18.511115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f3749216-8696-4e68-b5e3-902613d93b6b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:18.511792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f3749216-8696-4e68-b5e3-902613d93b6b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:18.518438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3749216-8696-4e68-b5e3-902613d93b6b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:18.518883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3749216-8696-4e68-b5e3-902613d93b6b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:18.519670 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3749216-8696-4e68-b5e3-902613d93b6b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:18.520109 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3749216-8696-4e68-b5e3-902613d93b6b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:18.578135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f3749216-8696-4e68-b5e3-902613d93b6b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:18.585805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f3749216-8696-4e68-b5e3-902613d93b6b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078331 Nov 02 23:35:18.586373 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2271/2846] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:18 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:19.602841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9cd69043-5a03-4c45-85a9-8f0020fcdc0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:19.603568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9cd69043-5a03-4c45-85a9-8f0020fcdc0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:19.609674 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9cd69043-5a03-4c45-85a9-8f0020fcdc0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:19.610116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9cd69043-5a03-4c45-85a9-8f0020fcdc0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:19.610874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9cd69043-5a03-4c45-85a9-8f0020fcdc0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:19.611328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9cd69043-5a03-4c45-85a9-8f0020fcdc0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:19.669201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9cd69043-5a03-4c45-85a9-8f0020fcdc0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:19.677094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9cd69043-5a03-4c45-85a9-8f0020fcdc0d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.077931 Nov 02 23:35:19.677664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2272/2847] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:19 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:20.693260 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-caacdcfb-657f-44ec-8107-1eb99332c43b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:20.693973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-caacdcfb-657f-44ec-8107-1eb99332c43b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:20.700146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-caacdcfb-657f-44ec-8107-1eb99332c43b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:20.700589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-caacdcfb-657f-44ec-8107-1eb99332c43b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:20.701351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-caacdcfb-657f-44ec-8107-1eb99332c43b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:20.701781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-caacdcfb-657f-44ec-8107-1eb99332c43b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:20.761595 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-caacdcfb-657f-44ec-8107-1eb99332c43b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:20.769873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-caacdcfb-657f-44ec-8107-1eb99332c43b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080357 Nov 02 23:35:20.770432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2273/2848] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:20 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:21.785418 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e02898fd-d15a-418b-aa3e-bd83aed90e17 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:21.786172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e02898fd-d15a-418b-aa3e-bd83aed90e17 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:21.792385 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e02898fd-d15a-418b-aa3e-bd83aed90e17 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:21.792824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e02898fd-d15a-418b-aa3e-bd83aed90e17 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:21.793585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e02898fd-d15a-418b-aa3e-bd83aed90e17 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:21.794013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e02898fd-d15a-418b-aa3e-bd83aed90e17 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:21.852603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e02898fd-d15a-418b-aa3e-bd83aed90e17 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:21.860625 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e02898fd-d15a-418b-aa3e-bd83aed90e17 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078891 Nov 02 23:35:21.861185 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2274/2849] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:21 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:22.877645 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3bdba8d6-2b85-4027-9cdc-be2d4bf75e0c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:22.878346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3bdba8d6-2b85-4027-9cdc-be2d4bf75e0c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:22.884516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3bdba8d6-2b85-4027-9cdc-be2d4bf75e0c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:22.884958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3bdba8d6-2b85-4027-9cdc-be2d4bf75e0c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:22.885718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3bdba8d6-2b85-4027-9cdc-be2d4bf75e0c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:22.886147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3bdba8d6-2b85-4027-9cdc-be2d4bf75e0c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:22.944688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3bdba8d6-2b85-4027-9cdc-be2d4bf75e0c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:22.952975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3bdba8d6-2b85-4027-9cdc-be2d4bf75e0c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078993 Nov 02 23:35:22.953552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2275/2850] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:22 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:23.970045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ea8beab2-28a2-42e5-9f88-2d44b09d7927 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:23.970765 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ea8beab2-28a2-42e5-9f88-2d44b09d7927 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:23.976997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea8beab2-28a2-42e5-9f88-2d44b09d7927 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:23.977438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea8beab2-28a2-42e5-9f88-2d44b09d7927 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:23.978207 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea8beab2-28a2-42e5-9f88-2d44b09d7927 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:23.978636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ea8beab2-28a2-42e5-9f88-2d44b09d7927 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:24.040235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ea8beab2-28a2-42e5-9f88-2d44b09d7927 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:24.047987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ea8beab2-28a2-42e5-9f88-2d44b09d7927 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082280 Nov 02 23:35:24.048557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2276/2851] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:23 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:25.064886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4bf59b87-6ae5-4abd-8065-15d725886936 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:25.065812 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4bf59b87-6ae5-4abd-8065-15d725886936 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:25.072068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4bf59b87-6ae5-4abd-8065-15d725886936 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:25.072513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4bf59b87-6ae5-4abd-8065-15d725886936 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:25.073286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4bf59b87-6ae5-4abd-8065-15d725886936 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:25.073719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4bf59b87-6ae5-4abd-8065-15d725886936 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:25.132055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4bf59b87-6ae5-4abd-8065-15d725886936 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:25.139683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4bf59b87-6ae5-4abd-8065-15d725886936 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078490 Nov 02 23:35:25.140281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2277/2852] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:25 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:35:26.156206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a1887b1f-dd05-4c50-9747-b43ad1d1a86b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:26.156875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a1887b1f-dd05-4c50-9747-b43ad1d1a86b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:26.163015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a1887b1f-dd05-4c50-9747-b43ad1d1a86b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:26.163460 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a1887b1f-dd05-4c50-9747-b43ad1d1a86b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:26.164219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a1887b1f-dd05-4c50-9747-b43ad1d1a86b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:26.164681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a1887b1f-dd05-4c50-9747-b43ad1d1a86b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:26.223758 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a1887b1f-dd05-4c50-9747-b43ad1d1a86b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:26.232220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a1887b1f-dd05-4c50-9747-b43ad1d1a86b tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.079510 Nov 02 23:35:26.232887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2278/2853] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:26 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:27.249654 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2846f410-4d3d-4ea9-9cf7-6817c167c010 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:27.250312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2846f410-4d3d-4ea9-9cf7-6817c167c010 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:27.256740 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2846f410-4d3d-4ea9-9cf7-6817c167c010 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:27.257186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2846f410-4d3d-4ea9-9cf7-6817c167c010 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:27.257953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2846f410-4d3d-4ea9-9cf7-6817c167c010 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:27.258382 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2846f410-4d3d-4ea9-9cf7-6817c167c010 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:27.316501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2846f410-4d3d-4ea9-9cf7-6817c167c010 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:27.324191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2846f410-4d3d-4ea9-9cf7-6817c167c010 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078824 Nov 02 23:35:27.324751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2279/2854] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:27 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:28.341421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f4700d1f-df08-4785-95c2-d867557d6f38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:28.342101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f4700d1f-df08-4785-95c2-d867557d6f38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:28.348951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f4700d1f-df08-4785-95c2-d867557d6f38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:28.349392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f4700d1f-df08-4785-95c2-d867557d6f38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:28.350150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f4700d1f-df08-4785-95c2-d867557d6f38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:28.350577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f4700d1f-df08-4785-95c2-d867557d6f38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:28.408917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f4700d1f-df08-4785-95c2-d867557d6f38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:28.416447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f4700d1f-df08-4785-95c2-d867557d6f38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078683 Nov 02 23:35:28.417016 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2280/2855] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:28 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:29.433211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b5c81237-d96d-4306-a6fd-f79de1db5190 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:29.433847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b5c81237-d96d-4306-a6fd-f79de1db5190 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:29.440368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5c81237-d96d-4306-a6fd-f79de1db5190 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:29.440811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5c81237-d96d-4306-a6fd-f79de1db5190 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:29.441574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5c81237-d96d-4306-a6fd-f79de1db5190 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:29.442003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b5c81237-d96d-4306-a6fd-f79de1db5190 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:29.499844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b5c81237-d96d-4306-a6fd-f79de1db5190 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:29.507400 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b5c81237-d96d-4306-a6fd-f79de1db5190 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.077841 Nov 02 23:35:29.507961 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2281/2856] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:29 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:30.524456 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4f872429-b0c5-49b9-8419-f3babb769645 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:30.525122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4f872429-b0c5-49b9-8419-f3babb769645 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:30.531474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f872429-b0c5-49b9-8419-f3babb769645 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:30.531922 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f872429-b0c5-49b9-8419-f3babb769645 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:30.532688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f872429-b0c5-49b9-8419-f3babb769645 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:30.533122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4f872429-b0c5-49b9-8419-f3babb769645 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:30.594250 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4f872429-b0c5-49b9-8419-f3babb769645 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:30.602026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4f872429-b0c5-49b9-8419-f3babb769645 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.081383 Nov 02 23:35:30.602597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2282/2857] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:30 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:31.619366 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-efecd75f-e3a0-4370-a357-546d29a310c7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:31.620055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-efecd75f-e3a0-4370-a357-546d29a310c7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:31.626821 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-efecd75f-e3a0-4370-a357-546d29a310c7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:31.627303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-efecd75f-e3a0-4370-a357-546d29a310c7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:31.628066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-efecd75f-e3a0-4370-a357-546d29a310c7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:31.628520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-efecd75f-e3a0-4370-a357-546d29a310c7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:31.688691 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-efecd75f-e3a0-4370-a357-546d29a310c7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:31.696424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-efecd75f-e3a0-4370-a357-546d29a310c7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080707 Nov 02 23:35:31.696990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2283/2858] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:31 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:32.712729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-78106c90-fbaa-48a5-9c77-35537e4fb1f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:32.713364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-78106c90-fbaa-48a5-9c77-35537e4fb1f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:32.720204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78106c90-fbaa-48a5-9c77-35537e4fb1f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:32.720651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78106c90-fbaa-48a5-9c77-35537e4fb1f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:32.721600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78106c90-fbaa-48a5-9c77-35537e4fb1f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:32.721976 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78106c90-fbaa-48a5-9c77-35537e4fb1f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:32.780163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-78106c90-fbaa-48a5-9c77-35537e4fb1f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:32.788806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-78106c90-fbaa-48a5-9c77-35537e4fb1f5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.079660 Nov 02 23:35:32.789381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2284/2859] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:32 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:33.806150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-62dae8aa-f0dd-4b6f-bc3f-2374cb30318d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:33.807101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-62dae8aa-f0dd-4b6f-bc3f-2374cb30318d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:33.813631 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-62dae8aa-f0dd-4b6f-bc3f-2374cb30318d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:33.814077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-62dae8aa-f0dd-4b6f-bc3f-2374cb30318d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:33.814835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-62dae8aa-f0dd-4b6f-bc3f-2374cb30318d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:33.815291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-62dae8aa-f0dd-4b6f-bc3f-2374cb30318d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:33.874548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-62dae8aa-f0dd-4b6f-bc3f-2374cb30318d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:33.882100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-62dae8aa-f0dd-4b6f-bc3f-2374cb30318d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.079660 Nov 02 23:35:33.882658 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2285/2860] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:33 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:34.898981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-81338a1c-cac1-4e20-8d8a-857b475fd06c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:34.899691 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-81338a1c-cac1-4e20-8d8a-857b475fd06c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:34.905704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81338a1c-cac1-4e20-8d8a-857b475fd06c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:34.906140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81338a1c-cac1-4e20-8d8a-857b475fd06c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:34.907407 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81338a1c-cac1-4e20-8d8a-857b475fd06c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:34.907837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-81338a1c-cac1-4e20-8d8a-857b475fd06c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:34.970520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-81338a1c-cac1-4e20-8d8a-857b475fd06c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:34.978325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-81338a1c-cac1-4e20-8d8a-857b475fd06c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.082976 Nov 02 23:35:34.978888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2286/2861] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:34 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:35.995294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a88ee02b-5ae6-40f9-b220-1e75574c700a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:35.995992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a88ee02b-5ae6-40f9-b220-1e75574c700a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:36.002819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a88ee02b-5ae6-40f9-b220-1e75574c700a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:36.003364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a88ee02b-5ae6-40f9-b220-1e75574c700a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:36.004122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a88ee02b-5ae6-40f9-b220-1e75574c700a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:36.004553 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a88ee02b-5ae6-40f9-b220-1e75574c700a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:36.064003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a88ee02b-5ae6-40f9-b220-1e75574c700a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:36.071737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a88ee02b-5ae6-40f9-b220-1e75574c700a tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080255 Nov 02 23:35:36.072309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2287/2862] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:35 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:37.087261 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f1ba723a-4014-403f-896c-aebae5f8849e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:37.087949 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f1ba723a-4014-403f-896c-aebae5f8849e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:37.094493 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f1ba723a-4014-403f-896c-aebae5f8849e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:37.094946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f1ba723a-4014-403f-896c-aebae5f8849e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:37.095702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f1ba723a-4014-403f-896c-aebae5f8849e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:37.096129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f1ba723a-4014-403f-896c-aebae5f8849e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:37.156809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f1ba723a-4014-403f-896c-aebae5f8849e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:37.164599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f1ba723a-4014-403f-896c-aebae5f8849e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080937 Nov 02 23:35:37.165156 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2288/2863] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:37 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:38.182404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1e953ab7-abd0-4d76-8728-16f8994574af tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:38.183120 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1e953ab7-abd0-4d76-8728-16f8994574af tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:38.190158 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e953ab7-abd0-4d76-8728-16f8994574af tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:38.190616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e953ab7-abd0-4d76-8728-16f8994574af tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:38.191383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e953ab7-abd0-4d76-8728-16f8994574af tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:38.191806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1e953ab7-abd0-4d76-8728-16f8994574af tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:38.250748 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1e953ab7-abd0-4d76-8728-16f8994574af tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:38.258790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1e953ab7-abd0-4d76-8728-16f8994574af tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080124 Nov 02 23:35:38.259388 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2289/2864] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:38 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:39.275271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-14ac50f3-cf21-4eb8-87ec-13209a4155fa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:39.275921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-14ac50f3-cf21-4eb8-87ec-13209a4155fa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:39.282071 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14ac50f3-cf21-4eb8-87ec-13209a4155fa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:39.282542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14ac50f3-cf21-4eb8-87ec-13209a4155fa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:39.283369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14ac50f3-cf21-4eb8-87ec-13209a4155fa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:39.283802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-14ac50f3-cf21-4eb8-87ec-13209a4155fa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:39.342452 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-14ac50f3-cf21-4eb8-87ec-13209a4155fa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:39.350117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-14ac50f3-cf21-4eb8-87ec-13209a4155fa tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078524 Nov 02 23:35:39.350671 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2290/2865] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:39 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:40.366671 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cb4d7d72-a1a6-439a-b2b8-a7c96fe9a3ce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:40.367351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cb4d7d72-a1a6-439a-b2b8-a7c96fe9a3ce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:40.373648 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cb4d7d72-a1a6-439a-b2b8-a7c96fe9a3ce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:40.374083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cb4d7d72-a1a6-439a-b2b8-a7c96fe9a3ce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:40.374834 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cb4d7d72-a1a6-439a-b2b8-a7c96fe9a3ce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:40.375309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cb4d7d72-a1a6-439a-b2b8-a7c96fe9a3ce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:40.433636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cb4d7d72-a1a6-439a-b2b8-a7c96fe9a3ce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:40.442448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cb4d7d72-a1a6-439a-b2b8-a7c96fe9a3ce tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.079445 Nov 02 23:35:40.443030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2291/2866] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:40 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:41.459017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6370c621-1d1d-4c43-baa6-ac3366dbd446 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:41.459669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6370c621-1d1d-4c43-baa6-ac3366dbd446 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:41.465718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6370c621-1d1d-4c43-baa6-ac3366dbd446 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:41.466165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6370c621-1d1d-4c43-baa6-ac3366dbd446 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:41.466941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6370c621-1d1d-4c43-baa6-ac3366dbd446 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:41.467394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6370c621-1d1d-4c43-baa6-ac3366dbd446 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:41.527264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6370c621-1d1d-4c43-baa6-ac3366dbd446 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:41.535434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6370c621-1d1d-4c43-baa6-ac3366dbd446 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.080178 Nov 02 23:35:41.536004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2292/2867] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:41 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:42.552061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-27d6f19d-7a31-47af-8a00-70b396452ff6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:42.552704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-27d6f19d-7a31-47af-8a00-70b396452ff6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:42.558802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27d6f19d-7a31-47af-8a00-70b396452ff6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:42.559282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27d6f19d-7a31-47af-8a00-70b396452ff6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:42.560041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27d6f19d-7a31-47af-8a00-70b396452ff6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:42.560727 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27d6f19d-7a31-47af-8a00-70b396452ff6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:42.618859 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-27d6f19d-7a31-47af-8a00-70b396452ff6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:42.627099 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-27d6f19d-7a31-47af-8a00-70b396452ff6 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078729 Nov 02 23:35:42.627665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2293/2868] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:42 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:43.643656 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9d3fab33-3329-479d-ba2e-eaf9a2740b38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:43.644342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9d3fab33-3329-479d-ba2e-eaf9a2740b38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:43.650546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d3fab33-3329-479d-ba2e-eaf9a2740b38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:43.651010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d3fab33-3329-479d-ba2e-eaf9a2740b38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:43.651771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d3fab33-3329-479d-ba2e-eaf9a2740b38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:43.652194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d3fab33-3329-479d-ba2e-eaf9a2740b38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:43.717352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9d3fab33-3329-479d-ba2e-eaf9a2740b38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:43.725743 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9d3fab33-3329-479d-ba2e-eaf9a2740b38 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.086274 Nov 02 23:35:43.726408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2294/2869] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:43 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:44.741557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c492f0ef-99d9-4dbe-b346-ddd52a9b954e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:44.742349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c492f0ef-99d9-4dbe-b346-ddd52a9b954e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:44.748719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c492f0ef-99d9-4dbe-b346-ddd52a9b954e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:44.749164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c492f0ef-99d9-4dbe-b346-ddd52a9b954e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:44.749933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c492f0ef-99d9-4dbe-b346-ddd52a9b954e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:44.750365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c492f0ef-99d9-4dbe-b346-ddd52a9b954e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:44.808943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c492f0ef-99d9-4dbe-b346-ddd52a9b954e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:44.816799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c492f0ef-99d9-4dbe-b346-ddd52a9b954e tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078852 Nov 02 23:35:44.817357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2295/2870] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:44 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:45.833017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c33cc9f5-62dd-43d8-93fa-32e010e15ba7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:45.833699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c33cc9f5-62dd-43d8-93fa-32e010e15ba7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:45.839826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c33cc9f5-62dd-43d8-93fa-32e010e15ba7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:45.840275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c33cc9f5-62dd-43d8-93fa-32e010e15ba7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:45.841043 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c33cc9f5-62dd-43d8-93fa-32e010e15ba7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:45.841503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c33cc9f5-62dd-43d8-93fa-32e010e15ba7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:45.899566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c33cc9f5-62dd-43d8-93fa-32e010e15ba7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:45.907876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c33cc9f5-62dd-43d8-93fa-32e010e15ba7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078579 Nov 02 23:35:45.908438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2296/2871] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:45 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:35:46.925011 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bc3b3a5d-3274-410d-a483-92a5de312cf4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:35:46.925655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bc3b3a5d-3274-410d-a483-92a5de312cf4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: 70df37d3-8cae-4366-a8c6-fc59e334cfd6] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:35:46.931871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc3b3a5d-3274-410d-a483-92a5de312cf4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:46.932313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc3b3a5d-3274-410d-a483-92a5de312cf4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:46.933059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc3b3a5d-3274-410d-a483-92a5de312cf4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:35:46.933484 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc3b3a5d-3274-410d-a483-92a5de312cf4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:35:46.991268 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bc3b3a5d-3274-410d-a483-92a5de312cf4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:35:46.998929 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bc3b3a5d-3274-410d-a483-92a5de312cf4 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6" status: 200 len: 1348 microversion: 2.1 time: 0.078255 Nov 02 23:35:46.999502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2297/2872] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:35:46 2021] GET /compute/v2.1/servers/70df37d3-8cae-4366-a8c6-fc59e334cfd6 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:36:06.038932 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:36:06.039736 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:36:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 23:37:16.812972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:37:16.813724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:37:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 23:37:17.708900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:37:17.709083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:37:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 23:37:49.419677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: ERROR oslo.messaging._drivers.impl_rabbit [-] [67feccfe-41bd-4ab4-bcb3-788ee171fed1] AMQP server on 10.222.0.41:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 23:37:49.423090 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-25a35d35-ccd8-47b5-af70-96d56659b663 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:37:49.423578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-25a35d35-ccd8-47b5-af70-96d56659b663 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:37:49.429323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25a35d35-ccd8-47b5-af70-96d56659b663 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:49.429760 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25a35d35-ccd8-47b5-af70-96d56659b663 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:49.430508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25a35d35-ccd8-47b5-af70-96d56659b663 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:49.430954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25a35d35-ccd8-47b5-af70-96d56659b663 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:49.456032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-25a35d35-ccd8-47b5-af70-96d56659b663 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Going to try to terminate instance {{(pid=115800) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 23:37:49.532055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-25a35d35-ccd8-47b5-af70-96d56659b663 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "DELETE /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 204 len: 0 microversion: 2.1 time: 0.113838 Nov 02 23:37:49.535753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2298/2873] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:37:49 2021] DELETE /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 23:37:49.541972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-80331e03-49ff-4803-8751-0f066ec83b46 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:37:49.542970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-80331e03-49ff-4803-8751-0f066ec83b46 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:37:49.548542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-80331e03-49ff-4803-8751-0f066ec83b46 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:49.548988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-80331e03-49ff-4803-8751-0f066ec83b46 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:49.549740 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-80331e03-49ff-4803-8751-0f066ec83b46 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:49.550166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-80331e03-49ff-4803-8751-0f066ec83b46 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:49.692617 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-80331e03-49ff-4803-8751-0f066ec83b46 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:37:49.700570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-80331e03-49ff-4803-8751-0f066ec83b46 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1507 microversion: 2.1 time: 0.162451 Nov 02 23:37:49.701137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2299/2874] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:37:49 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:37:50.718852 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4c7b64d6-ec92-42da-9ff7-ac5e3aab9314 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:37:50.719640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4c7b64d6-ec92-42da-9ff7-ac5e3aab9314 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:37:50.739806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] [67feccfe-41bd-4ab4-bcb3-788ee171fed1] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 53086. Nov 02 23:37:50.744144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4c7b64d6-ec92-42da-9ff7-ac5e3aab9314 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:50.744589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4c7b64d6-ec92-42da-9ff7-ac5e3aab9314 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:50.745368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4c7b64d6-ec92-42da-9ff7-ac5e3aab9314 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:50.745794 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4c7b64d6-ec92-42da-9ff7-ac5e3aab9314 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:50.886613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4c7b64d6-ec92-42da-9ff7-ac5e3aab9314 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:37:50.894543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4c7b64d6-ec92-42da-9ff7-ac5e3aab9314 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 200 len: 1507 microversion: 2.1 time: 0.180475 Nov 02 23:37:50.895150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2300/2875] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:37:50 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:37:51.224643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-63c19e09-caa2-4dca-8cba-259c4cbf2643 req-ceda39a6-cd5e-49eb-809a-0c40fca8b212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "128302f3-f7c5-4789-a766-c426046c9d16", "name": "network-vif-deleted", "tag": "6970655b-4ce0-4ff1-84c7-8e4ac80b49ab"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:37:51.226329 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:37:51.226329 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:37:51.234776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-63c19e09-caa2-4dca-8cba-259c4cbf2643 req-ceda39a6-cd5e-49eb-809a-0c40fca8b212 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:51.235301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-63c19e09-caa2-4dca-8cba-259c4cbf2643 req-ceda39a6-cd5e-49eb-809a-0c40fca8b212 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:51.246775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-63c19e09-caa2-4dca-8cba-259c4cbf2643 req-ceda39a6-cd5e-49eb-809a-0c40fca8b212 service nova] Creating event network-vif-deleted:6970655b-4ce0-4ff1-84c7-8e4ac80b49ab for instance 128302f3-f7c5-4789-a766-c426046c9d16 on hv-cinder-81584 Nov 02 23:37:51.251805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-63c19e09-caa2-4dca-8cba-259c4cbf2643 req-ceda39a6-cd5e-49eb-809a-0c40fca8b212 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084517 Nov 02 23:37:51.253036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2301/2876] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:37:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:37:51.911784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0174c5fd-d7b3-452b-b87b-48043fb06921 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:37:51.912536 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0174c5fd-d7b3-452b-b87b-48043fb06921 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: 128302f3-f7c5-4789-a766-c426046c9d16] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:37:51.919223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0174c5fd-d7b3-452b-b87b-48043fb06921 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:51.919703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0174c5fd-d7b3-452b-b87b-48043fb06921 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:51.920465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0174c5fd-d7b3-452b-b87b-48043fb06921 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:51.920894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0174c5fd-d7b3-452b-b87b-48043fb06921 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:51.933413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-0174c5fd-d7b3-452b-b87b-48043fb06921 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] HTTP exception thrown: Instance 128302f3-f7c5-4789-a766-c426046c9d16 could not be found. Nov 02 23:37:51.934724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0174c5fd-d7b3-452b-b87b-48043fb06921 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Returning 404 to user: Instance 128302f3-f7c5-4789-a766-c426046c9d16 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:37:51.935565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0174c5fd-d7b3-452b-b87b-48043fb06921 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16" status: 404 len: 111 microversion: 2.1 time: 0.027994 Nov 02 23:37:51.936084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2302/2877] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:37:51 2021] GET /compute/v2.1/servers/128302f3-f7c5-4789-a766-c426046c9d16 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 23:37:51.943257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-98c2668a-c702-4968-95dc-beac9323a1a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:37:51.943737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-98c2668a-c702-4968-95dc-beac9323a1a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:37:51.949054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98c2668a-c702-4968-95dc-beac9323a1a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:51.950077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98c2668a-c702-4968-95dc-beac9323a1a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:51.950826 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98c2668a-c702-4968-95dc-beac9323a1a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:51.951280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-98c2668a-c702-4968-95dc-beac9323a1a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:51.974184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-98c2668a-c702-4968-95dc-beac9323a1a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Going to try to terminate instance {{(pid=115800) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 23:37:52.048731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-98c2668a-c702-4968-95dc-beac9323a1a0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "DELETE /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 204 len: 0 microversion: 2.1 time: 0.108364 Nov 02 23:37:52.049404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2303/2878] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:37:51 2021] DELETE /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 23:37:52.058504 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0a60695f-60b1-46df-ae90-4df63dfddbe3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:37:52.059879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0a60695f-60b1-46df-ae90-4df63dfddbe3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:37:52.065615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0a60695f-60b1-46df-ae90-4df63dfddbe3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:52.066058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0a60695f-60b1-46df-ae90-4df63dfddbe3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:52.066813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0a60695f-60b1-46df-ae90-4df63dfddbe3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:52.067290 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0a60695f-60b1-46df-ae90-4df63dfddbe3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:52.194439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0a60695f-60b1-46df-ae90-4df63dfddbe3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:37:52.202656 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0a60695f-60b1-46df-ae90-4df63dfddbe3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1568 microversion: 2.1 time: 0.148927 Nov 02 23:37:52.203253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2304/2879] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:37:52 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:37:53.219986 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-630de4f2-5da3-4550-896e-839202be14a6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:37:53.220591 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-630de4f2-5da3-4550-896e-839202be14a6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:37:53.226989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-630de4f2-5da3-4550-896e-839202be14a6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:53.227448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-630de4f2-5da3-4550-896e-839202be14a6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:53.228195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-630de4f2-5da3-4550-896e-839202be14a6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:53.228619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-630de4f2-5da3-4550-896e-839202be14a6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:53.357112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-630de4f2-5da3-4550-896e-839202be14a6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:37:53.365023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-630de4f2-5da3-4550-896e-839202be14a6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1568 microversion: 2.1 time: 0.148695 Nov 02 23:37:53.365592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2305/2880] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:37:53 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:37:53.831368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-67a00667-4d5f-44ff-b2a2-798d71df97f2 req-41ab3607-36d8-46dc-a540-912706d3ad21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7bf8316-893d-4fad-b5f0-4ecad89120b3", "name": "network-vif-deleted", "tag": "9393cccd-7a26-4491-b2a8-fc394dd1ec6c"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:37:53.833423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:37:53.833423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:37:53.843346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-67a00667-4d5f-44ff-b2a2-798d71df97f2 req-41ab3607-36d8-46dc-a540-912706d3ad21 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:53.843906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-67a00667-4d5f-44ff-b2a2-798d71df97f2 req-41ab3607-36d8-46dc-a540-912706d3ad21 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:53.855813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-67a00667-4d5f-44ff-b2a2-798d71df97f2 req-41ab3607-36d8-46dc-a540-912706d3ad21 service nova] Creating event network-vif-deleted:9393cccd-7a26-4491-b2a8-fc394dd1ec6c for instance e7bf8316-893d-4fad-b5f0-4ecad89120b3 on hv-cinder-81584 Nov 02 23:37:53.861378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-67a00667-4d5f-44ff-b2a2-798d71df97f2 req-41ab3607-36d8-46dc-a540-912706d3ad21 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033556 Nov 02 23:37:53.862073 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2306/2881] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:37:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:37:54.381798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d874967f-ecb9-49c2-b947-1f632980aa67 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:37:54.382486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d874967f-ecb9-49c2-b947-1f632980aa67 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:37:54.389335 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d874967f-ecb9-49c2-b947-1f632980aa67 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:54.389773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d874967f-ecb9-49c2-b947-1f632980aa67 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:54.390525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d874967f-ecb9-49c2-b947-1f632980aa67 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:54.390984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d874967f-ecb9-49c2-b947-1f632980aa67 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:54.449662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d874967f-ecb9-49c2-b947-1f632980aa67 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:37:54.457709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d874967f-ecb9-49c2-b947-1f632980aa67 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079932 Nov 02 23:37:54.458273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2307/2882] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:37:54 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:37:55.474546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9ce8304e-85e7-486c-a008-d8dd0ae609a3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:37:55.475240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9ce8304e-85e7-486c-a008-d8dd0ae609a3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:37:55.481955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ce8304e-85e7-486c-a008-d8dd0ae609a3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:55.482396 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ce8304e-85e7-486c-a008-d8dd0ae609a3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:55.483181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ce8304e-85e7-486c-a008-d8dd0ae609a3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:55.483613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ce8304e-85e7-486c-a008-d8dd0ae609a3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:55.540587 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9ce8304e-85e7-486c-a008-d8dd0ae609a3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:37:55.548715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9ce8304e-85e7-486c-a008-d8dd0ae609a3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077854 Nov 02 23:37:55.549280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2308/2883] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:37:55 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:37:56.565950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0c3fa730-daa6-4e4c-9f64-4cf6d8af6cd8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:37:56.566606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0c3fa730-daa6-4e4c-9f64-4cf6d8af6cd8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:37:56.572747 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0c3fa730-daa6-4e4c-9f64-4cf6d8af6cd8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:56.573194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0c3fa730-daa6-4e4c-9f64-4cf6d8af6cd8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:56.573955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0c3fa730-daa6-4e4c-9f64-4cf6d8af6cd8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:56.574389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0c3fa730-daa6-4e4c-9f64-4cf6d8af6cd8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:56.632359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0c3fa730-daa6-4e4c-9f64-4cf6d8af6cd8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:37:56.640017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0c3fa730-daa6-4e4c-9f64-4cf6d8af6cd8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077763 Nov 02 23:37:56.640580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2309/2884] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:37:56 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:37:57.656697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4a1162d9-6839-4f6a-abd3-f5decbfaa48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:37:57.657298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4a1162d9-6839-4f6a-abd3-f5decbfaa48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:37:57.664058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a1162d9-6839-4f6a-abd3-f5decbfaa48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:57.664509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a1162d9-6839-4f6a-abd3-f5decbfaa48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:57.665281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a1162d9-6839-4f6a-abd3-f5decbfaa48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:57.665709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4a1162d9-6839-4f6a-abd3-f5decbfaa48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:57.726142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4a1162d9-6839-4f6a-abd3-f5decbfaa48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:37:57.734137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4a1162d9-6839-4f6a-abd3-f5decbfaa48e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081216 Nov 02 23:37:57.734692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2310/2885] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:37:57 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:37:58.750628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4c236961-2e66-4e60-bf1e-c8dd4e95fc4c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:37:58.751400 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4c236961-2e66-4e60-bf1e-c8dd4e95fc4c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:37:58.757488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4c236961-2e66-4e60-bf1e-c8dd4e95fc4c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:58.757923 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4c236961-2e66-4e60-bf1e-c8dd4e95fc4c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:58.758685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4c236961-2e66-4e60-bf1e-c8dd4e95fc4c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:58.759141 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4c236961-2e66-4e60-bf1e-c8dd4e95fc4c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:58.820600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4c236961-2e66-4e60-bf1e-c8dd4e95fc4c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:37:58.828810 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4c236961-2e66-4e60-bf1e-c8dd4e95fc4c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081929 Nov 02 23:37:58.829380 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2311/2886] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:37:58 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:37:59.845936 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8f468c84-9c4d-4ac1-b8aa-8884cbedc0b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:37:59.846587 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8f468c84-9c4d-4ac1-b8aa-8884cbedc0b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:37:59.852816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8f468c84-9c4d-4ac1-b8aa-8884cbedc0b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:59.853268 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8f468c84-9c4d-4ac1-b8aa-8884cbedc0b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:59.854024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8f468c84-9c4d-4ac1-b8aa-8884cbedc0b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:37:59.854483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8f468c84-9c4d-4ac1-b8aa-8884cbedc0b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:37:59.912529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8f468c84-9c4d-4ac1-b8aa-8884cbedc0b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:37:59.920979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8f468c84-9c4d-4ac1-b8aa-8884cbedc0b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078809 Nov 02 23:37:59.921538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2312/2887] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:37:59 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:00.938086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-06b81010-4afe-4903-bafa-91fcc76485c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:00.938781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-06b81010-4afe-4903-bafa-91fcc76485c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:00.944880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06b81010-4afe-4903-bafa-91fcc76485c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:00.945326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06b81010-4afe-4903-bafa-91fcc76485c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:00.946079 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06b81010-4afe-4903-bafa-91fcc76485c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:00.946510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-06b81010-4afe-4903-bafa-91fcc76485c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:01.005451 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-06b81010-4afe-4903-bafa-91fcc76485c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:01.013034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-06b81010-4afe-4903-bafa-91fcc76485c6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079381 Nov 02 23:38:01.013600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2313/2888] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:00 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:02.029459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a5576d82-5a62-463b-b292-1cfc57dc2b7b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:02.030154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a5576d82-5a62-463b-b292-1cfc57dc2b7b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:02.036304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5576d82-5a62-463b-b292-1cfc57dc2b7b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:02.036754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5576d82-5a62-463b-b292-1cfc57dc2b7b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:02.037520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5576d82-5a62-463b-b292-1cfc57dc2b7b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:02.037956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5576d82-5a62-463b-b292-1cfc57dc2b7b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:02.097551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a5576d82-5a62-463b-b292-1cfc57dc2b7b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:02.105189 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a5576d82-5a62-463b-b292-1cfc57dc2b7b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079492 Nov 02 23:38:02.105755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2314/2889] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:02 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:03.121668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-798e99a1-6d1d-4b11-b57b-2460903abcc7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:03.122327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-798e99a1-6d1d-4b11-b57b-2460903abcc7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:03.128513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-798e99a1-6d1d-4b11-b57b-2460903abcc7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:03.128956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-798e99a1-6d1d-4b11-b57b-2460903abcc7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:03.129712 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-798e99a1-6d1d-4b11-b57b-2460903abcc7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:03.130140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-798e99a1-6d1d-4b11-b57b-2460903abcc7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:03.188721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-798e99a1-6d1d-4b11-b57b-2460903abcc7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:03.196389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-798e99a1-6d1d-4b11-b57b-2460903abcc7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078440 Nov 02 23:38:03.196945 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2315/2890] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:03 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:04.213305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1444449f-68a6-428c-9d83-fcdc6b01f3ad tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:04.213910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1444449f-68a6-428c-9d83-fcdc6b01f3ad tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:04.220159 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1444449f-68a6-428c-9d83-fcdc6b01f3ad tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:04.220604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1444449f-68a6-428c-9d83-fcdc6b01f3ad tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:04.221371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1444449f-68a6-428c-9d83-fcdc6b01f3ad tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:04.221801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1444449f-68a6-428c-9d83-fcdc6b01f3ad tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:04.280100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1444449f-68a6-428c-9d83-fcdc6b01f3ad tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:04.287713 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1444449f-68a6-428c-9d83-fcdc6b01f3ad tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078130 Nov 02 23:38:04.288309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2316/2891] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:04 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:05.304169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-28425b43-1340-44da-9576-46645d172eb3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:05.304809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-28425b43-1340-44da-9576-46645d172eb3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:05.311275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-28425b43-1340-44da-9576-46645d172eb3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:05.311719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-28425b43-1340-44da-9576-46645d172eb3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:05.312517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-28425b43-1340-44da-9576-46645d172eb3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:05.313019 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-28425b43-1340-44da-9576-46645d172eb3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:05.374135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-28425b43-1340-44da-9576-46645d172eb3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:05.381793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-28425b43-1340-44da-9576-46645d172eb3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081282 Nov 02 23:38:05.382352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2317/2892] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:05 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:06.398681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-73d9609a-7c70-4c31-87a0-811e46e9d0d5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:06.399391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-73d9609a-7c70-4c31-87a0-811e46e9d0d5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:06.406063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73d9609a-7c70-4c31-87a0-811e46e9d0d5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:06.406513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73d9609a-7c70-4c31-87a0-811e46e9d0d5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:06.407305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73d9609a-7c70-4c31-87a0-811e46e9d0d5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:06.407737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73d9609a-7c70-4c31-87a0-811e46e9d0d5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:06.467450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-73d9609a-7c70-4c31-87a0-811e46e9d0d5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:06.475176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-73d9609a-7c70-4c31-87a0-811e46e9d0d5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080064 Nov 02 23:38:06.475744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2318/2893] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:06 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:07.492255 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4fe6deb9-24f8-41c0-bf70-80bde649ce6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:07.492933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4fe6deb9-24f8-41c0-bf70-80bde649ce6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:07.499077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4fe6deb9-24f8-41c0-bf70-80bde649ce6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:07.499520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4fe6deb9-24f8-41c0-bf70-80bde649ce6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:07.500273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4fe6deb9-24f8-41c0-bf70-80bde649ce6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:07.500698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4fe6deb9-24f8-41c0-bf70-80bde649ce6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:07.558008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4fe6deb9-24f8-41c0-bf70-80bde649ce6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:07.565828 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4fe6deb9-24f8-41c0-bf70-80bde649ce6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077209 Nov 02 23:38:07.566392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2319/2894] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:07 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:08.582161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e225fc97-4b0a-474d-ae4e-fdeed747d49b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:08.582842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e225fc97-4b0a-474d-ae4e-fdeed747d49b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:08.588935 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e225fc97-4b0a-474d-ae4e-fdeed747d49b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:08.589389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e225fc97-4b0a-474d-ae4e-fdeed747d49b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:08.590131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e225fc97-4b0a-474d-ae4e-fdeed747d49b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:08.590561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e225fc97-4b0a-474d-ae4e-fdeed747d49b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:08.648256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e225fc97-4b0a-474d-ae4e-fdeed747d49b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:08.656300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e225fc97-4b0a-474d-ae4e-fdeed747d49b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077809 Nov 02 23:38:08.656872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2320/2895] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:08 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:09.673206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5ea80241-7d53-4d4f-94c0-9a20e5d59245 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:09.673917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5ea80241-7d53-4d4f-94c0-9a20e5d59245 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:09.680166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ea80241-7d53-4d4f-94c0-9a20e5d59245 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:09.680612 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ea80241-7d53-4d4f-94c0-9a20e5d59245 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:09.681379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ea80241-7d53-4d4f-94c0-9a20e5d59245 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:09.681811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5ea80241-7d53-4d4f-94c0-9a20e5d59245 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:09.740502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5ea80241-7d53-4d4f-94c0-9a20e5d59245 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:09.748927 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5ea80241-7d53-4d4f-94c0-9a20e5d59245 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079877 Nov 02 23:38:09.749501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2321/2896] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:09 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:10.766798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c3aa7f74-9d0b-4a1a-aaad-f1e957fd8f6e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:10.767508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c3aa7f74-9d0b-4a1a-aaad-f1e957fd8f6e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:10.773763 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3aa7f74-9d0b-4a1a-aaad-f1e957fd8f6e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:10.774208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3aa7f74-9d0b-4a1a-aaad-f1e957fd8f6e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:10.774996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3aa7f74-9d0b-4a1a-aaad-f1e957fd8f6e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:10.775434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3aa7f74-9d0b-4a1a-aaad-f1e957fd8f6e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:10.833208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c3aa7f74-9d0b-4a1a-aaad-f1e957fd8f6e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:10.840791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c3aa7f74-9d0b-4a1a-aaad-f1e957fd8f6e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078370 Nov 02 23:38:10.841355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2322/2897] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:10 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:11.857415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7dab98ca-e965-4020-b0a4-f2afbc5a1a3c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:11.858118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7dab98ca-e965-4020-b0a4-f2afbc5a1a3c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:11.864313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7dab98ca-e965-4020-b0a4-f2afbc5a1a3c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:11.864757 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7dab98ca-e965-4020-b0a4-f2afbc5a1a3c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:11.865513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7dab98ca-e965-4020-b0a4-f2afbc5a1a3c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:11.865946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7dab98ca-e965-4020-b0a4-f2afbc5a1a3c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:11.927179 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7dab98ca-e965-4020-b0a4-f2afbc5a1a3c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:11.935150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7dab98ca-e965-4020-b0a4-f2afbc5a1a3c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081851 Nov 02 23:38:11.935715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2323/2898] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:11 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:12.951478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8e779c89-7a68-42e9-8f98-d528f533bc4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:12.952179 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8e779c89-7a68-42e9-8f98-d528f533bc4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:12.958247 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e779c89-7a68-42e9-8f98-d528f533bc4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:12.958696 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e779c89-7a68-42e9-8f98-d528f533bc4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:12.959488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e779c89-7a68-42e9-8f98-d528f533bc4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:12.959919 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8e779c89-7a68-42e9-8f98-d528f533bc4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:13.017663 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8e779c89-7a68-42e9-8f98-d528f533bc4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:13.026032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8e779c89-7a68-42e9-8f98-d528f533bc4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078171 Nov 02 23:38:13.026599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2324/2899] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:12 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:14.042856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5d833332-a2d6-4122-bbed-96b5edcc7f27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:14.043584 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5d833332-a2d6-4122-bbed-96b5edcc7f27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:14.049597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d833332-a2d6-4122-bbed-96b5edcc7f27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:14.050036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d833332-a2d6-4122-bbed-96b5edcc7f27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:14.050790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d833332-a2d6-4122-bbed-96b5edcc7f27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:14.051246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d833332-a2d6-4122-bbed-96b5edcc7f27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:14.110132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5d833332-a2d6-4122-bbed-96b5edcc7f27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:14.117920 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5d833332-a2d6-4122-bbed-96b5edcc7f27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078734 Nov 02 23:38:14.118479 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2325/2900] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:14 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:15.135179 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d8c1b83b-7a6a-40aa-abd8-b3ffe99098c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:15.135865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d8c1b83b-7a6a-40aa-abd8-b3ffe99098c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:15.142701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8c1b83b-7a6a-40aa-abd8-b3ffe99098c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:15.143192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8c1b83b-7a6a-40aa-abd8-b3ffe99098c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:15.143956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8c1b83b-7a6a-40aa-abd8-b3ffe99098c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:15.144389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d8c1b83b-7a6a-40aa-abd8-b3ffe99098c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:15.205005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d8c1b83b-7a6a-40aa-abd8-b3ffe99098c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:15.212922 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d8c1b83b-7a6a-40aa-abd8-b3ffe99098c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081379 Nov 02 23:38:15.213484 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2326/2901] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:15 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:16.230057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cf7932e1-2ace-4188-9f4a-3bc71ae2bc92 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:16.230655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cf7932e1-2ace-4188-9f4a-3bc71ae2bc92 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:16.237830 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf7932e1-2ace-4188-9f4a-3bc71ae2bc92 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:16.238277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf7932e1-2ace-4188-9f4a-3bc71ae2bc92 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:16.239097 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf7932e1-2ace-4188-9f4a-3bc71ae2bc92 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:16.239529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cf7932e1-2ace-4188-9f4a-3bc71ae2bc92 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:16.298464 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cf7932e1-2ace-4188-9f4a-3bc71ae2bc92 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:16.306262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cf7932e1-2ace-4188-9f4a-3bc71ae2bc92 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079912 Nov 02 23:38:16.306825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2327/2902] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:16 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:17.322978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a671b083-745b-4ada-b486-108a19b3bd23 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:17.323654 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a671b083-745b-4ada-b486-108a19b3bd23 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:17.329782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a671b083-745b-4ada-b486-108a19b3bd23 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:17.330222 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a671b083-745b-4ada-b486-108a19b3bd23 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:17.330998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a671b083-745b-4ada-b486-108a19b3bd23 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:17.331428 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a671b083-745b-4ada-b486-108a19b3bd23 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:17.390237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a671b083-745b-4ada-b486-108a19b3bd23 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:17.397771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a671b083-745b-4ada-b486-108a19b3bd23 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078461 Nov 02 23:38:17.398340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2328/2903] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:17 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:18.414021 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-28afe3e5-c246-4044-828f-0d4a884425cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:18.414705 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-28afe3e5-c246-4044-828f-0d4a884425cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:18.420800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-28afe3e5-c246-4044-828f-0d4a884425cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:18.421242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-28afe3e5-c246-4044-828f-0d4a884425cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:18.422004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-28afe3e5-c246-4044-828f-0d4a884425cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:18.422435 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-28afe3e5-c246-4044-828f-0d4a884425cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:18.484449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-28afe3e5-c246-4044-828f-0d4a884425cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:18.492348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-28afe3e5-c246-4044-828f-0d4a884425cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081937 Nov 02 23:38:18.492909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2329/2904] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:18 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:19.509008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d28d47f5-258e-4c09-b22e-7936c5763405 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:19.509646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d28d47f5-258e-4c09-b22e-7936c5763405 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:19.516357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d28d47f5-258e-4c09-b22e-7936c5763405 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:19.516802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d28d47f5-258e-4c09-b22e-7936c5763405 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:19.517559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d28d47f5-258e-4c09-b22e-7936c5763405 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:19.517989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d28d47f5-258e-4c09-b22e-7936c5763405 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:19.575090 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d28d47f5-258e-4c09-b22e-7936c5763405 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:19.583310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d28d47f5-258e-4c09-b22e-7936c5763405 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077866 Nov 02 23:38:19.583877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2330/2905] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:19 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:20.600138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-864b91d3-0206-474c-85f4-84f7b10079f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:20.600805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-864b91d3-0206-474c-85f4-84f7b10079f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:20.607547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-864b91d3-0206-474c-85f4-84f7b10079f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:20.607992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-864b91d3-0206-474c-85f4-84f7b10079f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:20.608752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-864b91d3-0206-474c-85f4-84f7b10079f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:20.609181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-864b91d3-0206-474c-85f4-84f7b10079f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:20.666326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-864b91d3-0206-474c-85f4-84f7b10079f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:20.674549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-864b91d3-0206-474c-85f4-84f7b10079f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078037 Nov 02 23:38:20.675144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2331/2906] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:20 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:21.691760 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-08ea7225-3482-4f3b-aa98-71fc17b97f0d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:21.692475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-08ea7225-3482-4f3b-aa98-71fc17b97f0d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:21.698438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08ea7225-3482-4f3b-aa98-71fc17b97f0d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:21.698933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08ea7225-3482-4f3b-aa98-71fc17b97f0d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:21.699745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08ea7225-3482-4f3b-aa98-71fc17b97f0d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:21.700172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08ea7225-3482-4f3b-aa98-71fc17b97f0d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:21.760208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-08ea7225-3482-4f3b-aa98-71fc17b97f0d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:21.768183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-08ea7225-3482-4f3b-aa98-71fc17b97f0d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080021 Nov 02 23:38:21.768762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2332/2907] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:21 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:38:22.784294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ac469693-07a4-408e-8651-10cbb79f32bf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:22.785018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ac469693-07a4-408e-8651-10cbb79f32bf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:22.791232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac469693-07a4-408e-8651-10cbb79f32bf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:22.791681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac469693-07a4-408e-8651-10cbb79f32bf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:22.792430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac469693-07a4-408e-8651-10cbb79f32bf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:22.792854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ac469693-07a4-408e-8651-10cbb79f32bf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:22.850628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ac469693-07a4-408e-8651-10cbb79f32bf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:22.858246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ac469693-07a4-408e-8651-10cbb79f32bf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077601 Nov 02 23:38:22.858808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2333/2908] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:22 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:23.875184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-059e2684-a87f-4993-a2ab-a2766aca5722 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:23.875894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-059e2684-a87f-4993-a2ab-a2766aca5722 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:23.881953 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-059e2684-a87f-4993-a2ab-a2766aca5722 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:23.882389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-059e2684-a87f-4993-a2ab-a2766aca5722 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:23.883171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-059e2684-a87f-4993-a2ab-a2766aca5722 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:23.883599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-059e2684-a87f-4993-a2ab-a2766aca5722 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:23.941266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-059e2684-a87f-4993-a2ab-a2766aca5722 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:23.948844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-059e2684-a87f-4993-a2ab-a2766aca5722 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078071 Nov 02 23:38:23.949404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2334/2909] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:23 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:24.966702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2657d0ee-f9c1-4cbd-b5b3-cf92f73b3f50 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:24.967445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2657d0ee-f9c1-4cbd-b5b3-cf92f73b3f50 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:24.973825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2657d0ee-f9c1-4cbd-b5b3-cf92f73b3f50 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:24.974303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2657d0ee-f9c1-4cbd-b5b3-cf92f73b3f50 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:24.975207 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2657d0ee-f9c1-4cbd-b5b3-cf92f73b3f50 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:24.975711 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2657d0ee-f9c1-4cbd-b5b3-cf92f73b3f50 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:25.038787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2657d0ee-f9c1-4cbd-b5b3-cf92f73b3f50 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:25.046595 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2657d0ee-f9c1-4cbd-b5b3-cf92f73b3f50 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.084154 Nov 02 23:38:25.047193 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2335/2910] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:24 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:26.063206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a21896ff-0ede-4bd6-a08c-75a22de180cb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:26.063985 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a21896ff-0ede-4bd6-a08c-75a22de180cb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:26.070065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a21896ff-0ede-4bd6-a08c-75a22de180cb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:26.070513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a21896ff-0ede-4bd6-a08c-75a22de180cb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:26.071310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a21896ff-0ede-4bd6-a08c-75a22de180cb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:26.071744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a21896ff-0ede-4bd6-a08c-75a22de180cb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:26.132253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a21896ff-0ede-4bd6-a08c-75a22de180cb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:26.139795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a21896ff-0ede-4bd6-a08c-75a22de180cb tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081023 Nov 02 23:38:26.140361 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2336/2911] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:26 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:27.156028 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-388a7eca-4bea-45a7-b5db-1ebc88dc1e78 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:27.156719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-388a7eca-4bea-45a7-b5db-1ebc88dc1e78 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:27.162804 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-388a7eca-4bea-45a7-b5db-1ebc88dc1e78 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:27.163293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-388a7eca-4bea-45a7-b5db-1ebc88dc1e78 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:27.164037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-388a7eca-4bea-45a7-b5db-1ebc88dc1e78 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:27.164468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-388a7eca-4bea-45a7-b5db-1ebc88dc1e78 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:27.227606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-388a7eca-4bea-45a7-b5db-1ebc88dc1e78 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:27.237185 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-388a7eca-4bea-45a7-b5db-1ebc88dc1e78 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.083777 Nov 02 23:38:27.237764 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2337/2912] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:27 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:28.253852 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6b8b854c-a9bd-48fc-825f-1d824afb500c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:28.254492 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6b8b854c-a9bd-48fc-825f-1d824afb500c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:28.260657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6b8b854c-a9bd-48fc-825f-1d824afb500c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:28.261092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6b8b854c-a9bd-48fc-825f-1d824afb500c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:28.261860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6b8b854c-a9bd-48fc-825f-1d824afb500c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:28.262266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6b8b854c-a9bd-48fc-825f-1d824afb500c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:28.321228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6b8b854c-a9bd-48fc-825f-1d824afb500c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:28.328798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6b8b854c-a9bd-48fc-825f-1d824afb500c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078618 Nov 02 23:38:28.329355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2338/2913] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:28 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:38:29.346047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7500e104-2fed-48c0-bd0b-3e0498e32b9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:29.346720 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7500e104-2fed-48c0-bd0b-3e0498e32b9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:29.352929 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7500e104-2fed-48c0-bd0b-3e0498e32b9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:29.353374 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7500e104-2fed-48c0-bd0b-3e0498e32b9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:29.354143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7500e104-2fed-48c0-bd0b-3e0498e32b9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:29.354578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7500e104-2fed-48c0-bd0b-3e0498e32b9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:29.413061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7500e104-2fed-48c0-bd0b-3e0498e32b9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:29.420629 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7500e104-2fed-48c0-bd0b-3e0498e32b9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078848 Nov 02 23:38:29.421212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2339/2914] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:29 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:30.437333 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f79d179d-3220-45ff-bb50-2c568449f718 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:30.437978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f79d179d-3220-45ff-bb50-2c568449f718 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:30.444208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f79d179d-3220-45ff-bb50-2c568449f718 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:30.444646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f79d179d-3220-45ff-bb50-2c568449f718 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:30.445393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f79d179d-3220-45ff-bb50-2c568449f718 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:30.445820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f79d179d-3220-45ff-bb50-2c568449f718 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:30.504073 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f79d179d-3220-45ff-bb50-2c568449f718 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:30.511789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f79d179d-3220-45ff-bb50-2c568449f718 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078497 Nov 02 23:38:30.512349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2340/2915] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:30 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:31.527999 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-85d93729-b210-4811-9c6f-b43c426720ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:31.528664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-85d93729-b210-4811-9c6f-b43c426720ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:31.535000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85d93729-b210-4811-9c6f-b43c426720ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:31.535444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85d93729-b210-4811-9c6f-b43c426720ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:31.536201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85d93729-b210-4811-9c6f-b43c426720ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:31.536686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85d93729-b210-4811-9c6f-b43c426720ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:31.597694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-85d93729-b210-4811-9c6f-b43c426720ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:31.605323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-85d93729-b210-4811-9c6f-b43c426720ac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080974 Nov 02 23:38:31.605888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2341/2916] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:31 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:32.621408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fcb32384-c6f8-499b-9fcd-6020ee632356 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:32.622418 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fcb32384-c6f8-499b-9fcd-6020ee632356 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:32.629278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fcb32384-c6f8-499b-9fcd-6020ee632356 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:32.629714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fcb32384-c6f8-499b-9fcd-6020ee632356 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:32.630702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fcb32384-c6f8-499b-9fcd-6020ee632356 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:32.631161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fcb32384-c6f8-499b-9fcd-6020ee632356 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:32.689282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fcb32384-c6f8-499b-9fcd-6020ee632356 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:32.696822 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fcb32384-c6f8-499b-9fcd-6020ee632356 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079139 Nov 02 23:38:32.697378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2342/2917] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:32 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:33.713824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-36f56838-947f-4c51-94c7-64e11d7a5856 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:33.714524 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-36f56838-947f-4c51-94c7-64e11d7a5856 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:33.720606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-36f56838-947f-4c51-94c7-64e11d7a5856 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:33.721048 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-36f56838-947f-4c51-94c7-64e11d7a5856 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:33.721801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-36f56838-947f-4c51-94c7-64e11d7a5856 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:33.722233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-36f56838-947f-4c51-94c7-64e11d7a5856 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:33.783770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-36f56838-947f-4c51-94c7-64e11d7a5856 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:33.791485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-36f56838-947f-4c51-94c7-64e11d7a5856 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081302 Nov 02 23:38:33.792051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2343/2918] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:33 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:34.807228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e2d311b9-8eb5-47ab-b014-f21a2751b2b7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:34.807924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e2d311b9-8eb5-47ab-b014-f21a2751b2b7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:34.814270 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e2d311b9-8eb5-47ab-b014-f21a2751b2b7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:34.814714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e2d311b9-8eb5-47ab-b014-f21a2751b2b7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:34.815522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e2d311b9-8eb5-47ab-b014-f21a2751b2b7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:34.815963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e2d311b9-8eb5-47ab-b014-f21a2751b2b7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:34.874072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e2d311b9-8eb5-47ab-b014-f21a2751b2b7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:34.881696 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e2d311b9-8eb5-47ab-b014-f21a2751b2b7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078127 Nov 02 23:38:34.882251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2344/2919] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:34 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:35.897904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-29dad961-d4c4-463f-b49a-21699895e7e2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:35.898602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-29dad961-d4c4-463f-b49a-21699895e7e2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:35.904813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-29dad961-d4c4-463f-b49a-21699895e7e2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:35.905397 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-29dad961-d4c4-463f-b49a-21699895e7e2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:35.906150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-29dad961-d4c4-463f-b49a-21699895e7e2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:35.906577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-29dad961-d4c4-463f-b49a-21699895e7e2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:35.968130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-29dad961-d4c4-463f-b49a-21699895e7e2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:35.975714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-29dad961-d4c4-463f-b49a-21699895e7e2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081506 Nov 02 23:38:35.976281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2345/2920] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:35 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:36.991998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-10a1eeff-d2f8-4c10-97a2-6218179052ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:36.992693 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-10a1eeff-d2f8-4c10-97a2-6218179052ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:36.998838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10a1eeff-d2f8-4c10-97a2-6218179052ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:36.999313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10a1eeff-d2f8-4c10-97a2-6218179052ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:37.000073 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10a1eeff-d2f8-4c10-97a2-6218179052ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:37.000641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-10a1eeff-d2f8-4c10-97a2-6218179052ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:37.058232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-10a1eeff-d2f8-4c10-97a2-6218179052ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:37.066106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-10a1eeff-d2f8-4c10-97a2-6218179052ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077806 Nov 02 23:38:37.066672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2346/2921] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:36 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:38.083103 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-22980efb-cddc-44f4-9f20-78d7faace0b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:38.083805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-22980efb-cddc-44f4-9f20-78d7faace0b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:38.090081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22980efb-cddc-44f4-9f20-78d7faace0b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:38.090521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22980efb-cddc-44f4-9f20-78d7faace0b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:38.091304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22980efb-cddc-44f4-9f20-78d7faace0b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:38.091737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-22980efb-cddc-44f4-9f20-78d7faace0b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:38.152961 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-22980efb-cddc-44f4-9f20-78d7faace0b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:38.161174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-22980efb-cddc-44f4-9f20-78d7faace0b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081702 Nov 02 23:38:38.161744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2347/2922] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:38 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:39.177813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d107fd15-f16f-45c9-b066-c9525bdec7b0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:39.178508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d107fd15-f16f-45c9-b066-c9525bdec7b0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:39.185047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d107fd15-f16f-45c9-b066-c9525bdec7b0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:39.185495 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d107fd15-f16f-45c9-b066-c9525bdec7b0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:39.186259 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d107fd15-f16f-45c9-b066-c9525bdec7b0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:39.186693 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d107fd15-f16f-45c9-b066-c9525bdec7b0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:39.245851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d107fd15-f16f-45c9-b066-c9525bdec7b0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:39.253753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d107fd15-f16f-45c9-b066-c9525bdec7b0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079587 Nov 02 23:38:39.254313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2348/2923] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:39 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:40.269944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a2de0230-3532-46f6-b61e-f91bbf7538f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:40.270652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a2de0230-3532-46f6-b61e-f91bbf7538f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:40.276700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2de0230-3532-46f6-b61e-f91bbf7538f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:40.277135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2de0230-3532-46f6-b61e-f91bbf7538f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:40.277891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2de0230-3532-46f6-b61e-f91bbf7538f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:40.278310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a2de0230-3532-46f6-b61e-f91bbf7538f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:40.337330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a2de0230-3532-46f6-b61e-f91bbf7538f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:40.344945 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a2de0230-3532-46f6-b61e-f91bbf7538f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079278 Nov 02 23:38:40.345508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2349/2924] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:40 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:41.361314 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c5c595ff-5432-4c82-9276-98f772949995 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:41.361991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c5c595ff-5432-4c82-9276-98f772949995 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:41.368256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c5c595ff-5432-4c82-9276-98f772949995 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:41.368695 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c5c595ff-5432-4c82-9276-98f772949995 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:41.369449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c5c595ff-5432-4c82-9276-98f772949995 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:41.369902 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c5c595ff-5432-4c82-9276-98f772949995 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:41.427619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c5c595ff-5432-4c82-9276-98f772949995 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:41.435449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c5c595ff-5432-4c82-9276-98f772949995 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077862 Nov 02 23:38:41.436005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2350/2925] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:41 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:42.452411 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9602dd7b-9197-47ff-923f-82bd5c7b625b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:42.453125 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9602dd7b-9197-47ff-923f-82bd5c7b625b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:42.460054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9602dd7b-9197-47ff-923f-82bd5c7b625b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:42.460465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9602dd7b-9197-47ff-923f-82bd5c7b625b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:42.461249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9602dd7b-9197-47ff-923f-82bd5c7b625b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:42.461677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9602dd7b-9197-47ff-923f-82bd5c7b625b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:42.519822 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9602dd7b-9197-47ff-923f-82bd5c7b625b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:42.527393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9602dd7b-9197-47ff-923f-82bd5c7b625b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078647 Nov 02 23:38:42.527960 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2351/2926] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:42 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:43.543654 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f8a2143d-992c-45f9-bcf9-a3ca31aaa24a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:43.544296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f8a2143d-992c-45f9-bcf9-a3ca31aaa24a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:43.550507 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8a2143d-992c-45f9-bcf9-a3ca31aaa24a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:43.550961 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8a2143d-992c-45f9-bcf9-a3ca31aaa24a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:43.551730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8a2143d-992c-45f9-bcf9-a3ca31aaa24a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:43.552164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8a2143d-992c-45f9-bcf9-a3ca31aaa24a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:43.609851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f8a2143d-992c-45f9-bcf9-a3ca31aaa24a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:43.617720 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f8a2143d-992c-45f9-bcf9-a3ca31aaa24a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077730 Nov 02 23:38:43.618287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2352/2927] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:43 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:44.633824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ba424822-00c0-475d-88c1-1086babb4395 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:44.634488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ba424822-00c0-475d-88c1-1086babb4395 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:44.641344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ba424822-00c0-475d-88c1-1086babb4395 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:44.641779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ba424822-00c0-475d-88c1-1086babb4395 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:44.642533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ba424822-00c0-475d-88c1-1086babb4395 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:44.642981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ba424822-00c0-475d-88c1-1086babb4395 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:44.706506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ba424822-00c0-475d-88c1-1086babb4395 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:44.715077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ba424822-00c0-475d-88c1-1086babb4395 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.084845 Nov 02 23:38:44.715647 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2353/2928] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:44 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:45.732032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-73224649-8d0a-4776-a10a-e9d53c0b36aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:45.732715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-73224649-8d0a-4776-a10a-e9d53c0b36aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:45.739372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73224649-8d0a-4776-a10a-e9d53c0b36aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:45.739817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73224649-8d0a-4776-a10a-e9d53c0b36aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:45.740572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73224649-8d0a-4776-a10a-e9d53c0b36aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:45.740998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73224649-8d0a-4776-a10a-e9d53c0b36aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:45.800334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-73224649-8d0a-4776-a10a-e9d53c0b36aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:45.807979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-73224649-8d0a-4776-a10a-e9d53c0b36aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079608 Nov 02 23:38:45.808822 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2354/2929] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:45 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:46.825937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0d591ef6-0e18-4e70-9287-2d3424b15246 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:46.826649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0d591ef6-0e18-4e70-9287-2d3424b15246 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:46.833623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d591ef6-0e18-4e70-9287-2d3424b15246 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:46.834060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d591ef6-0e18-4e70-9287-2d3424b15246 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:46.834811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d591ef6-0e18-4e70-9287-2d3424b15246 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:46.835273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d591ef6-0e18-4e70-9287-2d3424b15246 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:46.892258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0d591ef6-0e18-4e70-9287-2d3424b15246 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:46.900693 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0d591ef6-0e18-4e70-9287-2d3424b15246 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078377 Nov 02 23:38:46.901264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2355/2930] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:46 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:47.917919 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0874a3c5-8a17-40c5-ae5c-508b3d7f6b80 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:47.918604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0874a3c5-8a17-40c5-ae5c-508b3d7f6b80 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:47.924770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0874a3c5-8a17-40c5-ae5c-508b3d7f6b80 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:47.925249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0874a3c5-8a17-40c5-ae5c-508b3d7f6b80 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:47.926012 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0874a3c5-8a17-40c5-ae5c-508b3d7f6b80 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:47.926440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0874a3c5-8a17-40c5-ae5c-508b3d7f6b80 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:47.984673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0874a3c5-8a17-40c5-ae5c-508b3d7f6b80 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:47.992433 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0874a3c5-8a17-40c5-ae5c-508b3d7f6b80 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078258 Nov 02 23:38:47.993016 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2356/2931] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:47 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:49.009123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-08652644-d461-4ca2-8824-b4c2e2a1e94e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:49.009837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-08652644-d461-4ca2-8824-b4c2e2a1e94e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:49.016124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08652644-d461-4ca2-8824-b4c2e2a1e94e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:49.016589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08652644-d461-4ca2-8824-b4c2e2a1e94e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:49.017486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08652644-d461-4ca2-8824-b4c2e2a1e94e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:49.017921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08652644-d461-4ca2-8824-b4c2e2a1e94e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:49.078658 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-08652644-d461-4ca2-8824-b4c2e2a1e94e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:49.086321 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-08652644-d461-4ca2-8824-b4c2e2a1e94e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080821 Nov 02 23:38:49.086890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2357/2932] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:49 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:38:50.101702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-eb70731d-2cde-4787-bf6e-341f6c8d3173 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:50.102406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-eb70731d-2cde-4787-bf6e-341f6c8d3173 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:50.108495 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb70731d-2cde-4787-bf6e-341f6c8d3173 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:50.108937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb70731d-2cde-4787-bf6e-341f6c8d3173 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:50.109689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb70731d-2cde-4787-bf6e-341f6c8d3173 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:50.110113 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eb70731d-2cde-4787-bf6e-341f6c8d3173 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:50.167535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-eb70731d-2cde-4787-bf6e-341f6c8d3173 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:50.175131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-eb70731d-2cde-4787-bf6e-341f6c8d3173 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077105 Nov 02 23:38:50.176189 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2358/2933] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:50 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:51.192166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-08fd246a-2404-4f77-bc17-60779916fc43 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:51.192857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-08fd246a-2404-4f77-bc17-60779916fc43 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:51.198687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08fd246a-2404-4f77-bc17-60779916fc43 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:51.199158 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08fd246a-2404-4f77-bc17-60779916fc43 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:51.199918 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08fd246a-2404-4f77-bc17-60779916fc43 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:51.200351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08fd246a-2404-4f77-bc17-60779916fc43 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:51.261339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-08fd246a-2404-4f77-bc17-60779916fc43 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:51.269059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-08fd246a-2404-4f77-bc17-60779916fc43 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081085 Nov 02 23:38:51.270315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2359/2934] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:51 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:52.286564 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-155972ee-0bb6-4695-bd2f-e0fb7066454d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:52.287288 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-155972ee-0bb6-4695-bd2f-e0fb7066454d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:52.293453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-155972ee-0bb6-4695-bd2f-e0fb7066454d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:52.293896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-155972ee-0bb6-4695-bd2f-e0fb7066454d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:52.294651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-155972ee-0bb6-4695-bd2f-e0fb7066454d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:52.295111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-155972ee-0bb6-4695-bd2f-e0fb7066454d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:52.354022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-155972ee-0bb6-4695-bd2f-e0fb7066454d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:52.361803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-155972ee-0bb6-4695-bd2f-e0fb7066454d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079512 Nov 02 23:38:52.362359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2360/2935] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:52 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:53.377491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cc0bd001-58fa-4386-b945-8e280c431358 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:53.378192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cc0bd001-58fa-4386-b945-8e280c431358 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:53.384319 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc0bd001-58fa-4386-b945-8e280c431358 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:53.384756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc0bd001-58fa-4386-b945-8e280c431358 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:53.385634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc0bd001-58fa-4386-b945-8e280c431358 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:53.386069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cc0bd001-58fa-4386-b945-8e280c431358 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:53.446179 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cc0bd001-58fa-4386-b945-8e280c431358 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:53.454031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cc0bd001-58fa-4386-b945-8e280c431358 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079967 Nov 02 23:38:53.454597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2361/2936] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:53 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:54.470357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8a029cb0-4522-4eeb-8012-d2c58a84155b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:54.471041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8a029cb0-4522-4eeb-8012-d2c58a84155b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:54.477824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a029cb0-4522-4eeb-8012-d2c58a84155b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:54.478445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a029cb0-4522-4eeb-8012-d2c58a84155b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:54.479194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a029cb0-4522-4eeb-8012-d2c58a84155b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:54.479621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8a029cb0-4522-4eeb-8012-d2c58a84155b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:54.537467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8a029cb0-4522-4eeb-8012-d2c58a84155b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:54.545087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8a029cb0-4522-4eeb-8012-d2c58a84155b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078392 Nov 02 23:38:54.545645 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2362/2937] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:54 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:55.561125 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9fd4fce8-d51d-4b55-8dc4-4ab9ba08f99b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:55.561800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9fd4fce8-d51d-4b55-8dc4-4ab9ba08f99b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:55.568397 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9fd4fce8-d51d-4b55-8dc4-4ab9ba08f99b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:55.568837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9fd4fce8-d51d-4b55-8dc4-4ab9ba08f99b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:55.569589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9fd4fce8-d51d-4b55-8dc4-4ab9ba08f99b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:55.570011 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9fd4fce8-d51d-4b55-8dc4-4ab9ba08f99b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:55.627305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9fd4fce8-d51d-4b55-8dc4-4ab9ba08f99b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:55.635464 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9fd4fce8-d51d-4b55-8dc4-4ab9ba08f99b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078395 Nov 02 23:38:55.636021 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2363/2938] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:55 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:56.652723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e566c165-4a42-4156-9f5b-69726580457e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:56.653521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e566c165-4a42-4156-9f5b-69726580457e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:56.659481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e566c165-4a42-4156-9f5b-69726580457e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:56.660427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e566c165-4a42-4156-9f5b-69726580457e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:56.661191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e566c165-4a42-4156-9f5b-69726580457e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:56.661618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e566c165-4a42-4156-9f5b-69726580457e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:56.819107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e566c165-4a42-4156-9f5b-69726580457e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:56.826780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e566c165-4a42-4156-9f5b-69726580457e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.177829 Nov 02 23:38:56.827386 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2364/2939] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:56 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:57.842976 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f5b7542f-bf74-48a1-99ad-23dd00bc12d4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:57.843630 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f5b7542f-bf74-48a1-99ad-23dd00bc12d4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:57.850294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f5b7542f-bf74-48a1-99ad-23dd00bc12d4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:57.850674 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f5b7542f-bf74-48a1-99ad-23dd00bc12d4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:57.851474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f5b7542f-bf74-48a1-99ad-23dd00bc12d4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:57.851901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f5b7542f-bf74-48a1-99ad-23dd00bc12d4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:57.912668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f5b7542f-bf74-48a1-99ad-23dd00bc12d4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:57.920413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f5b7542f-bf74-48a1-99ad-23dd00bc12d4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081121 Nov 02 23:38:57.920969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2365/2940] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:57 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:38:58.937710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3a92ae73-0a90-41ec-9ade-40baf458cb48 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:38:58.938448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3a92ae73-0a90-41ec-9ade-40baf458cb48 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:38:58.945029 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a92ae73-0a90-41ec-9ade-40baf458cb48 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:58.945465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a92ae73-0a90-41ec-9ade-40baf458cb48 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:58.946216 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a92ae73-0a90-41ec-9ade-40baf458cb48 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:38:58.946642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3a92ae73-0a90-41ec-9ade-40baf458cb48 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:38:59.006686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3a92ae73-0a90-41ec-9ade-40baf458cb48 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:38:59.014316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3a92ae73-0a90-41ec-9ade-40baf458cb48 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080258 Nov 02 23:38:59.014876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2366/2941] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:38:58 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:00.030588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-83ff7a62-4634-4d97-b698-00aa68d9276c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:00.031221 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-83ff7a62-4634-4d97-b698-00aa68d9276c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:00.038025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83ff7a62-4634-4d97-b698-00aa68d9276c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:00.038474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83ff7a62-4634-4d97-b698-00aa68d9276c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:00.039270 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83ff7a62-4634-4d97-b698-00aa68d9276c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:00.039704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-83ff7a62-4634-4d97-b698-00aa68d9276c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:00.098002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-83ff7a62-4634-4d97-b698-00aa68d9276c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:00.105752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-83ff7a62-4634-4d97-b698-00aa68d9276c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078812 Nov 02 23:39:00.106309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2367/2942] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:00 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:01.121259 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7efd8b0e-d79e-4d5a-b58d-c5d89b09d0c8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:01.122092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7efd8b0e-d79e-4d5a-b58d-c5d89b09d0c8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:01.128608 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7efd8b0e-d79e-4d5a-b58d-c5d89b09d0c8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:01.129044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7efd8b0e-d79e-4d5a-b58d-c5d89b09d0c8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:01.129802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7efd8b0e-d79e-4d5a-b58d-c5d89b09d0c8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:01.130226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7efd8b0e-d79e-4d5a-b58d-c5d89b09d0c8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:01.191360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7efd8b0e-d79e-4d5a-b58d-c5d89b09d0c8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:01.199060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7efd8b0e-d79e-4d5a-b58d-c5d89b09d0c8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081373 Nov 02 23:39:01.199625 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2368/2943] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:01 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:02.215383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-78ed5a1b-d7de-45f6-9b0f-eb70d151903a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:02.215990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-78ed5a1b-d7de-45f6-9b0f-eb70d151903a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:02.222128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78ed5a1b-d7de-45f6-9b0f-eb70d151903a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:02.222573 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78ed5a1b-d7de-45f6-9b0f-eb70d151903a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:02.223358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78ed5a1b-d7de-45f6-9b0f-eb70d151903a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:02.223781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78ed5a1b-d7de-45f6-9b0f-eb70d151903a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:02.282138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-78ed5a1b-d7de-45f6-9b0f-eb70d151903a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:02.290206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-78ed5a1b-d7de-45f6-9b0f-eb70d151903a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078424 Nov 02 23:39:02.290772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2369/2944] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:02 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:03.306480 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b3ace9e8-93a6-4056-b1f7-19283f291713 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:03.307183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b3ace9e8-93a6-4056-b1f7-19283f291713 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:03.313540 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3ace9e8-93a6-4056-b1f7-19283f291713 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:03.313985 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3ace9e8-93a6-4056-b1f7-19283f291713 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:03.314751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3ace9e8-93a6-4056-b1f7-19283f291713 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:03.315205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3ace9e8-93a6-4056-b1f7-19283f291713 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:03.373032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b3ace9e8-93a6-4056-b1f7-19283f291713 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:03.381150 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b3ace9e8-93a6-4056-b1f7-19283f291713 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078297 Nov 02 23:39:03.381708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2370/2945] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:03 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:04.397217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4367b890-9bcb-4f49-a108-782f818fbee4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:04.397904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4367b890-9bcb-4f49-a108-782f818fbee4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:04.403989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4367b890-9bcb-4f49-a108-782f818fbee4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:04.404432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4367b890-9bcb-4f49-a108-782f818fbee4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:04.405183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4367b890-9bcb-4f49-a108-782f818fbee4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:04.405611 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4367b890-9bcb-4f49-a108-782f818fbee4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:04.467248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4367b890-9bcb-4f49-a108-782f818fbee4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:04.477454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4367b890-9bcb-4f49-a108-782f818fbee4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.083856 Nov 02 23:39:04.478042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2371/2946] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:04 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:05.494428 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0b42715a-0c71-41a0-a17e-bb6c153b4e3b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:05.495118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0b42715a-0c71-41a0-a17e-bb6c153b4e3b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:05.501212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b42715a-0c71-41a0-a17e-bb6c153b4e3b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:05.501659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b42715a-0c71-41a0-a17e-bb6c153b4e3b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:05.502413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b42715a-0c71-41a0-a17e-bb6c153b4e3b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:05.502849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b42715a-0c71-41a0-a17e-bb6c153b4e3b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:05.561375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0b42715a-0c71-41a0-a17e-bb6c153b4e3b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:05.568909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0b42715a-0c71-41a0-a17e-bb6c153b4e3b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078141 Nov 02 23:39:05.569466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2372/2947] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:05 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:06.585662 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4ebf732f-69c8-44d6-9700-bbbf08e3ca61 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:06.586347 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4ebf732f-69c8-44d6-9700-bbbf08e3ca61 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:06.592489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ebf732f-69c8-44d6-9700-bbbf08e3ca61 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:06.592916 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ebf732f-69c8-44d6-9700-bbbf08e3ca61 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:06.593672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ebf732f-69c8-44d6-9700-bbbf08e3ca61 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:06.594093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4ebf732f-69c8-44d6-9700-bbbf08e3ca61 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:06.651808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4ebf732f-69c8-44d6-9700-bbbf08e3ca61 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:06.659729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4ebf732f-69c8-44d6-9700-bbbf08e3ca61 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077695 Nov 02 23:39:06.660312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2373/2948] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:06 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:07.676444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-606655cc-0deb-4e11-ba7b-1cb4855d7f13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:07.677137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-606655cc-0deb-4e11-ba7b-1cb4855d7f13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:07.683823 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-606655cc-0deb-4e11-ba7b-1cb4855d7f13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:07.684267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-606655cc-0deb-4e11-ba7b-1cb4855d7f13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:07.685033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-606655cc-0deb-4e11-ba7b-1cb4855d7f13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:07.685464 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-606655cc-0deb-4e11-ba7b-1cb4855d7f13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:07.744292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-606655cc-0deb-4e11-ba7b-1cb4855d7f13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:07.752341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-606655cc-0deb-4e11-ba7b-1cb4855d7f13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079503 Nov 02 23:39:07.752946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2374/2949] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:07 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:08.769049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fa60fcbe-4779-42b0-b918-dd5c0c7aea09 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:08.769745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fa60fcbe-4779-42b0-b918-dd5c0c7aea09 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:08.776422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fa60fcbe-4779-42b0-b918-dd5c0c7aea09 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:08.776866 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fa60fcbe-4779-42b0-b918-dd5c0c7aea09 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:08.777616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fa60fcbe-4779-42b0-b918-dd5c0c7aea09 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:08.778041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fa60fcbe-4779-42b0-b918-dd5c0c7aea09 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:08.836013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fa60fcbe-4779-42b0-b918-dd5c0c7aea09 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:08.843781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fa60fcbe-4779-42b0-b918-dd5c0c7aea09 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078356 Nov 02 23:39:08.844346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2375/2950] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:08 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:09.860850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-45d4e680-14db-479e-bea3-c05706ff6aa6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:09.861612 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-45d4e680-14db-479e-bea3-c05706ff6aa6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:09.868934 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45d4e680-14db-479e-bea3-c05706ff6aa6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:09.869474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45d4e680-14db-479e-bea3-c05706ff6aa6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:09.870304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45d4e680-14db-479e-bea3-c05706ff6aa6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:09.870801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45d4e680-14db-479e-bea3-c05706ff6aa6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:09.929954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-45d4e680-14db-479e-bea3-c05706ff6aa6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:09.937854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-45d4e680-14db-479e-bea3-c05706ff6aa6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080654 Nov 02 23:39:09.938408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2376/2951] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:09 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:10.954061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ade2ac30-b448-49a2-aa7b-f458df8bdd38 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:10.954743 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ade2ac30-b448-49a2-aa7b-f458df8bdd38 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:10.960924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ade2ac30-b448-49a2-aa7b-f458df8bdd38 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:10.961375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ade2ac30-b448-49a2-aa7b-f458df8bdd38 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:10.962133 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ade2ac30-b448-49a2-aa7b-f458df8bdd38 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:10.962560 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ade2ac30-b448-49a2-aa7b-f458df8bdd38 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:11.023680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ade2ac30-b448-49a2-aa7b-f458df8bdd38 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:11.031430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ade2ac30-b448-49a2-aa7b-f458df8bdd38 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081038 Nov 02 23:39:11.031994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2377/2952] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:10 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:12.047690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-39a6e944-8a27-4c4f-a071-08e73859c71d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:12.048394 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-39a6e944-8a27-4c4f-a071-08e73859c71d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:12.054424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39a6e944-8a27-4c4f-a071-08e73859c71d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:12.054867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39a6e944-8a27-4c4f-a071-08e73859c71d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:12.055649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39a6e944-8a27-4c4f-a071-08e73859c71d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:12.056075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-39a6e944-8a27-4c4f-a071-08e73859c71d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:12.114210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-39a6e944-8a27-4c4f-a071-08e73859c71d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:12.121989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-39a6e944-8a27-4c4f-a071-08e73859c71d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077957 Nov 02 23:39:12.122546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2378/2953] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:12 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:39:13.138992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-66710354-189b-4e16-8a40-88b8be6c03cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:13.139692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-66710354-189b-4e16-8a40-88b8be6c03cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:13.146280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66710354-189b-4e16-8a40-88b8be6c03cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:13.146726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66710354-189b-4e16-8a40-88b8be6c03cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:13.147515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66710354-189b-4e16-8a40-88b8be6c03cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:13.147944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66710354-189b-4e16-8a40-88b8be6c03cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:13.205220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-66710354-189b-4e16-8a40-88b8be6c03cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:13.218422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-66710354-189b-4e16-8a40-88b8be6c03cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.082910 Nov 02 23:39:13.219266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2379/2954] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:13 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:14.235287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bf53bd2c-8f56-4628-8b8b-b5d566dc30c7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:14.235895 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bf53bd2c-8f56-4628-8b8b-b5d566dc30c7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:14.242547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf53bd2c-8f56-4628-8b8b-b5d566dc30c7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:14.243036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf53bd2c-8f56-4628-8b8b-b5d566dc30c7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:14.243802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf53bd2c-8f56-4628-8b8b-b5d566dc30c7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:14.244234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf53bd2c-8f56-4628-8b8b-b5d566dc30c7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:14.303643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bf53bd2c-8f56-4628-8b8b-b5d566dc30c7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:14.311488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bf53bd2c-8f56-4628-8b8b-b5d566dc30c7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079880 Nov 02 23:39:14.312055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2380/2955] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:14 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:15.327802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2a8f2308-ad94-4cd2-aa7f-187a91bebe16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:15.328471 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2a8f2308-ad94-4cd2-aa7f-187a91bebe16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:15.335257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a8f2308-ad94-4cd2-aa7f-187a91bebe16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:15.335701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a8f2308-ad94-4cd2-aa7f-187a91bebe16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:15.336461 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a8f2308-ad94-4cd2-aa7f-187a91bebe16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:15.336890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2a8f2308-ad94-4cd2-aa7f-187a91bebe16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:15.393668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2a8f2308-ad94-4cd2-aa7f-187a91bebe16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:15.401990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2a8f2308-ad94-4cd2-aa7f-187a91bebe16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077796 Nov 02 23:39:15.402559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2381/2956] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:15 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:16.418270 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b1e144d5-a568-41bf-98f3-b95d0978ada7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:16.418977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b1e144d5-a568-41bf-98f3-b95d0978ada7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:16.425135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b1e144d5-a568-41bf-98f3-b95d0978ada7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:16.425571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b1e144d5-a568-41bf-98f3-b95d0978ada7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:16.426323 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b1e144d5-a568-41bf-98f3-b95d0978ada7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:16.426755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b1e144d5-a568-41bf-98f3-b95d0978ada7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:16.484030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b1e144d5-a568-41bf-98f3-b95d0978ada7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:16.491628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b1e144d5-a568-41bf-98f3-b95d0978ada7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077004 Nov 02 23:39:16.492180 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2382/2957] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:16 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:17.508010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-26329d12-0025-4778-b00d-c3e723e7966a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:17.508690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-26329d12-0025-4778-b00d-c3e723e7966a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:17.514754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26329d12-0025-4778-b00d-c3e723e7966a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:17.515229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26329d12-0025-4778-b00d-c3e723e7966a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:17.515989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26329d12-0025-4778-b00d-c3e723e7966a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:17.516420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26329d12-0025-4778-b00d-c3e723e7966a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:17.576815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-26329d12-0025-4778-b00d-c3e723e7966a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:17.584410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-26329d12-0025-4778-b00d-c3e723e7966a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080131 Nov 02 23:39:17.584962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2383/2958] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:17 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:18.600404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6cb58f14-46cb-440d-b41a-39db5595acf4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:18.601084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6cb58f14-46cb-440d-b41a-39db5595acf4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:18.607412 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6cb58f14-46cb-440d-b41a-39db5595acf4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:18.607837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6cb58f14-46cb-440d-b41a-39db5595acf4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:18.608600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6cb58f14-46cb-440d-b41a-39db5595acf4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:18.609031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6cb58f14-46cb-440d-b41a-39db5595acf4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:18.666731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6cb58f14-46cb-440d-b41a-39db5595acf4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:18.674404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6cb58f14-46cb-440d-b41a-39db5595acf4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077648 Nov 02 23:39:18.674993 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2384/2959] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:18 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:19.691573 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-831adac5-dcb9-42a4-9856-092995ada8b3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:19.692835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-831adac5-dcb9-42a4-9856-092995ada8b3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:19.699035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-831adac5-dcb9-42a4-9856-092995ada8b3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:19.699482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-831adac5-dcb9-42a4-9856-092995ada8b3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:19.700243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-831adac5-dcb9-42a4-9856-092995ada8b3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:19.700674 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-831adac5-dcb9-42a4-9856-092995ada8b3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:19.758788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-831adac5-dcb9-42a4-9856-092995ada8b3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:19.766437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-831adac5-dcb9-42a4-9856-092995ada8b3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078645 Nov 02 23:39:19.767018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2385/2960] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:19 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:20.783371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e7f05286-b96d-4ec1-87a6-83728c84e896 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:20.784068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e7f05286-b96d-4ec1-87a6-83728c84e896 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:20.790621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e7f05286-b96d-4ec1-87a6-83728c84e896 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:20.791100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e7f05286-b96d-4ec1-87a6-83728c84e896 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:20.791858 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e7f05286-b96d-4ec1-87a6-83728c84e896 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:20.792288 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e7f05286-b96d-4ec1-87a6-83728c84e896 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:20.851253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e7f05286-b96d-4ec1-87a6-83728c84e896 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:20.859176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e7f05286-b96d-4ec1-87a6-83728c84e896 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079407 Nov 02 23:39:20.859738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2386/2961] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:20 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:21.875522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-027ee63e-65a4-4ca4-a06a-ac6362aaae2c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:21.876215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-027ee63e-65a4-4ca4-a06a-ac6362aaae2c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:21.882215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-027ee63e-65a4-4ca4-a06a-ac6362aaae2c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:21.882652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-027ee63e-65a4-4ca4-a06a-ac6362aaae2c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:21.883441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-027ee63e-65a4-4ca4-a06a-ac6362aaae2c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:21.883869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-027ee63e-65a4-4ca4-a06a-ac6362aaae2c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:21.942650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-027ee63e-65a4-4ca4-a06a-ac6362aaae2c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:21.950251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-027ee63e-65a4-4ca4-a06a-ac6362aaae2c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078422 Nov 02 23:39:21.951043 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2387/2962] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:21 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:22.966495 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-72213ac0-befa-4288-8dcd-3465ebd5214f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:22.967224 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-72213ac0-befa-4288-8dcd-3465ebd5214f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:22.973317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72213ac0-befa-4288-8dcd-3465ebd5214f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:22.974377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72213ac0-befa-4288-8dcd-3465ebd5214f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:22.975162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72213ac0-befa-4288-8dcd-3465ebd5214f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:22.975594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-72213ac0-befa-4288-8dcd-3465ebd5214f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:23.032265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-72213ac0-befa-4288-8dcd-3465ebd5214f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:23.040501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-72213ac0-befa-4288-8dcd-3465ebd5214f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077611 Nov 02 23:39:23.041051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2388/2963] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:22 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:24.057725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-88367d3d-114e-4a5a-a63c-734d0b322311 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:24.058680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-88367d3d-114e-4a5a-a63c-734d0b322311 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:24.064976 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88367d3d-114e-4a5a-a63c-734d0b322311 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:24.065420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88367d3d-114e-4a5a-a63c-734d0b322311 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:24.066186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88367d3d-114e-4a5a-a63c-734d0b322311 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:24.066624 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88367d3d-114e-4a5a-a63c-734d0b322311 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:24.127308 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-88367d3d-114e-4a5a-a63c-734d0b322311 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:24.135177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-88367d3d-114e-4a5a-a63c-734d0b322311 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081182 Nov 02 23:39:24.135744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2389/2964] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:24 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:25.151754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bb6c20e7-2d8c-483b-be6d-81b4dbf67c16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:25.152458 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bb6c20e7-2d8c-483b-be6d-81b4dbf67c16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:25.158499 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bb6c20e7-2d8c-483b-be6d-81b4dbf67c16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:25.158955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bb6c20e7-2d8c-483b-be6d-81b4dbf67c16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:25.159716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bb6c20e7-2d8c-483b-be6d-81b4dbf67c16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:25.160136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bb6c20e7-2d8c-483b-be6d-81b4dbf67c16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:25.218621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bb6c20e7-2d8c-483b-be6d-81b4dbf67c16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:25.226281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bb6c20e7-2d8c-483b-be6d-81b4dbf67c16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078214 Nov 02 23:39:25.226837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2390/2965] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:25 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:26.243183 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f070defb-4d01-4c89-bc50-4ceab03b01b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:26.243793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f070defb-4d01-4c89-bc50-4ceab03b01b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:26.249948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f070defb-4d01-4c89-bc50-4ceab03b01b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:26.250409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f070defb-4d01-4c89-bc50-4ceab03b01b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:26.251194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f070defb-4d01-4c89-bc50-4ceab03b01b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:26.251633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f070defb-4d01-4c89-bc50-4ceab03b01b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:26.310500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f070defb-4d01-4c89-bc50-4ceab03b01b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:26.318378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f070defb-4d01-4c89-bc50-4ceab03b01b1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079576 Nov 02 23:39:26.318948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2391/2966] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:26 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:27.335264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6d11ba31-589c-49c5-be62-cd6ea852b340 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:27.336042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6d11ba31-589c-49c5-be62-cd6ea852b340 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:27.341980 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6d11ba31-589c-49c5-be62-cd6ea852b340 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:27.342427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6d11ba31-589c-49c5-be62-cd6ea852b340 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:27.343227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6d11ba31-589c-49c5-be62-cd6ea852b340 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:27.343659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6d11ba31-589c-49c5-be62-cd6ea852b340 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:27.401254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6d11ba31-589c-49c5-be62-cd6ea852b340 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:27.408942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6d11ba31-589c-49c5-be62-cd6ea852b340 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077944 Nov 02 23:39:27.409472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2392/2967] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:27 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:28.425108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-80dcd317-d53f-4c04-9d09-0d631b172a66 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:28.425750 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-80dcd317-d53f-4c04-9d09-0d631b172a66 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:28.431850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-80dcd317-d53f-4c04-9d09-0d631b172a66 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:28.432291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-80dcd317-d53f-4c04-9d09-0d631b172a66 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:28.433303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-80dcd317-d53f-4c04-9d09-0d631b172a66 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:28.433726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-80dcd317-d53f-4c04-9d09-0d631b172a66 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:28.491123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-80dcd317-d53f-4c04-9d09-0d631b172a66 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:28.498847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-80dcd317-d53f-4c04-9d09-0d631b172a66 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077523 Nov 02 23:39:28.499438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2393/2968] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:28 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:29.515595 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-88bd80de-162d-403d-86cf-514a69c6d770 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:29.516217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-88bd80de-162d-403d-86cf-514a69c6d770 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:29.522355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88bd80de-162d-403d-86cf-514a69c6d770 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:29.522807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88bd80de-162d-403d-86cf-514a69c6d770 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:29.523602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88bd80de-162d-403d-86cf-514a69c6d770 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:29.524033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88bd80de-162d-403d-86cf-514a69c6d770 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:29.581799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-88bd80de-162d-403d-86cf-514a69c6d770 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:29.589532 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-88bd80de-162d-403d-86cf-514a69c6d770 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077590 Nov 02 23:39:29.590095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2394/2969] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:29 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:30.605788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b63e5c86-7f94-4d20-96b4-0171b7aa533e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:30.606508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b63e5c86-7f94-4d20-96b4-0171b7aa533e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:30.613044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b63e5c86-7f94-4d20-96b4-0171b7aa533e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:30.613489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b63e5c86-7f94-4d20-96b4-0171b7aa533e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:30.614276 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b63e5c86-7f94-4d20-96b4-0171b7aa533e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:30.614714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b63e5c86-7f94-4d20-96b4-0171b7aa533e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:30.675678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b63e5c86-7f94-4d20-96b4-0171b7aa533e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:30.683711 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b63e5c86-7f94-4d20-96b4-0171b7aa533e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081554 Nov 02 23:39:30.684272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2395/2970] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:30 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:31.700847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b6603c4f-c26c-4434-9c2b-b11e8fec22f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:31.701525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b6603c4f-c26c-4434-9c2b-b11e8fec22f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:31.707613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6603c4f-c26c-4434-9c2b-b11e8fec22f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:31.708056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6603c4f-c26c-4434-9c2b-b11e8fec22f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:31.708816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6603c4f-c26c-4434-9c2b-b11e8fec22f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:31.709731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6603c4f-c26c-4434-9c2b-b11e8fec22f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:31.768430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b6603c4f-c26c-4434-9c2b-b11e8fec22f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:31.776765 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b6603c4f-c26c-4434-9c2b-b11e8fec22f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079607 Nov 02 23:39:31.777327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2396/2971] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:31 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:32.792525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dbecfbc8-29a8-461a-8c52-2cbd47e51986 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:32.793202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dbecfbc8-29a8-461a-8c52-2cbd47e51986 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:32.799340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbecfbc8-29a8-461a-8c52-2cbd47e51986 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:32.799779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbecfbc8-29a8-461a-8c52-2cbd47e51986 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:32.800535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbecfbc8-29a8-461a-8c52-2cbd47e51986 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:32.800970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbecfbc8-29a8-461a-8c52-2cbd47e51986 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:32.861197 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dbecfbc8-29a8-461a-8c52-2cbd47e51986 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:32.868837 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dbecfbc8-29a8-461a-8c52-2cbd47e51986 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079942 Nov 02 23:39:32.869404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2397/2972] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:32 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:33.885156 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1f0fd97e-2ec3-41df-b53d-1d011c164fe8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:33.885897 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1f0fd97e-2ec3-41df-b53d-1d011c164fe8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:33.891962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f0fd97e-2ec3-41df-b53d-1d011c164fe8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:33.892406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f0fd97e-2ec3-41df-b53d-1d011c164fe8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:33.893164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f0fd97e-2ec3-41df-b53d-1d011c164fe8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:33.893593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f0fd97e-2ec3-41df-b53d-1d011c164fe8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:33.951195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1f0fd97e-2ec3-41df-b53d-1d011c164fe8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:33.958664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1f0fd97e-2ec3-41df-b53d-1d011c164fe8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077122 Nov 02 23:39:33.959251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2398/2973] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:33 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:34.975748 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9ed45843-49b3-4094-8916-7ef0da7e41f1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:34.976474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9ed45843-49b3-4094-8916-7ef0da7e41f1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:34.983628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ed45843-49b3-4094-8916-7ef0da7e41f1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:34.984125 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ed45843-49b3-4094-8916-7ef0da7e41f1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:34.984958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ed45843-49b3-4094-8916-7ef0da7e41f1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:34.985426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9ed45843-49b3-4094-8916-7ef0da7e41f1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:35.044154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9ed45843-49b3-4094-8916-7ef0da7e41f1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:35.051965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9ed45843-49b3-4094-8916-7ef0da7e41f1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079915 Nov 02 23:39:35.052537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2399/2974] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:34 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:36.068937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e4766e69-82bd-46ab-8a3b-994f0e871c8d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:36.069636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e4766e69-82bd-46ab-8a3b-994f0e871c8d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:36.075770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4766e69-82bd-46ab-8a3b-994f0e871c8d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:36.076223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4766e69-82bd-46ab-8a3b-994f0e871c8d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:36.076988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4766e69-82bd-46ab-8a3b-994f0e871c8d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:36.077424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e4766e69-82bd-46ab-8a3b-994f0e871c8d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:36.135253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e4766e69-82bd-46ab-8a3b-994f0e871c8d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:36.142937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e4766e69-82bd-46ab-8a3b-994f0e871c8d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077610 Nov 02 23:39:36.143503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2400/2975] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:36 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:37.159805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dd82d0a9-af60-439a-95a3-d48c37d7d40d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:37.160477 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dd82d0a9-af60-439a-95a3-d48c37d7d40d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:37.167087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd82d0a9-af60-439a-95a3-d48c37d7d40d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:37.167526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd82d0a9-af60-439a-95a3-d48c37d7d40d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:37.168287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd82d0a9-af60-439a-95a3-d48c37d7d40d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:37.168716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd82d0a9-af60-439a-95a3-d48c37d7d40d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:37.229936 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dd82d0a9-af60-439a-95a3-d48c37d7d40d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:37.237674 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dd82d0a9-af60-439a-95a3-d48c37d7d40d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081437 Nov 02 23:39:37.238234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2401/2976] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:37 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:38.254630 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-022e9652-175c-433f-aa1e-62a43fb92b4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:38.255259 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-022e9652-175c-433f-aa1e-62a43fb92b4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:38.261420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-022e9652-175c-433f-aa1e-62a43fb92b4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:38.261863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-022e9652-175c-433f-aa1e-62a43fb92b4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:38.262610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-022e9652-175c-433f-aa1e-62a43fb92b4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:38.263063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-022e9652-175c-433f-aa1e-62a43fb92b4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:38.320411 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-022e9652-175c-433f-aa1e-62a43fb92b4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:38.328039 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-022e9652-175c-433f-aa1e-62a43fb92b4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077029 Nov 02 23:39:38.328591 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2402/2977] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:38 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:39.344890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fd60f11b-8356-4208-a679-d5e6a187ef1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:39.345593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fd60f11b-8356-4208-a679-d5e6a187ef1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:39.352124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd60f11b-8356-4208-a679-d5e6a187ef1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:39.352570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd60f11b-8356-4208-a679-d5e6a187ef1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:39.353327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd60f11b-8356-4208-a679-d5e6a187ef1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:39.353755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fd60f11b-8356-4208-a679-d5e6a187ef1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:39.411165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fd60f11b-8356-4208-a679-d5e6a187ef1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:39.419321 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fd60f11b-8356-4208-a679-d5e6a187ef1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078070 Nov 02 23:39:39.419875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2403/2978] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:39 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:39:40.436166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d9d8025b-0420-48da-bf93-b790dddcf373 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:40.436824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d9d8025b-0420-48da-bf93-b790dddcf373 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:40.442908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9d8025b-0420-48da-bf93-b790dddcf373 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:40.443377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9d8025b-0420-48da-bf93-b790dddcf373 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:40.444622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9d8025b-0420-48da-bf93-b790dddcf373 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:40.445058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9d8025b-0420-48da-bf93-b790dddcf373 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:40.502520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d9d8025b-0420-48da-bf93-b790dddcf373 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:40.510821 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d9d8025b-0420-48da-bf93-b790dddcf373 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078671 Nov 02 23:39:40.511423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2404/2979] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:40 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:41.527923 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-559a1c70-c940-4e22-80ae-777e73df661c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:41.528563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-559a1c70-c940-4e22-80ae-777e73df661c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:41.534625 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-559a1c70-c940-4e22-80ae-777e73df661c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:41.535111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-559a1c70-c940-4e22-80ae-777e73df661c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:41.535868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-559a1c70-c940-4e22-80ae-777e73df661c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:41.536295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-559a1c70-c940-4e22-80ae-777e73df661c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:41.595123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-559a1c70-c940-4e22-80ae-777e73df661c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:41.603334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-559a1c70-c940-4e22-80ae-777e73df661c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079041 Nov 02 23:39:41.603900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2405/2980] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:41 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:42.620563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bc77737f-cc31-411e-b4b4-b18f1fcd07fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:42.621246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bc77737f-cc31-411e-b4b4-b18f1fcd07fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:42.627976 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc77737f-cc31-411e-b4b4-b18f1fcd07fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:42.628411 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc77737f-cc31-411e-b4b4-b18f1fcd07fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:42.629180 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc77737f-cc31-411e-b4b4-b18f1fcd07fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:42.629617 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc77737f-cc31-411e-b4b4-b18f1fcd07fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:42.688176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bc77737f-cc31-411e-b4b4-b18f1fcd07fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:42.696032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bc77737f-cc31-411e-b4b4-b18f1fcd07fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079867 Nov 02 23:39:42.696599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2406/2981] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:42 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:43.712590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a25c365c-c92e-4b95-bc32-71e98781da32 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:43.713353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a25c365c-c92e-4b95-bc32-71e98781da32 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:43.719489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a25c365c-c92e-4b95-bc32-71e98781da32 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:43.719929 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a25c365c-c92e-4b95-bc32-71e98781da32 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:43.720685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a25c365c-c92e-4b95-bc32-71e98781da32 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:43.721113 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a25c365c-c92e-4b95-bc32-71e98781da32 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:43.782699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a25c365c-c92e-4b95-bc32-71e98781da32 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:43.790957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a25c365c-c92e-4b95-bc32-71e98781da32 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.082608 Nov 02 23:39:43.791517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2407/2982] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:43 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:44.808085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aee50ad8-d1df-4895-8726-8e99a07ef433 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:44.808772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aee50ad8-d1df-4895-8726-8e99a07ef433 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:44.814977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aee50ad8-d1df-4895-8726-8e99a07ef433 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:44.815421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aee50ad8-d1df-4895-8726-8e99a07ef433 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:44.816173 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aee50ad8-d1df-4895-8726-8e99a07ef433 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:44.816597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aee50ad8-d1df-4895-8726-8e99a07ef433 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:44.874667 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aee50ad8-d1df-4895-8726-8e99a07ef433 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:44.882339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aee50ad8-d1df-4895-8726-8e99a07ef433 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078718 Nov 02 23:39:44.882942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2408/2983] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:44 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:45.897690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0f5a5d7c-28bf-48df-962b-cd3fb6d993c8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:45.898350 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0f5a5d7c-28bf-48df-962b-cd3fb6d993c8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:45.904521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0f5a5d7c-28bf-48df-962b-cd3fb6d993c8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:45.904956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0f5a5d7c-28bf-48df-962b-cd3fb6d993c8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:45.905708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0f5a5d7c-28bf-48df-962b-cd3fb6d993c8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:45.906134 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0f5a5d7c-28bf-48df-962b-cd3fb6d993c8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:45.964262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0f5a5d7c-28bf-48df-962b-cd3fb6d993c8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:45.972021 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0f5a5d7c-28bf-48df-962b-cd3fb6d993c8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077963 Nov 02 23:39:45.972580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2409/2984] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:45 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:46.988136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-21ead014-3211-40db-8090-f2ed1ed80ca0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:46.988818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-21ead014-3211-40db-8090-f2ed1ed80ca0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:46.994829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21ead014-3211-40db-8090-f2ed1ed80ca0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:46.995302 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21ead014-3211-40db-8090-f2ed1ed80ca0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:46.996055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21ead014-3211-40db-8090-f2ed1ed80ca0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:46.996481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-21ead014-3211-40db-8090-f2ed1ed80ca0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:47.054865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-21ead014-3211-40db-8090-f2ed1ed80ca0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:47.062757 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-21ead014-3211-40db-8090-f2ed1ed80ca0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078254 Nov 02 23:39:47.063352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2410/2985] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:46 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:48.079391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a032a487-d354-42ef-89fa-3a00f98d854c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:48.080076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a032a487-d354-42ef-89fa-3a00f98d854c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:48.086330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a032a487-d354-42ef-89fa-3a00f98d854c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:48.086765 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a032a487-d354-42ef-89fa-3a00f98d854c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:48.087550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a032a487-d354-42ef-89fa-3a00f98d854c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:48.087974 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a032a487-d354-42ef-89fa-3a00f98d854c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:48.145812 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a032a487-d354-42ef-89fa-3a00f98d854c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:48.153449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a032a487-d354-42ef-89fa-3a00f98d854c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077649 Nov 02 23:39:48.154009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2411/2986] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:48 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:49.170005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-eacf79ef-06cc-4699-9b03-c08b98d1900f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:49.170733 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-eacf79ef-06cc-4699-9b03-c08b98d1900f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:49.176968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eacf79ef-06cc-4699-9b03-c08b98d1900f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:49.177409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eacf79ef-06cc-4699-9b03-c08b98d1900f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:49.178166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eacf79ef-06cc-4699-9b03-c08b98d1900f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:49.178633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eacf79ef-06cc-4699-9b03-c08b98d1900f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:49.237575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-eacf79ef-06cc-4699-9b03-c08b98d1900f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:49.245308 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-eacf79ef-06cc-4699-9b03-c08b98d1900f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079094 Nov 02 23:39:49.245873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2412/2987] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:49 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:39:50.403943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a1e712ba-6e8b-4d61-84c1-5780a0052431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:50.404568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a1e712ba-6e8b-4d61-84c1-5780a0052431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:50.410254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a1e712ba-6e8b-4d61-84c1-5780a0052431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:50.410696 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a1e712ba-6e8b-4d61-84c1-5780a0052431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:50.411496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a1e712ba-6e8b-4d61-84c1-5780a0052431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:50.411924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a1e712ba-6e8b-4d61-84c1-5780a0052431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:50.473794 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a1e712ba-6e8b-4d61-84c1-5780a0052431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:50.481554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a1e712ba-6e8b-4d61-84c1-5780a0052431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.223266 Nov 02 23:39:50.482137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2413/2988] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:50 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:51.497976 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bf9c91a3-25be-489c-a715-5fda42564e01 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:51.498643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bf9c91a3-25be-489c-a715-5fda42564e01 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:51.504706 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf9c91a3-25be-489c-a715-5fda42564e01 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:51.505147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf9c91a3-25be-489c-a715-5fda42564e01 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:51.505896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf9c91a3-25be-489c-a715-5fda42564e01 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:51.506325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bf9c91a3-25be-489c-a715-5fda42564e01 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:51.565143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bf9c91a3-25be-489c-a715-5fda42564e01 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:51.573202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bf9c91a3-25be-489c-a715-5fda42564e01 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078884 Nov 02 23:39:51.573768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2414/2989] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:51 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:52.589707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a85a8e07-b7ee-4505-9b21-64449d2d1f38 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:52.590413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a85a8e07-b7ee-4505-9b21-64449d2d1f38 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:52.596738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a85a8e07-b7ee-4505-9b21-64449d2d1f38 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:52.597185 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a85a8e07-b7ee-4505-9b21-64449d2d1f38 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:52.597955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a85a8e07-b7ee-4505-9b21-64449d2d1f38 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:52.598381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a85a8e07-b7ee-4505-9b21-64449d2d1f38 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:52.657885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a85a8e07-b7ee-4505-9b21-64449d2d1f38 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:52.665516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a85a8e07-b7ee-4505-9b21-64449d2d1f38 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079449 Nov 02 23:39:52.666075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2415/2990] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:52 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:53.681566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d3b88b72-3f16-4391-a7ef-ea18e3062346 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:53.682238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d3b88b72-3f16-4391-a7ef-ea18e3062346 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:53.688527 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3b88b72-3f16-4391-a7ef-ea18e3062346 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:53.688959 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3b88b72-3f16-4391-a7ef-ea18e3062346 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:53.690158 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3b88b72-3f16-4391-a7ef-ea18e3062346 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:53.690158 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3b88b72-3f16-4391-a7ef-ea18e3062346 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:53.749781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d3b88b72-3f16-4391-a7ef-ea18e3062346 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:53.758341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d3b88b72-3f16-4391-a7ef-ea18e3062346 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080464 Nov 02 23:39:53.758937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2416/2991] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:53 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:54.775552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c48c4753-2f68-4347-bfcd-c7b024b2237a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:54.776250 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c48c4753-2f68-4347-bfcd-c7b024b2237a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:54.782270 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c48c4753-2f68-4347-bfcd-c7b024b2237a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:54.782708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c48c4753-2f68-4347-bfcd-c7b024b2237a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:54.783588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c48c4753-2f68-4347-bfcd-c7b024b2237a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:54.783923 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c48c4753-2f68-4347-bfcd-c7b024b2237a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:54.842889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c48c4753-2f68-4347-bfcd-c7b024b2237a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:54.851552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c48c4753-2f68-4347-bfcd-c7b024b2237a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080182 Nov 02 23:39:54.852124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2417/2992] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:54 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:55.868735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2b90ab5d-4eca-4691-840a-8c1ef1e6857b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:55.869424 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2b90ab5d-4eca-4691-840a-8c1ef1e6857b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:55.875778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b90ab5d-4eca-4691-840a-8c1ef1e6857b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:55.876224 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b90ab5d-4eca-4691-840a-8c1ef1e6857b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:55.877017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b90ab5d-4eca-4691-840a-8c1ef1e6857b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:55.877447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b90ab5d-4eca-4691-840a-8c1ef1e6857b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:55.935681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2b90ab5d-4eca-4691-840a-8c1ef1e6857b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:55.943241 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2b90ab5d-4eca-4691-840a-8c1ef1e6857b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078792 Nov 02 23:39:55.943809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2418/2993] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:55 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:56.959614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3fede60f-ba61-4362-ba03-0562951cfc6f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:56.960866 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3fede60f-ba61-4362-ba03-0562951cfc6f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:56.967305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fede60f-ba61-4362-ba03-0562951cfc6f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:56.967751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fede60f-ba61-4362-ba03-0562951cfc6f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:56.968518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fede60f-ba61-4362-ba03-0562951cfc6f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:56.968964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fede60f-ba61-4362-ba03-0562951cfc6f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:57.031789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3fede60f-ba61-4362-ba03-0562951cfc6f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:57.039367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3fede60f-ba61-4362-ba03-0562951cfc6f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.083393 Nov 02 23:39:57.039964 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2419/2994] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:56 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:58.056460 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-413d3cdd-2913-4e29-ba6d-dd4654cc5a98 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:58.057186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-413d3cdd-2913-4e29-ba6d-dd4654cc5a98 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:58.063607 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-413d3cdd-2913-4e29-ba6d-dd4654cc5a98 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:58.064049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-413d3cdd-2913-4e29-ba6d-dd4654cc5a98 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:58.064807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-413d3cdd-2913-4e29-ba6d-dd4654cc5a98 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:58.065234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-413d3cdd-2913-4e29-ba6d-dd4654cc5a98 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:58.125594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-413d3cdd-2913-4e29-ba6d-dd4654cc5a98 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:58.133509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-413d3cdd-2913-4e29-ba6d-dd4654cc5a98 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081120 Nov 02 23:39:58.134090 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2420/2995] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:58 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:39:59.149225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d48c1b09-0119-459f-bec9-553fd142a02f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:39:59.149924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d48c1b09-0119-459f-bec9-553fd142a02f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:39:59.158257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d48c1b09-0119-459f-bec9-553fd142a02f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:59.158716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d48c1b09-0119-459f-bec9-553fd142a02f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:59.159520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d48c1b09-0119-459f-bec9-553fd142a02f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:39:59.159957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d48c1b09-0119-459f-bec9-553fd142a02f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:39:59.219682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d48c1b09-0119-459f-bec9-553fd142a02f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:39:59.228193 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d48c1b09-0119-459f-bec9-553fd142a02f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.082574 Nov 02 23:39:59.228749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2421/2996] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:39:59 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:00.245597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ca910b96-9c20-48c2-8dd4-306da00c491a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:00.246352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ca910b96-9c20-48c2-8dd4-306da00c491a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:00.252200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ca910b96-9c20-48c2-8dd4-306da00c491a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:00.252709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ca910b96-9c20-48c2-8dd4-306da00c491a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:00.253415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ca910b96-9c20-48c2-8dd4-306da00c491a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:00.253846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ca910b96-9c20-48c2-8dd4-306da00c491a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:00.313579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ca910b96-9c20-48c2-8dd4-306da00c491a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:00.322194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ca910b96-9c20-48c2-8dd4-306da00c491a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081019 Nov 02 23:40:00.322767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2422/2997] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:00 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:01.338619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-625ef803-1589-4086-8150-394b422da473 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:01.339339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-625ef803-1589-4086-8150-394b422da473 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:01.345377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-625ef803-1589-4086-8150-394b422da473 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:01.345816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-625ef803-1589-4086-8150-394b422da473 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:01.346561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-625ef803-1589-4086-8150-394b422da473 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:01.347012 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-625ef803-1589-4086-8150-394b422da473 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:01.405210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-625ef803-1589-4086-8150-394b422da473 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:01.412906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-625ef803-1589-4086-8150-394b422da473 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077907 Nov 02 23:40:01.413936 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2423/2998] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:01 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:02.430175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0d1ff73c-d428-41c7-8e19-3e7a1ccf4c85 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:02.430862 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0d1ff73c-d428-41c7-8e19-3e7a1ccf4c85 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:02.437299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d1ff73c-d428-41c7-8e19-3e7a1ccf4c85 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:02.437742 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d1ff73c-d428-41c7-8e19-3e7a1ccf4c85 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:02.438501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d1ff73c-d428-41c7-8e19-3e7a1ccf4c85 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:02.438952 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d1ff73c-d428-41c7-8e19-3e7a1ccf4c85 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:02.497583 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0d1ff73c-d428-41c7-8e19-3e7a1ccf4c85 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:02.505274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0d1ff73c-d428-41c7-8e19-3e7a1ccf4c85 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078702 Nov 02 23:40:02.505841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2424/2999] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:02 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:03.521883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a4f132fa-f94b-44fa-8ff3-7a60f6ba072c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:03.522590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a4f132fa-f94b-44fa-8ff3-7a60f6ba072c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:03.529319 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a4f132fa-f94b-44fa-8ff3-7a60f6ba072c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:03.529771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a4f132fa-f94b-44fa-8ff3-7a60f6ba072c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:03.530533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a4f132fa-f94b-44fa-8ff3-7a60f6ba072c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:03.531016 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a4f132fa-f94b-44fa-8ff3-7a60f6ba072c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:03.593324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a4f132fa-f94b-44fa-8ff3-7a60f6ba072c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:03.601217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a4f132fa-f94b-44fa-8ff3-7a60f6ba072c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.082918 Nov 02 23:40:03.601797 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2425/3000] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:03 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:04.617560 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d048be05-90f4-4570-b188-e92592407a3b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:04.618252 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d048be05-90f4-4570-b188-e92592407a3b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:04.624383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d048be05-90f4-4570-b188-e92592407a3b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:04.624824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d048be05-90f4-4570-b188-e92592407a3b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:04.625582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d048be05-90f4-4570-b188-e92592407a3b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:04.626012 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d048be05-90f4-4570-b188-e92592407a3b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:04.686270 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d048be05-90f4-4570-b188-e92592407a3b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:04.694058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d048be05-90f4-4570-b188-e92592407a3b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080176 Nov 02 23:40:04.694618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2426/3001] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:04 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:05.710524 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-caf6ca43-7637-4a8f-8f3f-9166eb8fbc5f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:05.711207 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-caf6ca43-7637-4a8f-8f3f-9166eb8fbc5f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:05.717250 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-caf6ca43-7637-4a8f-8f3f-9166eb8fbc5f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:05.717693 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-caf6ca43-7637-4a8f-8f3f-9166eb8fbc5f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:05.718444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-caf6ca43-7637-4a8f-8f3f-9166eb8fbc5f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:05.718877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-caf6ca43-7637-4a8f-8f3f-9166eb8fbc5f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:05.777781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-caf6ca43-7637-4a8f-8f3f-9166eb8fbc5f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:05.785521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-caf6ca43-7637-4a8f-8f3f-9166eb8fbc5f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078819 Nov 02 23:40:05.786068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2427/3002] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:05 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:06.802309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-026be799-5822-492c-a576-8ddeb832b099 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:06.803035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-026be799-5822-492c-a576-8ddeb832b099 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:06.809901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-026be799-5822-492c-a576-8ddeb832b099 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:06.810345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-026be799-5822-492c-a576-8ddeb832b099 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:06.811149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-026be799-5822-492c-a576-8ddeb832b099 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:06.811588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-026be799-5822-492c-a576-8ddeb832b099 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:06.870144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-026be799-5822-492c-a576-8ddeb832b099 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:06.877794 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-026be799-5822-492c-a576-8ddeb832b099 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079129 Nov 02 23:40:06.878357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2428/3003] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:06 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:07.894938 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ddc3b03b-6bdd-4bed-bf08-db7aae02f660 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:07.895631 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ddc3b03b-6bdd-4bed-bf08-db7aae02f660 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:07.902357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddc3b03b-6bdd-4bed-bf08-db7aae02f660 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:07.902800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddc3b03b-6bdd-4bed-bf08-db7aae02f660 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:07.903592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddc3b03b-6bdd-4bed-bf08-db7aae02f660 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:07.904017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ddc3b03b-6bdd-4bed-bf08-db7aae02f660 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:07.963381 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ddc3b03b-6bdd-4bed-bf08-db7aae02f660 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:07.971111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ddc3b03b-6bdd-4bed-bf08-db7aae02f660 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079793 Nov 02 23:40:07.971678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2429/3004] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:07 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:08.987547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2b8f6851-6a8a-4564-bb1a-68ebce0c10b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:08.988256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2b8f6851-6a8a-4564-bb1a-68ebce0c10b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:08.994447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b8f6851-6a8a-4564-bb1a-68ebce0c10b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:08.995056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b8f6851-6a8a-4564-bb1a-68ebce0c10b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:08.995732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b8f6851-6a8a-4564-bb1a-68ebce0c10b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:08.996167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2b8f6851-6a8a-4564-bb1a-68ebce0c10b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:09.055275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2b8f6851-6a8a-4564-bb1a-68ebce0c10b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:09.063194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2b8f6851-6a8a-4564-bb1a-68ebce0c10b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079314 Nov 02 23:40:09.063773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2430/3005] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:08 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:10.079631 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5878df95-b20d-45e4-b76b-74c2d7e812a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:10.080326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5878df95-b20d-45e4-b76b-74c2d7e812a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:10.087625 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5878df95-b20d-45e4-b76b-74c2d7e812a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:10.088070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5878df95-b20d-45e4-b76b-74c2d7e812a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:10.088840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5878df95-b20d-45e4-b76b-74c2d7e812a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:10.089273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5878df95-b20d-45e4-b76b-74c2d7e812a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:10.153931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5878df95-b20d-45e4-b76b-74c2d7e812a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:10.161557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5878df95-b20d-45e4-b76b-74c2d7e812a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.085608 Nov 02 23:40:10.162156 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2431/3006] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:10 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:11.177618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d0965709-9890-46a6-ad27-d23dbaadbc5d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:11.178316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d0965709-9890-46a6-ad27-d23dbaadbc5d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:11.184889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d0965709-9890-46a6-ad27-d23dbaadbc5d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:11.185332 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d0965709-9890-46a6-ad27-d23dbaadbc5d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:11.186103 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d0965709-9890-46a6-ad27-d23dbaadbc5d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:11.186534 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d0965709-9890-46a6-ad27-d23dbaadbc5d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:11.250014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d0965709-9890-46a6-ad27-d23dbaadbc5d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:11.260910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d0965709-9890-46a6-ad27-d23dbaadbc5d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.086900 Nov 02 23:40:11.261491 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2432/3007] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:11 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:12.277166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-836d42a1-265b-4847-85d9-39868a32302c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:12.278006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-836d42a1-265b-4847-85d9-39868a32302c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:12.284045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-836d42a1-265b-4847-85d9-39868a32302c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:12.284485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-836d42a1-265b-4847-85d9-39868a32302c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:12.285256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-836d42a1-265b-4847-85d9-39868a32302c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:12.285689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-836d42a1-265b-4847-85d9-39868a32302c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:12.344109 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-836d42a1-265b-4847-85d9-39868a32302c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:12.352349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-836d42a1-265b-4847-85d9-39868a32302c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078839 Nov 02 23:40:12.352915 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2433/3008] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:12 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:13.369294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9cf85c47-e0d0-4eca-b71a-80cc97861007 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:13.369979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9cf85c47-e0d0-4eca-b71a-80cc97861007 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:13.376080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9cf85c47-e0d0-4eca-b71a-80cc97861007 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:13.376525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9cf85c47-e0d0-4eca-b71a-80cc97861007 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:13.377291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9cf85c47-e0d0-4eca-b71a-80cc97861007 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:13.377724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9cf85c47-e0d0-4eca-b71a-80cc97861007 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:13.435714 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9cf85c47-e0d0-4eca-b71a-80cc97861007 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:13.443530 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9cf85c47-e0d0-4eca-b71a-80cc97861007 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078534 Nov 02 23:40:13.444138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2434/3009] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:13 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:14.460250 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b6310e0a-fcc4-467a-b462-28057d97eb88 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:14.460802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b6310e0a-fcc4-467a-b462-28057d97eb88 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:14.466872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6310e0a-fcc4-467a-b462-28057d97eb88 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:14.467341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6310e0a-fcc4-467a-b462-28057d97eb88 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:14.468094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6310e0a-fcc4-467a-b462-28057d97eb88 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:14.468520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b6310e0a-fcc4-467a-b462-28057d97eb88 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:14.525805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b6310e0a-fcc4-467a-b462-28057d97eb88 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:14.533284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b6310e0a-fcc4-467a-b462-28057d97eb88 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077167 Nov 02 23:40:14.533836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2435/3010] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:14 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:15.550190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-254ace34-503f-4b31-99fe-16e3f25b7c25 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:15.550869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-254ace34-503f-4b31-99fe-16e3f25b7c25 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:15.557201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-254ace34-503f-4b31-99fe-16e3f25b7c25 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:15.557905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-254ace34-503f-4b31-99fe-16e3f25b7c25 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:15.558675 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-254ace34-503f-4b31-99fe-16e3f25b7c25 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:15.559210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-254ace34-503f-4b31-99fe-16e3f25b7c25 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:15.618280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-254ace34-503f-4b31-99fe-16e3f25b7c25 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:15.625938 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-254ace34-503f-4b31-99fe-16e3f25b7c25 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079717 Nov 02 23:40:15.626498 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2436/3011] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:15 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:16.642115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4d7cdf85-26a1-4298-ab08-a547fd3e1110 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:16.642828 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4d7cdf85-26a1-4298-ab08-a547fd3e1110 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:16.649532 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d7cdf85-26a1-4298-ab08-a547fd3e1110 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:16.649968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d7cdf85-26a1-4298-ab08-a547fd3e1110 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:16.650719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d7cdf85-26a1-4298-ab08-a547fd3e1110 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:16.651174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d7cdf85-26a1-4298-ab08-a547fd3e1110 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:16.712137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4d7cdf85-26a1-4298-ab08-a547fd3e1110 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:16.719799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4d7cdf85-26a1-4298-ab08-a547fd3e1110 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081291 Nov 02 23:40:16.720364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2437/3012] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:16 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:17.736516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-45b9d2cb-6086-4a1f-a069-349dcf7f43e8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:17.737184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-45b9d2cb-6086-4a1f-a069-349dcf7f43e8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:17.744161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45b9d2cb-6086-4a1f-a069-349dcf7f43e8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:17.744598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45b9d2cb-6086-4a1f-a069-349dcf7f43e8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:17.745358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45b9d2cb-6086-4a1f-a069-349dcf7f43e8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:17.745781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-45b9d2cb-6086-4a1f-a069-349dcf7f43e8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:17.804508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-45b9d2cb-6086-4a1f-a069-349dcf7f43e8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:17.812465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-45b9d2cb-6086-4a1f-a069-349dcf7f43e8 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079834 Nov 02 23:40:17.813027 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2438/3013] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:17 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:18.828265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-91ad6e3c-88a6-4644-9761-4459569a8554 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:18.828992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-91ad6e3c-88a6-4644-9761-4459569a8554 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:18.835205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-91ad6e3c-88a6-4644-9761-4459569a8554 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:18.835653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-91ad6e3c-88a6-4644-9761-4459569a8554 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:18.836454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-91ad6e3c-88a6-4644-9761-4459569a8554 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:18.836891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-91ad6e3c-88a6-4644-9761-4459569a8554 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:18.896112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-91ad6e3c-88a6-4644-9761-4459569a8554 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:18.904063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-91ad6e3c-88a6-4644-9761-4459569a8554 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079462 Nov 02 23:40:18.904638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2439/3014] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:18 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:19.920861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-158c9fa1-e799-412d-a68e-5d8375d58c4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:19.921590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-158c9fa1-e799-412d-a68e-5d8375d58c4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:19.927601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-158c9fa1-e799-412d-a68e-5d8375d58c4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:19.928038 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-158c9fa1-e799-412d-a68e-5d8375d58c4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:19.928789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-158c9fa1-e799-412d-a68e-5d8375d58c4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:19.929217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-158c9fa1-e799-412d-a68e-5d8375d58c4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:19.987199 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-158c9fa1-e799-412d-a68e-5d8375d58c4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:19.994831 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-158c9fa1-e799-412d-a68e-5d8375d58c4f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077612 Nov 02 23:40:19.995420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2440/3015] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:19 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:40:21.012418 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3e1ec1be-970a-4b5f-ab89-38067d3eebd5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:21.013107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3e1ec1be-970a-4b5f-ab89-38067d3eebd5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:21.018990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e1ec1be-970a-4b5f-ab89-38067d3eebd5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:21.019441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e1ec1be-970a-4b5f-ab89-38067d3eebd5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:21.020200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e1ec1be-970a-4b5f-ab89-38067d3eebd5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:21.020631 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e1ec1be-970a-4b5f-ab89-38067d3eebd5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:21.080615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3e1ec1be-970a-4b5f-ab89-38067d3eebd5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:21.088236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3e1ec1be-970a-4b5f-ab89-38067d3eebd5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080012 Nov 02 23:40:21.088792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2441/3016] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:21 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:22.104697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b18e7051-26ad-410f-8ce2-dd2baf3f6c94 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:22.105395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b18e7051-26ad-410f-8ce2-dd2baf3f6c94 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:22.111511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b18e7051-26ad-410f-8ce2-dd2baf3f6c94 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:22.111949 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b18e7051-26ad-410f-8ce2-dd2baf3f6c94 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:22.112697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b18e7051-26ad-410f-8ce2-dd2baf3f6c94 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:22.113128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b18e7051-26ad-410f-8ce2-dd2baf3f6c94 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:22.171355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b18e7051-26ad-410f-8ce2-dd2baf3f6c94 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:22.179264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b18e7051-26ad-410f-8ce2-dd2baf3f6c94 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078152 Nov 02 23:40:22.179842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2442/3017] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:22 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:23.196022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aa94f8b3-b807-4b66-aab7-d9b35baefb5d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:23.196749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aa94f8b3-b807-4b66-aab7-d9b35baefb5d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:23.203059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa94f8b3-b807-4b66-aab7-d9b35baefb5d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:23.203513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa94f8b3-b807-4b66-aab7-d9b35baefb5d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:23.204300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa94f8b3-b807-4b66-aab7-d9b35baefb5d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:23.204765 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aa94f8b3-b807-4b66-aab7-d9b35baefb5d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:23.269002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aa94f8b3-b807-4b66-aab7-d9b35baefb5d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:23.277326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aa94f8b3-b807-4b66-aab7-d9b35baefb5d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.084965 Nov 02 23:40:23.277892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2443/3018] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:23 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:24.293646 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a81b91c5-07c6-4208-a356-89cd9a95507f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:24.294339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a81b91c5-07c6-4208-a356-89cd9a95507f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:24.300515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a81b91c5-07c6-4208-a356-89cd9a95507f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:24.300965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a81b91c5-07c6-4208-a356-89cd9a95507f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:24.301728 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a81b91c5-07c6-4208-a356-89cd9a95507f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:24.302160 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a81b91c5-07c6-4208-a356-89cd9a95507f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:24.360839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a81b91c5-07c6-4208-a356-89cd9a95507f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:24.369057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a81b91c5-07c6-4208-a356-89cd9a95507f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079145 Nov 02 23:40:24.369630 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2444/3019] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:24 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:25.385957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6bf71bb2-2a38-4e2b-810b-f39bbe28183b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:25.386682 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6bf71bb2-2a38-4e2b-810b-f39bbe28183b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:25.392907 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6bf71bb2-2a38-4e2b-810b-f39bbe28183b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:25.393354 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6bf71bb2-2a38-4e2b-810b-f39bbe28183b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:25.394122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6bf71bb2-2a38-4e2b-810b-f39bbe28183b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:25.394552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6bf71bb2-2a38-4e2b-810b-f39bbe28183b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:25.454882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6bf71bb2-2a38-4e2b-810b-f39bbe28183b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:25.462768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6bf71bb2-2a38-4e2b-810b-f39bbe28183b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080918 Nov 02 23:40:25.463311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2445/3020] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:25 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:26.479520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-966f148e-3d89-4018-b60d-1cc5df455991 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:26.480185 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-966f148e-3d89-4018-b60d-1cc5df455991 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:26.486331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-966f148e-3d89-4018-b60d-1cc5df455991 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:26.486771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-966f148e-3d89-4018-b60d-1cc5df455991 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:26.487571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-966f148e-3d89-4018-b60d-1cc5df455991 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:26.487990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-966f148e-3d89-4018-b60d-1cc5df455991 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:26.547371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-966f148e-3d89-4018-b60d-1cc5df455991 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:26.555702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-966f148e-3d89-4018-b60d-1cc5df455991 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080429 Nov 02 23:40:26.556502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2446/3021] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:26 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:27.571781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-735bef76-1546-4b68-b626-6da35e296971 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:27.572497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-735bef76-1546-4b68-b626-6da35e296971 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:27.578598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-735bef76-1546-4b68-b626-6da35e296971 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:27.579075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-735bef76-1546-4b68-b626-6da35e296971 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:27.579841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-735bef76-1546-4b68-b626-6da35e296971 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:27.580271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-735bef76-1546-4b68-b626-6da35e296971 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:27.641300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-735bef76-1546-4b68-b626-6da35e296971 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:27.649067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-735bef76-1546-4b68-b626-6da35e296971 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080920 Nov 02 23:40:27.649628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2447/3022] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:27 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:28.665413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c7c41bdb-a11e-424e-80f7-df271ee87ebd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:28.666178 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c7c41bdb-a11e-424e-80f7-df271ee87ebd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:28.672246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7c41bdb-a11e-424e-80f7-df271ee87ebd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:28.672702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7c41bdb-a11e-424e-80f7-df271ee87ebd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:28.673466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7c41bdb-a11e-424e-80f7-df271ee87ebd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:28.673899 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c7c41bdb-a11e-424e-80f7-df271ee87ebd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:28.732221 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c7c41bdb-a11e-424e-80f7-df271ee87ebd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:28.740002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c7c41bdb-a11e-424e-80f7-df271ee87ebd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078214 Nov 02 23:40:28.740581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2448/3023] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:28 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:29.757086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5fe22dde-4585-48c7-b3c0-6cc0666593f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:29.758279 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5fe22dde-4585-48c7-b3c0-6cc0666593f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:29.764918 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5fe22dde-4585-48c7-b3c0-6cc0666593f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:29.765369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5fe22dde-4585-48c7-b3c0-6cc0666593f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:29.766132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5fe22dde-4585-48c7-b3c0-6cc0666593f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:29.766563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5fe22dde-4585-48c7-b3c0-6cc0666593f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:29.827443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5fe22dde-4585-48c7-b3c0-6cc0666593f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:29.835098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5fe22dde-4585-48c7-b3c0-6cc0666593f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081640 Nov 02 23:40:29.836341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2449/3024] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:29 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:30.852277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9c4475ac-0311-483f-9f73-677b523b48f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:30.852978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9c4475ac-0311-483f-9f73-677b523b48f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:30.859102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c4475ac-0311-483f-9f73-677b523b48f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:30.859547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c4475ac-0311-483f-9f73-677b523b48f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:30.860303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c4475ac-0311-483f-9f73-677b523b48f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:30.860733 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9c4475ac-0311-483f-9f73-677b523b48f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:30.918765 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9c4475ac-0311-483f-9f73-677b523b48f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:30.926343 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9c4475ac-0311-483f-9f73-677b523b48f0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077778 Nov 02 23:40:30.926906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2450/3025] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:30 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:31.943585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-362bf1c0-ae3e-474c-ba4b-52f1a47dde91 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:31.944289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-362bf1c0-ae3e-474c-ba4b-52f1a47dde91 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:31.950874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-362bf1c0-ae3e-474c-ba4b-52f1a47dde91 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:31.951357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-362bf1c0-ae3e-474c-ba4b-52f1a47dde91 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:31.952120 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-362bf1c0-ae3e-474c-ba4b-52f1a47dde91 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:31.952556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-362bf1c0-ae3e-474c-ba4b-52f1a47dde91 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:32.011906 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-362bf1c0-ae3e-474c-ba4b-52f1a47dde91 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:32.019697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-362bf1c0-ae3e-474c-ba4b-52f1a47dde91 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079752 Nov 02 23:40:32.020297 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2451/3026] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:31 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:33.037292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3e96cd4a-c5ba-4bde-bd96-670f5c73754f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:33.037980 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3e96cd4a-c5ba-4bde-bd96-670f5c73754f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:33.044668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e96cd4a-c5ba-4bde-bd96-670f5c73754f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:33.045108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e96cd4a-c5ba-4bde-bd96-670f5c73754f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:33.045864 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e96cd4a-c5ba-4bde-bd96-670f5c73754f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:33.046289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e96cd4a-c5ba-4bde-bd96-670f5c73754f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:33.105011 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3e96cd4a-c5ba-4bde-bd96-670f5c73754f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:33.112643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3e96cd4a-c5ba-4bde-bd96-670f5c73754f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079104 Nov 02 23:40:33.113206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2452/3027] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:33 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:34.129069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0d4377e9-bf81-42c1-8a1d-f5d58c85afd3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:34.129782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0d4377e9-bf81-42c1-8a1d-f5d58c85afd3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:34.136025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d4377e9-bf81-42c1-8a1d-f5d58c85afd3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:34.136474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d4377e9-bf81-42c1-8a1d-f5d58c85afd3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:34.137268 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d4377e9-bf81-42c1-8a1d-f5d58c85afd3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:34.137698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d4377e9-bf81-42c1-8a1d-f5d58c85afd3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:34.196567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0d4377e9-bf81-42c1-8a1d-f5d58c85afd3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:34.204241 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0d4377e9-bf81-42c1-8a1d-f5d58c85afd3 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078804 Nov 02 23:40:34.204861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2453/3028] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:34 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:35.220762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-58b79889-64cb-48b6-923c-3d85be629270 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:35.221393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-58b79889-64cb-48b6-923c-3d85be629270 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:35.228353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58b79889-64cb-48b6-923c-3d85be629270 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:35.228806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58b79889-64cb-48b6-923c-3d85be629270 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:35.229570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58b79889-64cb-48b6-923c-3d85be629270 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:35.230004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-58b79889-64cb-48b6-923c-3d85be629270 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:35.288060 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-58b79889-64cb-48b6-923c-3d85be629270 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:35.296378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-58b79889-64cb-48b6-923c-3d85be629270 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079236 Nov 02 23:40:35.296944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2454/3029] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:35 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:36.312877 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8bfc873b-4866-4232-961a-1f5658dbec9a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:36.313567 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8bfc873b-4866-4232-961a-1f5658dbec9a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:36.319913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bfc873b-4866-4232-961a-1f5658dbec9a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:36.320359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bfc873b-4866-4232-961a-1f5658dbec9a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:36.321109 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bfc873b-4866-4232-961a-1f5658dbec9a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:36.321534 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bfc873b-4866-4232-961a-1f5658dbec9a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:36.616688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8bfc873b-4866-4232-961a-1f5658dbec9a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:36.624794 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8bfc873b-4866-4232-961a-1f5658dbec9a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.315534 Nov 02 23:40:36.625362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2455/3030] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:36 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:36.830763 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:40:36.831055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:40:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 23:40:37.641322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1fb92afb-d550-4217-9825-c566d038fa8e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:37.641927 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1fb92afb-d550-4217-9825-c566d038fa8e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:37.650482 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fb92afb-d550-4217-9825-c566d038fa8e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:37.650941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fb92afb-d550-4217-9825-c566d038fa8e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:37.651715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fb92afb-d550-4217-9825-c566d038fa8e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:37.652143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1fb92afb-d550-4217-9825-c566d038fa8e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:37.711926 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1fb92afb-d550-4217-9825-c566d038fa8e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:37.719863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1fb92afb-d550-4217-9825-c566d038fa8e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.082096 Nov 02 23:40:37.720432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2456/3031] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:37 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:37.726158 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:40:37.726363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:40:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 23:40:38.736324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-42dbc3be-5561-4166-ae8b-1837691350cd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:38.737081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-42dbc3be-5561-4166-ae8b-1837691350cd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:38.743246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42dbc3be-5561-4166-ae8b-1837691350cd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:38.743691 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42dbc3be-5561-4166-ae8b-1837691350cd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:38.744469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42dbc3be-5561-4166-ae8b-1837691350cd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:38.744898 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-42dbc3be-5561-4166-ae8b-1837691350cd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:38.804398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-42dbc3be-5561-4166-ae8b-1837691350cd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:38.812355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-42dbc3be-5561-4166-ae8b-1837691350cd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079759 Nov 02 23:40:38.812920 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2457/3032] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:38 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:39.830173 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-485981d0-d098-46f9-b82f-5745ab1528fe tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:39.830896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-485981d0-d098-46f9-b82f-5745ab1528fe tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:39.837718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-485981d0-d098-46f9-b82f-5745ab1528fe tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:39.838144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-485981d0-d098-46f9-b82f-5745ab1528fe tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:39.838900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-485981d0-d098-46f9-b82f-5745ab1528fe tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:39.839353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-485981d0-d098-46f9-b82f-5745ab1528fe tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:39.896803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-485981d0-d098-46f9-b82f-5745ab1528fe tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:39.904824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-485981d0-d098-46f9-b82f-5745ab1528fe tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078373 Nov 02 23:40:39.905383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2458/3033] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:39 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:40.921277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1d48e863-7088-41ee-809a-002c1bf45d22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:40.921963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1d48e863-7088-41ee-809a-002c1bf45d22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:40.928152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d48e863-7088-41ee-809a-002c1bf45d22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:40.928593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d48e863-7088-41ee-809a-002c1bf45d22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:40.929347 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d48e863-7088-41ee-809a-002c1bf45d22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:40.929771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d48e863-7088-41ee-809a-002c1bf45d22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:40.989784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1d48e863-7088-41ee-809a-002c1bf45d22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:40.997378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1d48e863-7088-41ee-809a-002c1bf45d22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079707 Nov 02 23:40:40.997941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2459/3034] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:40 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:42.013794 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8dfccc6a-1008-47f4-8588-8840b7ee7b27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:42.014487 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8dfccc6a-1008-47f4-8588-8840b7ee7b27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:42.020772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8dfccc6a-1008-47f4-8588-8840b7ee7b27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:42.021221 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8dfccc6a-1008-47f4-8588-8840b7ee7b27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:42.021984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8dfccc6a-1008-47f4-8588-8840b7ee7b27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:42.022413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8dfccc6a-1008-47f4-8588-8840b7ee7b27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:42.083078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8dfccc6a-1008-47f4-8588-8840b7ee7b27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:42.091191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8dfccc6a-1008-47f4-8588-8840b7ee7b27 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081042 Nov 02 23:40:42.091759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2460/3035] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:42 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:43.107655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a593e492-8dbe-4644-ba78-71b1e8004890 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:43.108353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a593e492-8dbe-4644-ba78-71b1e8004890 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:43.114610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a593e492-8dbe-4644-ba78-71b1e8004890 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:43.115101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a593e492-8dbe-4644-ba78-71b1e8004890 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:43.115872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a593e492-8dbe-4644-ba78-71b1e8004890 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:43.116307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a593e492-8dbe-4644-ba78-71b1e8004890 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:43.173924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a593e492-8dbe-4644-ba78-71b1e8004890 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:43.182340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a593e492-8dbe-4644-ba78-71b1e8004890 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078080 Nov 02 23:40:43.182908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2461/3036] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:43 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:44.199155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-db88fd39-f00b-4288-bda5-0bfa1527fb9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:44.199874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-db88fd39-f00b-4288-bda5-0bfa1527fb9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:44.205852 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db88fd39-f00b-4288-bda5-0bfa1527fb9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:44.206292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db88fd39-f00b-4288-bda5-0bfa1527fb9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:44.207079 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db88fd39-f00b-4288-bda5-0bfa1527fb9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:44.207508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db88fd39-f00b-4288-bda5-0bfa1527fb9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:44.265985 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-db88fd39-f00b-4288-bda5-0bfa1527fb9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:44.273524 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-db88fd39-f00b-4288-bda5-0bfa1527fb9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078580 Nov 02 23:40:44.274074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2462/3037] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:44 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:45.290136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-93b6e7cb-eadc-4e93-b26a-d153fcf40547 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:45.290765 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-93b6e7cb-eadc-4e93-b26a-d153fcf40547 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:45.296626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93b6e7cb-eadc-4e93-b26a-d153fcf40547 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:45.297066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93b6e7cb-eadc-4e93-b26a-d153fcf40547 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:45.297824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93b6e7cb-eadc-4e93-b26a-d153fcf40547 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:45.298254 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-93b6e7cb-eadc-4e93-b26a-d153fcf40547 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:45.358096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-93b6e7cb-eadc-4e93-b26a-d153fcf40547 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:45.365731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-93b6e7cb-eadc-4e93-b26a-d153fcf40547 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080327 Nov 02 23:40:45.366351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2463/3038] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:45 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:46.381709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-15b577cc-3134-4f20-a999-64364e8099cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:46.382414 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-15b577cc-3134-4f20-a999-64364e8099cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:46.388502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15b577cc-3134-4f20-a999-64364e8099cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:46.388944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15b577cc-3134-4f20-a999-64364e8099cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:46.389701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15b577cc-3134-4f20-a999-64364e8099cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:46.390137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15b577cc-3134-4f20-a999-64364e8099cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:46.448203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-15b577cc-3134-4f20-a999-64364e8099cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:46.455738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-15b577cc-3134-4f20-a999-64364e8099cc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077655 Nov 02 23:40:46.456302 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2464/3039] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:46 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:47.472571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b3cfaebc-47df-42ab-87a2-d9c44a97db14 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:47.473175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b3cfaebc-47df-42ab-87a2-d9c44a97db14 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:47.480091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3cfaebc-47df-42ab-87a2-d9c44a97db14 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:47.480535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3cfaebc-47df-42ab-87a2-d9c44a97db14 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:47.481289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3cfaebc-47df-42ab-87a2-d9c44a97db14 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:47.481725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3cfaebc-47df-42ab-87a2-d9c44a97db14 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:47.542924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b3cfaebc-47df-42ab-87a2-d9c44a97db14 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:47.550588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b3cfaebc-47df-42ab-87a2-d9c44a97db14 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081624 Nov 02 23:40:47.551175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2465/3040] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:47 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:48.567449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-294d9b89-3024-407a-bb07-659bc50dad5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:48.568131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-294d9b89-3024-407a-bb07-659bc50dad5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:48.574782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-294d9b89-3024-407a-bb07-659bc50dad5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:48.575256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-294d9b89-3024-407a-bb07-659bc50dad5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:48.576009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-294d9b89-3024-407a-bb07-659bc50dad5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:48.576431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-294d9b89-3024-407a-bb07-659bc50dad5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:48.635243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-294d9b89-3024-407a-bb07-659bc50dad5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:48.642886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-294d9b89-3024-407a-bb07-659bc50dad5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079097 Nov 02 23:40:48.643474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2466/3041] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:48 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:49.660147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bc22de76-c185-4527-a009-6b6dfd0e2236 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:49.660880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bc22de76-c185-4527-a009-6b6dfd0e2236 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:49.667725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc22de76-c185-4527-a009-6b6dfd0e2236 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:49.668171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc22de76-c185-4527-a009-6b6dfd0e2236 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:49.668941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc22de76-c185-4527-a009-6b6dfd0e2236 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:49.669374 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc22de76-c185-4527-a009-6b6dfd0e2236 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:49.728041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bc22de76-c185-4527-a009-6b6dfd0e2236 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:49.735589 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bc22de76-c185-4527-a009-6b6dfd0e2236 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079256 Nov 02 23:40:49.736147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2467/3042] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:49 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:50.752020 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bb0c07e4-2b00-4838-8eab-d6ce4064ee13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:50.752718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bb0c07e4-2b00-4838-8eab-d6ce4064ee13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:50.759053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bb0c07e4-2b00-4838-8eab-d6ce4064ee13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:50.759496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bb0c07e4-2b00-4838-8eab-d6ce4064ee13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:50.760250 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bb0c07e4-2b00-4838-8eab-d6ce4064ee13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:50.760675 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bb0c07e4-2b00-4838-8eab-d6ce4064ee13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:50.821248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bb0c07e4-2b00-4838-8eab-d6ce4064ee13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:50.828889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bb0c07e4-2b00-4838-8eab-d6ce4064ee13 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080511 Nov 02 23:40:50.829455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2468/3043] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:50 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:51.010307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1c90488e-a8c2-4db0-960d-89843198412d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:51.010836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1c90488e-a8c2-4db0-960d-89843198412d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:51.016754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c90488e-a8c2-4db0-960d-89843198412d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:51.017280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c90488e-a8c2-4db0-960d-89843198412d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:51.018120 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c90488e-a8c2-4db0-960d-89843198412d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:51.018635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1c90488e-a8c2-4db0-960d-89843198412d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:51.043273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1c90488e-a8c2-4db0-960d-89843198412d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Going to try to terminate instance {{(pid=115800) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 23:40:51.101781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1c90488e-a8c2-4db0-960d-89843198412d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [92d77ebe-2bd0-494f-9195-488220280c14] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 23:40:52.118109 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [None req-1c90488e-a8c2-4db0-960d-89843198412d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [92d77ebe-2bd0-494f-9195-488220280c14] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 53500. Nov 02 23:40:52.137566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1c90488e-a8c2-4db0-960d-89843198412d tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f" status: 204 len: 0 microversion: 2.20 time: 1.131493 Nov 02 23:40:52.138361 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2469/3044] 10.222.0.41 () {60 vars in 1279 bytes} [Tue Nov 2 23:40:51 2021] DELETE /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f => generated 0 bytes in 1133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 23:40:52.142958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9e177d39-28d2-4372-86d4-d58f12eaeae7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:52.143653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9e177d39-28d2-4372-86d4-d58f12eaeae7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:52.150225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e177d39-28d2-4372-86d4-d58f12eaeae7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:52.150665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e177d39-28d2-4372-86d4-d58f12eaeae7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:52.151628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e177d39-28d2-4372-86d4-d58f12eaeae7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:52.152070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9e177d39-28d2-4372-86d4-d58f12eaeae7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:52.213165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9e177d39-28d2-4372-86d4-d58f12eaeae7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:52.220983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9e177d39-28d2-4372-86d4-d58f12eaeae7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081733 Nov 02 23:40:52.221600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2470/3045] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:52 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:40:52.226301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cd2dfd4e-7833-4390-ab79-a7a864be094c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:52.226894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cd2dfd4e-7833-4390-ab79-a7a864be094c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:52.232694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd2dfd4e-7833-4390-ab79-a7a864be094c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:52.233147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd2dfd4e-7833-4390-ab79-a7a864be094c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:52.233918 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd2dfd4e-7833-4390-ab79-a7a864be094c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:52.234351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd2dfd4e-7833-4390-ab79-a7a864be094c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:52.365518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cd2dfd4e-7833-4390-ab79-a7a864be094c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:52.373796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cd2dfd4e-7833-4390-ab79-a7a864be094c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:52.375228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cd2dfd4e-7833-4390-ab79-a7a864be094c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:52.376355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cd2dfd4e-7833-4390-ab79-a7a864be094c tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f" status: 200 len: 1723 microversion: 2.20 time: 0.153905 Nov 02 23:40:52.376905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2471/3046] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:40:52 2021] GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 23:40:53.237971 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4b1c9075-2c22-4a96-b1f5-a2604da9b97b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:53.238653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4b1c9075-2c22-4a96-b1f5-a2604da9b97b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:53.245689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b1c9075-2c22-4a96-b1f5-a2604da9b97b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:53.246268 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b1c9075-2c22-4a96-b1f5-a2604da9b97b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:53.247068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b1c9075-2c22-4a96-b1f5-a2604da9b97b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:53.247502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b1c9075-2c22-4a96-b1f5-a2604da9b97b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:53.314282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4b1c9075-2c22-4a96-b1f5-a2604da9b97b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:53.322867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4b1c9075-2c22-4a96-b1f5-a2604da9b97b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.088465 Nov 02 23:40:53.323690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2472/3047] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:53 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:40:53.395083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-85294bcb-f3b6-4996-b444-2eb6a4b9f2af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:53.395776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-85294bcb-f3b6-4996-b444-2eb6a4b9f2af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:53.401751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85294bcb-f3b6-4996-b444-2eb6a4b9f2af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:53.402279 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85294bcb-f3b6-4996-b444-2eb6a4b9f2af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:53.403145 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85294bcb-f3b6-4996-b444-2eb6a4b9f2af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:53.403554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85294bcb-f3b6-4996-b444-2eb6a4b9f2af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:53.534282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-85294bcb-f3b6-4996-b444-2eb6a4b9f2af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:53.542555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-85294bcb-f3b6-4996-b444-2eb6a4b9f2af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:53.544093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-85294bcb-f3b6-4996-b444-2eb6a4b9f2af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:53.545230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-85294bcb-f3b6-4996-b444-2eb6a4b9f2af tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f" status: 200 len: 1723 microversion: 2.20 time: 0.153948 Nov 02 23:40:53.545792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2473/3048] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:40:53 2021] GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:40:54.072456 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-bbded61b-17c5-487f-88c5-f14fd65d13fc req-e1febdab-6b64-44df-87d1-37da3a1a5e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef96c6ca-e054-45d7-b346-b5af72ea945f", "name": "network-vif-deleted", "tag": "ee913c35-64a5-482c-a3a7-9a8299f45bd3"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:40:54.074249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:40:54.074249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:40:54.081788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-bbded61b-17c5-487f-88c5-f14fd65d13fc req-e1febdab-6b64-44df-87d1-37da3a1a5e1b service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:54.082256 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-bbded61b-17c5-487f-88c5-f14fd65d13fc req-e1febdab-6b64-44df-87d1-37da3a1a5e1b service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:54.093818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-bbded61b-17c5-487f-88c5-f14fd65d13fc req-e1febdab-6b64-44df-87d1-37da3a1a5e1b service nova] Creating event network-vif-deleted:ee913c35-64a5-482c-a3a7-9a8299f45bd3 for instance ef96c6ca-e054-45d7-b346-b5af72ea945f on hv-cinder-81584 Nov 02 23:40:54.098763 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-bbded61b-17c5-487f-88c5-f14fd65d13fc req-e1febdab-6b64-44df-87d1-37da3a1a5e1b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030097 Nov 02 23:40:54.099419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2474/3049] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:40:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:40:54.340189 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-94bf17ab-f5c1-47d7-8c72-f99c966a30e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:54.340891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-94bf17ab-f5c1-47d7-8c72-f99c966a30e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:54.347057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94bf17ab-f5c1-47d7-8c72-f99c966a30e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:54.347513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94bf17ab-f5c1-47d7-8c72-f99c966a30e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:54.348293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94bf17ab-f5c1-47d7-8c72-f99c966a30e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:54.348726 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-94bf17ab-f5c1-47d7-8c72-f99c966a30e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:54.411343 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-94bf17ab-f5c1-47d7-8c72-f99c966a30e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:54.419594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-94bf17ab-f5c1-47d7-8c72-f99c966a30e7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.083871 Nov 02 23:40:54.420194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2475/3050] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:54 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:54.563410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-beb43c64-c7db-4a6d-a96a-5c85c4702aa2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:54.564262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-beb43c64-c7db-4a6d-a96a-5c85c4702aa2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:54.571535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-beb43c64-c7db-4a6d-a96a-5c85c4702aa2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:54.572068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-beb43c64-c7db-4a6d-a96a-5c85c4702aa2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:54.572931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-beb43c64-c7db-4a6d-a96a-5c85c4702aa2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:54.573431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-beb43c64-c7db-4a6d-a96a-5c85c4702aa2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:54.606145 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-beb43c64-c7db-4a6d-a96a-5c85c4702aa2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:54.606809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-beb43c64-c7db-4a6d-a96a-5c85c4702aa2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:54.607370 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.objects.instance [None req-beb43c64-c7db-4a6d-a96a-5c85c4702aa2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lazy-loading 'fault' on Instance uuid ef96c6ca-e054-45d7-b346-b5af72ea945f {{(pid=115800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 23:40:54.663022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-beb43c64-c7db-4a6d-a96a-5c85c4702aa2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:54.674061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-beb43c64-c7db-4a6d-a96a-5c85c4702aa2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:54.675669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-beb43c64-c7db-4a6d-a96a-5c85c4702aa2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c145054a2644e17b76cb2b67dcbd57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ef936bc64892a3d3ff11413f78b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:54.676901 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-beb43c64-c7db-4a6d-a96a-5c85c4702aa2 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f" status: 200 len: 1372 microversion: 2.20 time: 0.117695 Nov 02 23:40:54.677563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2476/3051] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:40:54 2021] GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f => generated 1372 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 23:40:55.436353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9f9ef325-4650-4388-9f3d-cfaf2c9b218d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:55.437032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9f9ef325-4650-4388-9f3d-cfaf2c9b218d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:55.445161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f9ef325-4650-4388-9f3d-cfaf2c9b218d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:55.445690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f9ef325-4650-4388-9f3d-cfaf2c9b218d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:55.446450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f9ef325-4650-4388-9f3d-cfaf2c9b218d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:55.446875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9f9ef325-4650-4388-9f3d-cfaf2c9b218d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:55.506517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9f9ef325-4650-4388-9f3d-cfaf2c9b218d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:55.514891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9f9ef325-4650-4388-9f3d-cfaf2c9b218d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.082546 Nov 02 23:40:55.515476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2477/3052] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:55 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:55.696923 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b24b23aa-075a-4c48-b83f-ed212f713701 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:55.697643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b24b23aa-075a-4c48-b83f-ed212f713701 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:55.703415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b24b23aa-075a-4c48-b83f-ed212f713701 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:55.703864 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b24b23aa-075a-4c48-b83f-ed212f713701 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:55.704626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b24b23aa-075a-4c48-b83f-ed212f713701 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:55.705055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b24b23aa-075a-4c48-b83f-ed212f713701 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:55.718250 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-b24b23aa-075a-4c48-b83f-ed212f713701 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] HTTP exception thrown: Instance ef96c6ca-e054-45d7-b346-b5af72ea945f could not be found. Nov 02 23:40:55.718813 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b24b23aa-075a-4c48-b83f-ed212f713701 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Returning 404 to user: Instance ef96c6ca-e054-45d7-b346-b5af72ea945f could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:40:55.719659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b24b23aa-075a-4c48-b83f-ed212f713701 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f" status: 404 len: 111 microversion: 2.20 time: 0.027002 Nov 02 23:40:55.720245 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2478/3053] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 2 23:40:55 2021] GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 23:40:55.728162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-239cccdf-4e30-4a46-8a57-92e555c50791 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '.version_select at 0x7fd85c806790>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:55.749401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-239cccdf-4e30-4a46-8a57-92e555c50791 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1684113584" status: 204 len: 0 microversion: 2.20 time: 0.024657 Nov 02 23:40:55.749982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2479/3054] 10.222.0.41 () {60 vars in 1261 bytes} [Tue Nov 2 23:40:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1684113584 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 23:40:56.531219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3514f39f-1100-4a41-b6e6-468741b36316 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:56.531849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3514f39f-1100-4a41-b6e6-468741b36316 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:56.537949 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3514f39f-1100-4a41-b6e6-468741b36316 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:56.539246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3514f39f-1100-4a41-b6e6-468741b36316 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:56.540032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3514f39f-1100-4a41-b6e6-468741b36316 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:56.540212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3514f39f-1100-4a41-b6e6-468741b36316 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:56.600327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3514f39f-1100-4a41-b6e6-468741b36316 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:56.608000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3514f39f-1100-4a41-b6e6-468741b36316 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080408 Nov 02 23:40:56.608747 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2480/3055] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:56 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:57.624486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-85bc3412-2024-4775-9da0-1c729df79296 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:57.625090 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-85bc3412-2024-4775-9da0-1c729df79296 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:57.631334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85bc3412-2024-4775-9da0-1c729df79296 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:57.632280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85bc3412-2024-4775-9da0-1c729df79296 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:57.633043 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85bc3412-2024-4775-9da0-1c729df79296 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:57.633474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-85bc3412-2024-4775-9da0-1c729df79296 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:57.697414 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-85bc3412-2024-4775-9da0-1c729df79296 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:57.706297 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-85bc3412-2024-4775-9da0-1c729df79296 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.085609 Nov 02 23:40:57.706880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2481/3056] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:57 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:58.723344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-933da14f-2b62-4593-8534-76b779eb8cdd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:58.724037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-933da14f-2b62-4593-8534-76b779eb8cdd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:58.730771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-933da14f-2b62-4593-8534-76b779eb8cdd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:58.731253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-933da14f-2b62-4593-8534-76b779eb8cdd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:58.732026 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-933da14f-2b62-4593-8534-76b779eb8cdd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:58.732463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-933da14f-2b62-4593-8534-76b779eb8cdd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:58.791131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-933da14f-2b62-4593-8534-76b779eb8cdd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:58.798788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-933da14f-2b62-4593-8534-76b779eb8cdd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079163 Nov 02 23:40:58.799392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2482/3057] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:58 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:40:59.815731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-08481951-3077-42a2-a7e3-b86cfc87f536 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:40:59.816461 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-08481951-3077-42a2-a7e3-b86cfc87f536 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:40:59.823094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08481951-3077-42a2-a7e3-b86cfc87f536 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:59.823545 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08481951-3077-42a2-a7e3-b86cfc87f536 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:59.824311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08481951-3077-42a2-a7e3-b86cfc87f536 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:40:59.824776 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08481951-3077-42a2-a7e3-b86cfc87f536 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:40:59.883000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-08481951-3077-42a2-a7e3-b86cfc87f536 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:40:59.890581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-08481951-3077-42a2-a7e3-b86cfc87f536 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078677 Nov 02 23:40:59.891175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2483/3058] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:40:59 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:00.907488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2f50f389-6e56-453d-9cdd-ac2fe97e6b79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:00.908172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2f50f389-6e56-453d-9cdd-ac2fe97e6b79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:00.915018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2f50f389-6e56-453d-9cdd-ac2fe97e6b79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:00.915473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2f50f389-6e56-453d-9cdd-ac2fe97e6b79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:00.916234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2f50f389-6e56-453d-9cdd-ac2fe97e6b79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:00.916665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2f50f389-6e56-453d-9cdd-ac2fe97e6b79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:00.973965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2f50f389-6e56-453d-9cdd-ac2fe97e6b79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:00.982273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2f50f389-6e56-453d-9cdd-ac2fe97e6b79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078412 Nov 02 23:41:00.982836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2484/3059] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:00 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:01.998798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7564413e-b379-4a6d-9666-33c8c2b7873c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:01.999521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7564413e-b379-4a6d-9666-33c8c2b7873c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:02.005890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7564413e-b379-4a6d-9666-33c8c2b7873c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:02.006331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7564413e-b379-4a6d-9666-33c8c2b7873c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:02.007126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7564413e-b379-4a6d-9666-33c8c2b7873c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:02.007565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7564413e-b379-4a6d-9666-33c8c2b7873c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:02.066054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7564413e-b379-4a6d-9666-33c8c2b7873c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:02.073669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7564413e-b379-4a6d-9666-33c8c2b7873c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078599 Nov 02 23:41:02.074231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2485/3060] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:01 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:03.089931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dbea0eaf-5173-4015-978e-8d67872d3caf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:03.090605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dbea0eaf-5173-4015-978e-8d67872d3caf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:03.096622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbea0eaf-5173-4015-978e-8d67872d3caf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:03.097062 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbea0eaf-5173-4015-978e-8d67872d3caf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:03.097814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbea0eaf-5173-4015-978e-8d67872d3caf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:03.098240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dbea0eaf-5173-4015-978e-8d67872d3caf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:03.155655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dbea0eaf-5173-4015-978e-8d67872d3caf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:03.163283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dbea0eaf-5173-4015-978e-8d67872d3caf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077016 Nov 02 23:41:03.163851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2486/3061] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:03 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:04.179512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c85e2453-2e78-4785-b227-11ce1bd18c22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:04.180219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c85e2453-2e78-4785-b227-11ce1bd18c22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:04.186559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c85e2453-2e78-4785-b227-11ce1bd18c22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:04.187031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c85e2453-2e78-4785-b227-11ce1bd18c22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:04.187799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c85e2453-2e78-4785-b227-11ce1bd18c22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:04.188230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c85e2453-2e78-4785-b227-11ce1bd18c22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:04.249725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c85e2453-2e78-4785-b227-11ce1bd18c22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:04.257974 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c85e2453-2e78-4785-b227-11ce1bd18c22 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.082053 Nov 02 23:41:04.258789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2487/3062] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:04 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:05.274978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8bb7aa8f-f4e6-4864-8e72-fc5de553c8ff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:05.275621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8bb7aa8f-f4e6-4864-8e72-fc5de553c8ff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:05.281976 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bb7aa8f-f4e6-4864-8e72-fc5de553c8ff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:05.282422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bb7aa8f-f4e6-4864-8e72-fc5de553c8ff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:05.283331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bb7aa8f-f4e6-4864-8e72-fc5de553c8ff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:05.283767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8bb7aa8f-f4e6-4864-8e72-fc5de553c8ff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:05.341889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8bb7aa8f-f4e6-4864-8e72-fc5de553c8ff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:05.349461 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8bb7aa8f-f4e6-4864-8e72-fc5de553c8ff tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078674 Nov 02 23:41:05.350019 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2488/3063] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:05 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:06.366414 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c3ba27a7-9182-4b96-9d8f-6e7bce527b73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:06.367124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c3ba27a7-9182-4b96-9d8f-6e7bce527b73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:06.373295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3ba27a7-9182-4b96-9d8f-6e7bce527b73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:06.373737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3ba27a7-9182-4b96-9d8f-6e7bce527b73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:06.374492 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3ba27a7-9182-4b96-9d8f-6e7bce527b73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:06.374939 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3ba27a7-9182-4b96-9d8f-6e7bce527b73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:06.435277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c3ba27a7-9182-4b96-9d8f-6e7bce527b73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:06.443094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c3ba27a7-9182-4b96-9d8f-6e7bce527b73 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080155 Nov 02 23:41:06.443664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2489/3064] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:06 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:07.460608 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e9f225f9-c655-4970-b746-57fa66aa893c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:07.461140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e9f225f9-c655-4970-b746-57fa66aa893c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:07.467440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9f225f9-c655-4970-b746-57fa66aa893c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:07.467886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9f225f9-c655-4970-b746-57fa66aa893c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:07.468649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9f225f9-c655-4970-b746-57fa66aa893c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:07.469082 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9f225f9-c655-4970-b746-57fa66aa893c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:07.527246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e9f225f9-c655-4970-b746-57fa66aa893c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:07.534745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e9f225f9-c655-4970-b746-57fa66aa893c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078331 Nov 02 23:41:07.535341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2490/3065] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:07 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:08.551840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-109e5b45-c1f6-4d45-93ab-2a738b85bd5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:08.552544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-109e5b45-c1f6-4d45-93ab-2a738b85bd5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:08.558891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-109e5b45-c1f6-4d45-93ab-2a738b85bd5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:08.559354 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-109e5b45-c1f6-4d45-93ab-2a738b85bd5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:08.560105 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-109e5b45-c1f6-4d45-93ab-2a738b85bd5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:08.560529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-109e5b45-c1f6-4d45-93ab-2a738b85bd5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:08.620564 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-109e5b45-c1f6-4d45-93ab-2a738b85bd5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:08.628188 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-109e5b45-c1f6-4d45-93ab-2a738b85bd5a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080040 Nov 02 23:41:08.628751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2491/3066] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:08 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:09.644529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6e3b7f99-724c-4b65-8374-0f285b20e99d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:09.645232 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6e3b7f99-724c-4b65-8374-0f285b20e99d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:09.651995 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e3b7f99-724c-4b65-8374-0f285b20e99d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:09.652443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e3b7f99-724c-4b65-8374-0f285b20e99d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:09.653203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e3b7f99-724c-4b65-8374-0f285b20e99d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:09.653639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e3b7f99-724c-4b65-8374-0f285b20e99d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:09.867102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6e3b7f99-724c-4b65-8374-0f285b20e99d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:09.874663 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6e3b7f99-724c-4b65-8374-0f285b20e99d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.233765 Nov 02 23:41:09.875246 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2492/3067] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:09 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:10.891845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dfb56110-b6e2-4eba-bde9-c61514c7e726 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:10.892558 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dfb56110-b6e2-4eba-bde9-c61514c7e726 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:10.899299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dfb56110-b6e2-4eba-bde9-c61514c7e726 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:10.899745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dfb56110-b6e2-4eba-bde9-c61514c7e726 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:10.900505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dfb56110-b6e2-4eba-bde9-c61514c7e726 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:10.900931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dfb56110-b6e2-4eba-bde9-c61514c7e726 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:10.961869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dfb56110-b6e2-4eba-bde9-c61514c7e726 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:10.969407 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dfb56110-b6e2-4eba-bde9-c61514c7e726 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081209 Nov 02 23:41:10.969955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2493/3068] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:10 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:11.985634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-19f83e91-6fc4-49e1-83cf-970aa54257e1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:11.986364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-19f83e91-6fc4-49e1-83cf-970aa54257e1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:11.992420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19f83e91-6fc4-49e1-83cf-970aa54257e1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:11.992857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19f83e91-6fc4-49e1-83cf-970aa54257e1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:11.993606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19f83e91-6fc4-49e1-83cf-970aa54257e1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:11.994027 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19f83e91-6fc4-49e1-83cf-970aa54257e1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:12.052705 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-19f83e91-6fc4-49e1-83cf-970aa54257e1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:12.060992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-19f83e91-6fc4-49e1-83cf-970aa54257e1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078981 Nov 02 23:41:12.061535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2494/3069] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:11 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:41:13.078000 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6575402c-f4c9-482b-91ba-05085598f9d0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:13.078705 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6575402c-f4c9-482b-91ba-05085598f9d0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:13.084887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6575402c-f4c9-482b-91ba-05085598f9d0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:13.085346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6575402c-f4c9-482b-91ba-05085598f9d0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:13.086157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6575402c-f4c9-482b-91ba-05085598f9d0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:13.086593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6575402c-f4c9-482b-91ba-05085598f9d0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:13.144630 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6575402c-f4c9-482b-91ba-05085598f9d0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:13.152284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6575402c-f4c9-482b-91ba-05085598f9d0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077962 Nov 02 23:41:13.152838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2495/3070] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:13 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:14.168699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-67b94768-c182-4023-bfdd-fd80fee728a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:14.169423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-67b94768-c182-4023-bfdd-fd80fee728a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:14.175415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67b94768-c182-4023-bfdd-fd80fee728a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:14.175853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67b94768-c182-4023-bfdd-fd80fee728a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:14.176602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67b94768-c182-4023-bfdd-fd80fee728a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:14.177029 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67b94768-c182-4023-bfdd-fd80fee728a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:14.235730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-67b94768-c182-4023-bfdd-fd80fee728a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:14.244065 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-67b94768-c182-4023-bfdd-fd80fee728a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078984 Nov 02 23:41:14.244614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2496/3071] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:14 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:15.261146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f4c52675-be0b-45b5-9587-ee2da4f66be5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:15.261820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f4c52675-be0b-45b5-9587-ee2da4f66be5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:15.268142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f4c52675-be0b-45b5-9587-ee2da4f66be5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:15.268594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f4c52675-be0b-45b5-9587-ee2da4f66be5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:15.269359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f4c52675-be0b-45b5-9587-ee2da4f66be5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:15.269793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f4c52675-be0b-45b5-9587-ee2da4f66be5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:15.328351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f4c52675-be0b-45b5-9587-ee2da4f66be5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:15.335997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f4c52675-be0b-45b5-9587-ee2da4f66be5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079234 Nov 02 23:41:15.336552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2497/3072] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:15 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:16.352344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f46cec74-ad5d-44fe-9a43-272f9fb9f8af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:16.353037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f46cec74-ad5d-44fe-9a43-272f9fb9f8af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:16.359344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f46cec74-ad5d-44fe-9a43-272f9fb9f8af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:16.359818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f46cec74-ad5d-44fe-9a43-272f9fb9f8af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:16.360585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f46cec74-ad5d-44fe-9a43-272f9fb9f8af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:16.361014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f46cec74-ad5d-44fe-9a43-272f9fb9f8af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:16.420521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f46cec74-ad5d-44fe-9a43-272f9fb9f8af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:16.428152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f46cec74-ad5d-44fe-9a43-272f9fb9f8af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079520 Nov 02 23:41:16.429395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2498/3073] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:16 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:17.445768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-00633781-26a1-45e9-81ce-536f89f5553f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:17.446440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-00633781-26a1-45e9-81ce-536f89f5553f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:17.452595 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-00633781-26a1-45e9-81ce-536f89f5553f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:17.453039 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-00633781-26a1-45e9-81ce-536f89f5553f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:17.453795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-00633781-26a1-45e9-81ce-536f89f5553f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:17.454225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-00633781-26a1-45e9-81ce-536f89f5553f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:17.516102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-00633781-26a1-45e9-81ce-536f89f5553f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:17.524309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-00633781-26a1-45e9-81ce-536f89f5553f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.082196 Nov 02 23:41:17.524865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2499/3074] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:17 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:18.540810 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9138d4e8-5ecc-4d60-9ece-d26e2fd44b8f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:18.541492 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9138d4e8-5ecc-4d60-9ece-d26e2fd44b8f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:18.547558 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9138d4e8-5ecc-4d60-9ece-d26e2fd44b8f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:18.547998 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9138d4e8-5ecc-4d60-9ece-d26e2fd44b8f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:18.548744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9138d4e8-5ecc-4d60-9ece-d26e2fd44b8f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:18.549172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9138d4e8-5ecc-4d60-9ece-d26e2fd44b8f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:18.607859 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9138d4e8-5ecc-4d60-9ece-d26e2fd44b8f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:18.615536 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9138d4e8-5ecc-4d60-9ece-d26e2fd44b8f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078868 Nov 02 23:41:18.616784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2500/3075] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:18 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:19.632618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c3afcbfa-e2bf-4033-ad0a-40d91a684d1b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:19.633294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c3afcbfa-e2bf-4033-ad0a-40d91a684d1b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:19.639351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3afcbfa-e2bf-4033-ad0a-40d91a684d1b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:19.639796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3afcbfa-e2bf-4033-ad0a-40d91a684d1b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:19.640555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3afcbfa-e2bf-4033-ad0a-40d91a684d1b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:19.640981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3afcbfa-e2bf-4033-ad0a-40d91a684d1b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:19.699439 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c3afcbfa-e2bf-4033-ad0a-40d91a684d1b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:19.707067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c3afcbfa-e2bf-4033-ad0a-40d91a684d1b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078814 Nov 02 23:41:19.707619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2501/3076] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:19 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:20.723655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cbe0fe2c-3b65-418a-9432-31bd003e8f79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:20.724545 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cbe0fe2c-3b65-418a-9432-31bd003e8f79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:20.731174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cbe0fe2c-3b65-418a-9432-31bd003e8f79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:20.731615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cbe0fe2c-3b65-418a-9432-31bd003e8f79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:20.732377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cbe0fe2c-3b65-418a-9432-31bd003e8f79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:20.732800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cbe0fe2c-3b65-418a-9432-31bd003e8f79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:20.791684 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cbe0fe2c-3b65-418a-9432-31bd003e8f79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:20.799148 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cbe0fe2c-3b65-418a-9432-31bd003e8f79 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079295 Nov 02 23:41:20.799698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2502/3077] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:20 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:21.815904 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-af03ac01-7d09-4128-9e7a-bcaabe1c8703 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:21.816579 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-af03ac01-7d09-4128-9e7a-bcaabe1c8703 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:21.822634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af03ac01-7d09-4128-9e7a-bcaabe1c8703 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:21.823107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af03ac01-7d09-4128-9e7a-bcaabe1c8703 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:21.823861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af03ac01-7d09-4128-9e7a-bcaabe1c8703 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:21.824284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af03ac01-7d09-4128-9e7a-bcaabe1c8703 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:21.882443 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-af03ac01-7d09-4128-9e7a-bcaabe1c8703 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:21.890075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-af03ac01-7d09-4128-9e7a-bcaabe1c8703 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077829 Nov 02 23:41:21.890627 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2503/3078] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:21 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:22.907047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-acef9d13-d7c2-4a8e-b5fd-0de394e65c9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:22.907770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-acef9d13-d7c2-4a8e-b5fd-0de394e65c9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:22.914369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-acef9d13-d7c2-4a8e-b5fd-0de394e65c9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:22.914812 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-acef9d13-d7c2-4a8e-b5fd-0de394e65c9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:22.915613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-acef9d13-d7c2-4a8e-b5fd-0de394e65c9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:22.916053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-acef9d13-d7c2-4a8e-b5fd-0de394e65c9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:22.973978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-acef9d13-d7c2-4a8e-b5fd-0de394e65c9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:22.982151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-acef9d13-d7c2-4a8e-b5fd-0de394e65c9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078746 Nov 02 23:41:22.982718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2504/3079] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:22 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:23.999088 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-20dba899-302b-40f9-8af9-72805e870328 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:23.999773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-20dba899-302b-40f9-8af9-72805e870328 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:24.006005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-20dba899-302b-40f9-8af9-72805e870328 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:24.006445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-20dba899-302b-40f9-8af9-72805e870328 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:24.007878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-20dba899-302b-40f9-8af9-72805e870328 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:24.008311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-20dba899-302b-40f9-8af9-72805e870328 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:24.069593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-20dba899-302b-40f9-8af9-72805e870328 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:24.077943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-20dba899-302b-40f9-8af9-72805e870328 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.082448 Nov 02 23:41:24.078503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2505/3080] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:23 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:25.093851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-af583749-d895-4086-b267-53247567a385 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:25.094847 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-af583749-d895-4086-b267-53247567a385 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:25.100454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af583749-d895-4086-b267-53247567a385 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:25.100902 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af583749-d895-4086-b267-53247567a385 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:25.101674 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af583749-d895-4086-b267-53247567a385 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:25.102104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af583749-d895-4086-b267-53247567a385 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:25.160660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-af583749-d895-4086-b267-53247567a385 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:25.168279 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-af583749-d895-4086-b267-53247567a385 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078583 Nov 02 23:41:25.168836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2506/3081] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:25 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:26.185357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-26a3b210-f313-47f0-aa2a-9eeb542eadd0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:26.186054 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-26a3b210-f313-47f0-aa2a-9eeb542eadd0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:26.192142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26a3b210-f313-47f0-aa2a-9eeb542eadd0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:26.192585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26a3b210-f313-47f0-aa2a-9eeb542eadd0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:26.193333 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26a3b210-f313-47f0-aa2a-9eeb542eadd0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:26.193757 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-26a3b210-f313-47f0-aa2a-9eeb542eadd0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:26.253667 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-26a3b210-f313-47f0-aa2a-9eeb542eadd0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:26.261988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-26a3b210-f313-47f0-aa2a-9eeb542eadd0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080517 Nov 02 23:41:26.262547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2507/3082] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:26 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:27.279001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6167cc6e-8bdc-4250-8d22-17cd77530c28 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:27.280999 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6167cc6e-8bdc-4250-8d22-17cd77530c28 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:27.285948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6167cc6e-8bdc-4250-8d22-17cd77530c28 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:27.286391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6167cc6e-8bdc-4250-8d22-17cd77530c28 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:27.287184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6167cc6e-8bdc-4250-8d22-17cd77530c28 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:27.287617 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6167cc6e-8bdc-4250-8d22-17cd77530c28 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:27.345691 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6167cc6e-8bdc-4250-8d22-17cd77530c28 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:27.353331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6167cc6e-8bdc-4250-8d22-17cd77530c28 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077990 Nov 02 23:41:27.353887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2508/3083] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:27 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:28.369746 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bc761f11-f458-450d-9857-805bc31cbd68 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:28.370430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bc761f11-f458-450d-9857-805bc31cbd68 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:28.376751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc761f11-f458-450d-9857-805bc31cbd68 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:28.377200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc761f11-f458-450d-9857-805bc31cbd68 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:28.377973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc761f11-f458-450d-9857-805bc31cbd68 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:28.378412 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc761f11-f458-450d-9857-805bc31cbd68 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:28.437024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bc761f11-f458-450d-9857-805bc31cbd68 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:28.444557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bc761f11-f458-450d-9857-805bc31cbd68 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078933 Nov 02 23:41:28.445797 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2509/3084] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:28 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:29.461680 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-78dffffd-2e4c-483a-a1ad-54af7afbceed tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:29.462328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-78dffffd-2e4c-483a-a1ad-54af7afbceed tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:29.468395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78dffffd-2e4c-483a-a1ad-54af7afbceed tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:29.468922 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78dffffd-2e4c-483a-a1ad-54af7afbceed tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:29.469590 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78dffffd-2e4c-483a-a1ad-54af7afbceed tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:29.470017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-78dffffd-2e4c-483a-a1ad-54af7afbceed tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:29.528675 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-78dffffd-2e4c-483a-a1ad-54af7afbceed tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:29.536287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-78dffffd-2e4c-483a-a1ad-54af7afbceed tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078920 Nov 02 23:41:29.536843 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2510/3085] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:29 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:41:30.552664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a1f7be7b-50f6-48a4-9e0a-198ebde41194 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:30.553411 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a1f7be7b-50f6-48a4-9e0a-198ebde41194 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:30.559832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a1f7be7b-50f6-48a4-9e0a-198ebde41194 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:30.560279 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a1f7be7b-50f6-48a4-9e0a-198ebde41194 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:30.561050 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a1f7be7b-50f6-48a4-9e0a-198ebde41194 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:30.561483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a1f7be7b-50f6-48a4-9e0a-198ebde41194 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:30.623695 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a1f7be7b-50f6-48a4-9e0a-198ebde41194 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:30.631560 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a1f7be7b-50f6-48a4-9e0a-198ebde41194 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.082502 Nov 02 23:41:30.632122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2511/3086] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:30 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:31.649168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4b91d73e-98a8-4dee-85d1-30d18067fcf0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:31.649912 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4b91d73e-98a8-4dee-85d1-30d18067fcf0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:31.659819 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b91d73e-98a8-4dee-85d1-30d18067fcf0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:31.660269 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b91d73e-98a8-4dee-85d1-30d18067fcf0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:31.661058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b91d73e-98a8-4dee-85d1-30d18067fcf0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:31.661495 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4b91d73e-98a8-4dee-85d1-30d18067fcf0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:31.722900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4b91d73e-98a8-4dee-85d1-30d18067fcf0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:31.732124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4b91d73e-98a8-4dee-85d1-30d18067fcf0 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.087065 Nov 02 23:41:31.732752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2512/3087] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:31 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:32.748618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-462fe99b-7104-4bbb-a167-21b7bde4b576 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:32.749219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-462fe99b-7104-4bbb-a167-21b7bde4b576 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:32.755398 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-462fe99b-7104-4bbb-a167-21b7bde4b576 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:32.755842 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-462fe99b-7104-4bbb-a167-21b7bde4b576 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:32.756604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-462fe99b-7104-4bbb-a167-21b7bde4b576 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:32.757035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-462fe99b-7104-4bbb-a167-21b7bde4b576 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:32.815493 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-462fe99b-7104-4bbb-a167-21b7bde4b576 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:32.823545 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-462fe99b-7104-4bbb-a167-21b7bde4b576 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078651 Nov 02 23:41:32.824103 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2513/3088] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:32 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:33.840615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-66d41ccd-eb11-42bd-89c2-fbba10839c0f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:33.841260 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-66d41ccd-eb11-42bd-89c2-fbba10839c0f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:33.847348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66d41ccd-eb11-42bd-89c2-fbba10839c0f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:33.847791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66d41ccd-eb11-42bd-89c2-fbba10839c0f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:33.848543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66d41ccd-eb11-42bd-89c2-fbba10839c0f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:33.848970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66d41ccd-eb11-42bd-89c2-fbba10839c0f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:33.906223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-66d41ccd-eb11-42bd-89c2-fbba10839c0f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:33.914471 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-66d41ccd-eb11-42bd-89c2-fbba10839c0f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077039 Nov 02 23:41:33.915075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2514/3089] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:33 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:34.931500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-382913a6-eec3-49ac-a5c9-73a4cfab3cfd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:34.932457 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-382913a6-eec3-49ac-a5c9-73a4cfab3cfd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:34.938571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-382913a6-eec3-49ac-a5c9-73a4cfab3cfd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:34.939048 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-382913a6-eec3-49ac-a5c9-73a4cfab3cfd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:34.939835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-382913a6-eec3-49ac-a5c9-73a4cfab3cfd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:34.940277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-382913a6-eec3-49ac-a5c9-73a4cfab3cfd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:34.999004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-382913a6-eec3-49ac-a5c9-73a4cfab3cfd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:35.007432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-382913a6-eec3-49ac-a5c9-73a4cfab3cfd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080234 Nov 02 23:41:35.007996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2515/3090] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:34 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:36.023809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-525ebdf9-898b-45d5-816f-276f297d2439 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:36.024497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-525ebdf9-898b-45d5-816f-276f297d2439 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:36.030613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-525ebdf9-898b-45d5-816f-276f297d2439 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:36.031106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-525ebdf9-898b-45d5-816f-276f297d2439 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:36.031876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-525ebdf9-898b-45d5-816f-276f297d2439 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:36.032315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-525ebdf9-898b-45d5-816f-276f297d2439 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:36.089869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-525ebdf9-898b-45d5-816f-276f297d2439 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:36.097428 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-525ebdf9-898b-45d5-816f-276f297d2439 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077827 Nov 02 23:41:36.097999 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2516/3091] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:36 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:37.114327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3b088e6c-4cd5-4607-89fe-32cca1d8a2de tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:37.115034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3b088e6c-4cd5-4607-89fe-32cca1d8a2de tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:37.122132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b088e6c-4cd5-4607-89fe-32cca1d8a2de tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:37.122602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b088e6c-4cd5-4607-89fe-32cca1d8a2de tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:37.123392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b088e6c-4cd5-4607-89fe-32cca1d8a2de tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:37.123829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3b088e6c-4cd5-4607-89fe-32cca1d8a2de tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:37.185677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3b088e6c-4cd5-4607-89fe-32cca1d8a2de tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:37.193361 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3b088e6c-4cd5-4607-89fe-32cca1d8a2de tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.082713 Nov 02 23:41:37.193923 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2517/3092] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:37 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:41:38.209423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7608bbb2-1eca-4de5-be75-2b6bff6b1431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:38.209966 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7608bbb2-1eca-4de5-be75-2b6bff6b1431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:38.216720 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7608bbb2-1eca-4de5-be75-2b6bff6b1431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:38.217167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7608bbb2-1eca-4de5-be75-2b6bff6b1431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:38.217921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7608bbb2-1eca-4de5-be75-2b6bff6b1431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:38.218352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7608bbb2-1eca-4de5-be75-2b6bff6b1431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:38.276822 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7608bbb2-1eca-4de5-be75-2b6bff6b1431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:38.284411 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7608bbb2-1eca-4de5-be75-2b6bff6b1431 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078750 Nov 02 23:41:38.285036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2518/3093] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:38 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:39.301223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-855753b0-2214-41ac-97d0-cb359656ed9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:39.301811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-855753b0-2214-41ac-97d0-cb359656ed9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:39.308931 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-855753b0-2214-41ac-97d0-cb359656ed9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:39.309369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-855753b0-2214-41ac-97d0-cb359656ed9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:39.310122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-855753b0-2214-41ac-97d0-cb359656ed9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:39.310545 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-855753b0-2214-41ac-97d0-cb359656ed9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:39.368101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-855753b0-2214-41ac-97d0-cb359656ed9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:39.375657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-855753b0-2214-41ac-97d0-cb359656ed9b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078101 Nov 02 23:41:39.376211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2519/3094] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:39 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:40.391908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8cdec3c3-0a1e-4e00-824a-f8317b65c014 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:40.392548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8cdec3c3-0a1e-4e00-824a-f8317b65c014 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:40.399051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8cdec3c3-0a1e-4e00-824a-f8317b65c014 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:40.399496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8cdec3c3-0a1e-4e00-824a-f8317b65c014 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:40.400247 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8cdec3c3-0a1e-4e00-824a-f8317b65c014 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:40.400669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8cdec3c3-0a1e-4e00-824a-f8317b65c014 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:40.457738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8cdec3c3-0a1e-4e00-824a-f8317b65c014 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:40.466136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8cdec3c3-0a1e-4e00-824a-f8317b65c014 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077949 Nov 02 23:41:40.466698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2520/3095] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:40 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:41.482692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5d26e4f9-32fb-47db-8fd6-7b376d6e368c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:41.483346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5d26e4f9-32fb-47db-8fd6-7b376d6e368c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:41.489650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d26e4f9-32fb-47db-8fd6-7b376d6e368c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:41.490099 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d26e4f9-32fb-47db-8fd6-7b376d6e368c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:41.490863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d26e4f9-32fb-47db-8fd6-7b376d6e368c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:41.491330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5d26e4f9-32fb-47db-8fd6-7b376d6e368c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:41.549353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5d26e4f9-32fb-47db-8fd6-7b376d6e368c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:41.557149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5d26e4f9-32fb-47db-8fd6-7b376d6e368c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078107 Nov 02 23:41:41.557744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2521/3096] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:41 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:42.573428 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-133c1a62-3a30-4e01-bcd8-929bf92885ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:42.574086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-133c1a62-3a30-4e01-bcd8-929bf92885ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:42.580215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-133c1a62-3a30-4e01-bcd8-929bf92885ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:42.580660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-133c1a62-3a30-4e01-bcd8-929bf92885ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:42.581423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-133c1a62-3a30-4e01-bcd8-929bf92885ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:42.581853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-133c1a62-3a30-4e01-bcd8-929bf92885ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:42.639073 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-133c1a62-3a30-4e01-bcd8-929bf92885ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:42.646577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-133c1a62-3a30-4e01-bcd8-929bf92885ee tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.076767 Nov 02 23:41:42.647173 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2522/3097] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:42 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:43.663257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-368d92b5-7d18-40c0-bf74-1de26064b3bc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:43.663884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-368d92b5-7d18-40c0-bf74-1de26064b3bc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:43.669996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-368d92b5-7d18-40c0-bf74-1de26064b3bc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:43.670435 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-368d92b5-7d18-40c0-bf74-1de26064b3bc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:43.671221 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-368d92b5-7d18-40c0-bf74-1de26064b3bc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:43.671645 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-368d92b5-7d18-40c0-bf74-1de26064b3bc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:43.732351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-368d92b5-7d18-40c0-bf74-1de26064b3bc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:43.740190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-368d92b5-7d18-40c0-bf74-1de26064b3bc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080532 Nov 02 23:41:43.740763 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2523/3098] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:43 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:44.756907 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-96e72a48-2b80-4341-bfc3-7796b94b59a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:44.757600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-96e72a48-2b80-4341-bfc3-7796b94b59a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:44.763644 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-96e72a48-2b80-4341-bfc3-7796b94b59a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:44.764090 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-96e72a48-2b80-4341-bfc3-7796b94b59a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:44.764843 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-96e72a48-2b80-4341-bfc3-7796b94b59a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:44.765275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-96e72a48-2b80-4341-bfc3-7796b94b59a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:44.822882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-96e72a48-2b80-4341-bfc3-7796b94b59a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:44.830320 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-96e72a48-2b80-4341-bfc3-7796b94b59a2 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077131 Nov 02 23:41:44.830876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2524/3099] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:44 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:45.846127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e04c21cf-e255-48ed-b650-ea30bf3383b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:45.846762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e04c21cf-e255-48ed-b650-ea30bf3383b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:45.853474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e04c21cf-e255-48ed-b650-ea30bf3383b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:45.853911 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e04c21cf-e255-48ed-b650-ea30bf3383b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:45.854692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e04c21cf-e255-48ed-b650-ea30bf3383b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:45.855145 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e04c21cf-e255-48ed-b650-ea30bf3383b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:45.912276 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e04c21cf-e255-48ed-b650-ea30bf3383b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:45.920627 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e04c21cf-e255-48ed-b650-ea30bf3383b9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078245 Nov 02 23:41:45.921251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2525/3100] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:45 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:46.936604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6f22de05-ed79-4f84-8257-ff2a50ef41ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:46.937234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6f22de05-ed79-4f84-8257-ff2a50ef41ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:46.943311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f22de05-ed79-4f84-8257-ff2a50ef41ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:46.943758 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f22de05-ed79-4f84-8257-ff2a50ef41ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:46.945033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f22de05-ed79-4f84-8257-ff2a50ef41ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:46.945462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6f22de05-ed79-4f84-8257-ff2a50ef41ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:47.002733 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6f22de05-ed79-4f84-8257-ff2a50ef41ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:47.011600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6f22de05-ed79-4f84-8257-ff2a50ef41ae tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078784 Nov 02 23:41:47.012154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2526/3101] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:46 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:48.028421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dd820fa0-2c0a-4ea2-a481-d0ee630db9cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:48.029067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dd820fa0-2c0a-4ea2-a481-d0ee630db9cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:48.035209 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd820fa0-2c0a-4ea2-a481-d0ee630db9cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:48.035660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd820fa0-2c0a-4ea2-a481-d0ee630db9cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:48.036428 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd820fa0-2c0a-4ea2-a481-d0ee630db9cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:48.036860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dd820fa0-2c0a-4ea2-a481-d0ee630db9cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:48.094737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dd820fa0-2c0a-4ea2-a481-d0ee630db9cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:48.103007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dd820fa0-2c0a-4ea2-a481-d0ee630db9cf tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077532 Nov 02 23:41:48.103571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2527/3102] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:48 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:49.119854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-09cef942-0f6c-4537-91a5-d390e977621c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:49.120545 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-09cef942-0f6c-4537-91a5-d390e977621c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:49.126666 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-09cef942-0f6c-4537-91a5-d390e977621c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:49.127146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-09cef942-0f6c-4537-91a5-d390e977621c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:49.127911 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-09cef942-0f6c-4537-91a5-d390e977621c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:49.128360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-09cef942-0f6c-4537-91a5-d390e977621c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:49.186271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-09cef942-0f6c-4537-91a5-d390e977621c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:49.193942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-09cef942-0f6c-4537-91a5-d390e977621c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078408 Nov 02 23:41:49.194512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2528/3103] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:49 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:50.047092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5f5614ca-f125-431f-8155-b47e5add2aa0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:50.047583 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5f5614ca-f125-431f-8155-b47e5add2aa0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:50.053357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f5614ca-f125-431f-8155-b47e5add2aa0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:50.053806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f5614ca-f125-431f-8155-b47e5add2aa0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:50.054564 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f5614ca-f125-431f-8155-b47e5add2aa0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:50.055035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f5614ca-f125-431f-8155-b47e5add2aa0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:50.068841 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-5f5614ca-f125-431f-8155-b47e5add2aa0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] HTTP exception thrown: Instance b8f293cf-a963-45dd-aaed-9149bfcfca7e could not be found. Nov 02 23:41:50.069807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5f5614ca-f125-431f-8155-b47e5add2aa0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Returning 404 to user: Instance b8f293cf-a963-45dd-aaed-9149bfcfca7e could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:41:50.070235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5f5614ca-f125-431f-8155-b47e5add2aa0 tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "DELETE /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 404 len: 111 microversion: 2.1 time: 0.026823 Nov 02 23:41:50.070797 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2529/3104] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:41:50 2021] DELETE /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 23:41:50.078408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3fb3f2d6-7e19-45c8-b70a-5c6ab69588ec tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:50.079139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3fb3f2d6-7e19-45c8-b70a-5c6ab69588ec tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] [instance: b8f293cf-a963-45dd-aaed-9149bfcfca7e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:50.084676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fb3f2d6-7e19-45c8-b70a-5c6ab69588ec tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:50.085121 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fb3f2d6-7e19-45c8-b70a-5c6ab69588ec tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:50.085880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fb3f2d6-7e19-45c8-b70a-5c6ab69588ec tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:50.086867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3fb3f2d6-7e19-45c8-b70a-5c6ab69588ec tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:50.099605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-3fb3f2d6-7e19-45c8-b70a-5c6ab69588ec tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] HTTP exception thrown: Instance b8f293cf-a963-45dd-aaed-9149bfcfca7e could not be found. Nov 02 23:41:50.100253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3fb3f2d6-7e19-45c8-b70a-5c6ab69588ec tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] Returning 404 to user: Instance b8f293cf-a963-45dd-aaed-9149bfcfca7e could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:41:50.101100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3fb3f2d6-7e19-45c8-b70a-5c6ab69588ec tempest-AttachVolumeTestJSON-1597009475 tempest-AttachVolumeTestJSON-1597009475-project] 10.222.0.41 "GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e" status: 404 len: 111 microversion: 2.1 time: 0.026191 Nov 02 23:41:50.101624 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2530/3105] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:50 2021] GET /compute/v2.1/servers/b8f293cf-a963-45dd-aaed-9149bfcfca7e => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 23:41:50.121553 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fc311f72-6012-4f08-9408-79511a8b611d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:50.122170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fc311f72-6012-4f08-9408-79511a8b611d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:50.127921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc311f72-6012-4f08-9408-79511a8b611d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:50.128363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc311f72-6012-4f08-9408-79511a8b611d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:50.129338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc311f72-6012-4f08-9408-79511a8b611d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:50.129543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fc311f72-6012-4f08-9408-79511a8b611d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:50.158526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fc311f72-6012-4f08-9408-79511a8b611d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Going to try to terminate instance {{(pid=115800) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 23:41:50.249268 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fc311f72-6012-4f08-9408-79511a8b611d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 204 len: 0 microversion: 2.1 time: 0.130821 Nov 02 23:41:50.255013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2531/3106] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:41:50 2021] DELETE /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 23:41:50.260169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2570aca0-0777-4588-8e67-fa472f8cc639 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:50.260856 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2570aca0-0777-4588-8e67-fa472f8cc639 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:50.266809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2570aca0-0777-4588-8e67-fa472f8cc639 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:50.267397 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2570aca0-0777-4588-8e67-fa472f8cc639 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:50.268207 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2570aca0-0777-4588-8e67-fa472f8cc639 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:50.268667 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2570aca0-0777-4588-8e67-fa472f8cc639 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:50.333820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2570aca0-0777-4588-8e67-fa472f8cc639 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:50.342128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2570aca0-0777-4588-8e67-fa472f8cc639 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.085939 Nov 02 23:41:50.342718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2532/3107] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:50 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:41:50.351408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-63c88b32-8f4e-462a-b5db-230340d3b5da tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:50.351408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-63c88b32-8f4e-462a-b5db-230340d3b5da tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:50.353908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-63c88b32-8f4e-462a-b5db-230340d3b5da tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:50.354349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-63c88b32-8f4e-462a-b5db-230340d3b5da tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:50.355136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-63c88b32-8f4e-462a-b5db-230340d3b5da tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:50.355566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-63c88b32-8f4e-462a-b5db-230340d3b5da tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:50.483141 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-63c88b32-8f4e-462a-b5db-230340d3b5da tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:50.490344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-63c88b32-8f4e-462a-b5db-230340d3b5da tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1514 microversion: 2.1 time: 0.146670 Nov 02 23:41:50.490907 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2533/3108] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:50 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:41:51.358601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d6030179-4f8d-4f10-8435-222541010def tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:51.359291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d6030179-4f8d-4f10-8435-222541010def tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:51.365692 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6030179-4f8d-4f10-8435-222541010def tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:51.366146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6030179-4f8d-4f10-8435-222541010def tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:51.368223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6030179-4f8d-4f10-8435-222541010def tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:51.368691 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d6030179-4f8d-4f10-8435-222541010def tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:51.428048 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d6030179-4f8d-4f10-8435-222541010def tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:51.435896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d6030179-4f8d-4f10-8435-222541010def tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080920 Nov 02 23:41:51.436669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2534/3109] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:51 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:51.506363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-656843d6-aceb-4c58-ac28-e52c2ac5429d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:51.507115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-656843d6-aceb-4c58-ac28-e52c2ac5429d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:51.513507 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-656843d6-aceb-4c58-ac28-e52c2ac5429d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:51.513950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-656843d6-aceb-4c58-ac28-e52c2ac5429d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:51.514709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-656843d6-aceb-4c58-ac28-e52c2ac5429d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:51.515155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-656843d6-aceb-4c58-ac28-e52c2ac5429d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:51.649565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-656843d6-aceb-4c58-ac28-e52c2ac5429d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:51.657335 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-656843d6-aceb-4c58-ac28-e52c2ac5429d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1514 microversion: 2.1 time: 0.154534 Nov 02 23:41:51.657928 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2535/3110] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:51 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:52.230094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-117408d0-f59b-4f24-b4f2-5d975dfde2fd req-d942aa1c-d34e-4d23-86f2-e0754c003e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07", "name": "network-vif-deleted", "tag": "a4dd4b8a-c493-4af8-b49d-f031913d57ab"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:41:52.232018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:41:52.232018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:41:52.239253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-117408d0-f59b-4f24-b4f2-5d975dfde2fd req-d942aa1c-d34e-4d23-86f2-e0754c003e64 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:52.239694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-117408d0-f59b-4f24-b4f2-5d975dfde2fd req-d942aa1c-d34e-4d23-86f2-e0754c003e64 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:52.253778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-117408d0-f59b-4f24-b4f2-5d975dfde2fd req-d942aa1c-d34e-4d23-86f2-e0754c003e64 service nova] Creating event network-vif-deleted:a4dd4b8a-c493-4af8-b49d-f031913d57ab for instance fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 on hv-cinder-81584 Nov 02 23:41:52.259153 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-117408d0-f59b-4f24-b4f2-5d975dfde2fd req-d942aa1c-d34e-4d23-86f2-e0754c003e64 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033170 Nov 02 23:41:52.259814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2536/3111] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:41:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:41:52.454770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8ddeb0c4-f12e-40ea-99f5-8b21464030fd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:52.456353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8ddeb0c4-f12e-40ea-99f5-8b21464030fd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:52.462937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8ddeb0c4-f12e-40ea-99f5-8b21464030fd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:52.463502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8ddeb0c4-f12e-40ea-99f5-8b21464030fd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:52.464379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8ddeb0c4-f12e-40ea-99f5-8b21464030fd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:52.464936 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8ddeb0c4-f12e-40ea-99f5-8b21464030fd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:52.549433 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8ddeb0c4-f12e-40ea-99f5-8b21464030fd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:52.558234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8ddeb0c4-f12e-40ea-99f5-8b21464030fd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.108778 Nov 02 23:41:52.559145 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2537/3112] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:52 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:41:52.677091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3e372435-7ba8-4bde-b987-4b4194d6135c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:52.677091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3e372435-7ba8-4bde-b987-4b4194d6135c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:52.684702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e372435-7ba8-4bde-b987-4b4194d6135c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:52.685153 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e372435-7ba8-4bde-b987-4b4194d6135c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:52.685929 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e372435-7ba8-4bde-b987-4b4194d6135c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:52.686358 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e372435-7ba8-4bde-b987-4b4194d6135c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:52.720189 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e372435-7ba8-4bde-b987-4b4194d6135c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:52.720641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e372435-7ba8-4bde-b987-4b4194d6135c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:52.721089 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.objects.instance [None req-3e372435-7ba8-4bde-b987-4b4194d6135c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lazy-loading 'fault' on Instance uuid fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 {{(pid=115800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 23:41:52.769330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3e372435-7ba8-4bde-b987-4b4194d6135c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:52.777593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3e372435-7ba8-4bde-b987-4b4194d6135c tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 200 len: 1308 microversion: 2.1 time: 0.107891 Nov 02 23:41:52.778162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2538/3113] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:52 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:53.578297 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fea79067-3b35-4d3a-89e3-ae3087f82e3c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:53.578942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fea79067-3b35-4d3a-89e3-ae3087f82e3c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:53.585410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fea79067-3b35-4d3a-89e3-ae3087f82e3c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:53.585817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fea79067-3b35-4d3a-89e3-ae3087f82e3c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:53.587917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fea79067-3b35-4d3a-89e3-ae3087f82e3c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:53.588581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fea79067-3b35-4d3a-89e3-ae3087f82e3c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:53.669892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fea79067-3b35-4d3a-89e3-ae3087f82e3c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:53.678341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fea79067-3b35-4d3a-89e3-ae3087f82e3c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.105440 Nov 02 23:41:53.689534 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2539/3114] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:53 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:41:53.795742 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3102702d-d2f2-4f90-a8a5-6b7e49b93452 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:53.796456 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3102702d-d2f2-4f90-a8a5-6b7e49b93452 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:53.802619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3102702d-d2f2-4f90-a8a5-6b7e49b93452 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:53.803611 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3102702d-d2f2-4f90-a8a5-6b7e49b93452 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:53.804893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3102702d-d2f2-4f90-a8a5-6b7e49b93452 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:53.806206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3102702d-d2f2-4f90-a8a5-6b7e49b93452 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:53.825387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-3102702d-d2f2-4f90-a8a5-6b7e49b93452 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] HTTP exception thrown: Instance fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 could not be found. Nov 02 23:41:53.825982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3102702d-d2f2-4f90-a8a5-6b7e49b93452 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Returning 404 to user: Instance fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:41:53.827622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3102702d-d2f2-4f90-a8a5-6b7e49b93452 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07" status: 404 len: 111 microversion: 2.1 time: 0.035562 Nov 02 23:41:53.828351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2540/3115] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:53 2021] GET /compute/v2.1/servers/fc8f9e9e-0a2f-49e7-8f45-56051c1a8a07 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 23:41:53.839431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4297b6ad-2f36-45d2-8df6-caeb25c075d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:53.839431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4297b6ad-2f36-45d2-8df6-caeb25c075d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:53.846561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4297b6ad-2f36-45d2-8df6-caeb25c075d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:53.847166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4297b6ad-2f36-45d2-8df6-caeb25c075d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:53.848046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4297b6ad-2f36-45d2-8df6-caeb25c075d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:53.848566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4297b6ad-2f36-45d2-8df6-caeb25c075d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:53.874807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4297b6ad-2f36-45d2-8df6-caeb25c075d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Going to try to terminate instance {{(pid=115800) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 23:41:53.950346 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4297b6ad-2f36-45d2-8df6-caeb25c075d8 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5" status: 204 len: 0 microversion: 2.1 time: 0.117459 Nov 02 23:41:53.951342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2541/3116] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:41:53 2021] DELETE /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 23:41:53.959622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c1a55570-f4e2-42a7-820c-90ff74475252 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:53.960325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c1a55570-f4e2-42a7-820c-90ff74475252 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:53.966685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c1a55570-f4e2-42a7-820c-90ff74475252 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:53.971229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c1a55570-f4e2-42a7-820c-90ff74475252 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:53.972465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c1a55570-f4e2-42a7-820c-90ff74475252 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:53.972597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c1a55570-f4e2-42a7-820c-90ff74475252 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:54.106855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c1a55570-f4e2-42a7-820c-90ff74475252 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:54.114098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c1a55570-f4e2-42a7-820c-90ff74475252 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5" status: 200 len: 1513 microversion: 2.1 time: 0.158469 Nov 02 23:41:54.114657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2542/3117] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:53 2021] GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:54.697463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3e9bbc41-b296-4efe-9957-be87f10dc9a5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:54.698181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3e9bbc41-b296-4efe-9957-be87f10dc9a5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:54.704471 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e9bbc41-b296-4efe-9957-be87f10dc9a5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:54.704911 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e9bbc41-b296-4efe-9957-be87f10dc9a5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:54.705664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e9bbc41-b296-4efe-9957-be87f10dc9a5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:54.706088 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3e9bbc41-b296-4efe-9957-be87f10dc9a5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:54.765745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3e9bbc41-b296-4efe-9957-be87f10dc9a5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:54.773513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3e9bbc41-b296-4efe-9957-be87f10dc9a5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080352 Nov 02 23:41:54.774694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2543/3118] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:54 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:55.132231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5a70ccb3-c97b-4cd1-9046-34c8904cf731 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:55.132929 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5a70ccb3-c97b-4cd1-9046-34c8904cf731 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:55.139512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a70ccb3-c97b-4cd1-9046-34c8904cf731 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:55.140331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a70ccb3-c97b-4cd1-9046-34c8904cf731 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:55.141355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a70ccb3-c97b-4cd1-9046-34c8904cf731 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:55.141852 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5a70ccb3-c97b-4cd1-9046-34c8904cf731 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:55.246095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5a70ccb3-c97b-4cd1-9046-34c8904cf731 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:55.254295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5a70ccb3-c97b-4cd1-9046-34c8904cf731 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5" status: 200 len: 1471 microversion: 2.1 time: 0.126200 Nov 02 23:41:55.254878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2544/3119] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:55 2021] GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5 => generated 1471 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:55.270056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-bc47d82c-ecac-4ce8-9e6f-f3b48bfb2218 req-8b76d76e-494c-42b9-9dcc-f66cb8c38ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec965ba6-7484-49dc-9efe-4accdc1361e5", "name": "network-vif-deleted", "tag": "5acdb4c8-a941-4571-a8ba-636f73738cee"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:41:55.272711 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:41:55.272711 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:41:55.282196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-bc47d82c-ecac-4ce8-9e6f-f3b48bfb2218 req-8b76d76e-494c-42b9-9dcc-f66cb8c38ca0 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:55.283018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-bc47d82c-ecac-4ce8-9e6f-f3b48bfb2218 req-8b76d76e-494c-42b9-9dcc-f66cb8c38ca0 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:55.304835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-bc47d82c-ecac-4ce8-9e6f-f3b48bfb2218 req-8b76d76e-494c-42b9-9dcc-f66cb8c38ca0 service nova] Creating event network-vif-deleted:5acdb4c8-a941-4571-a8ba-636f73738cee for instance ec965ba6-7484-49dc-9efe-4accdc1361e5 on hv-cinder-81584 Nov 02 23:41:55.311046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-bc47d82c-ecac-4ce8-9e6f-f3b48bfb2218 req-8b76d76e-494c-42b9-9dcc-f66cb8c38ca0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048064 Nov 02 23:41:55.312091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2545/3120] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:41:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:41:55.790052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-585990be-f774-4191-a7af-b93c6c41874f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:55.790871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-585990be-f774-4191-a7af-b93c6c41874f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:55.798067 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-585990be-f774-4191-a7af-b93c6c41874f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:55.798504 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-585990be-f774-4191-a7af-b93c6c41874f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:55.799864 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-585990be-f774-4191-a7af-b93c6c41874f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:55.800356 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-585990be-f774-4191-a7af-b93c6c41874f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:55.862402 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-585990be-f774-4191-a7af-b93c6c41874f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:55.869994 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-585990be-f774-4191-a7af-b93c6c41874f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.083941 Nov 02 23:41:55.870561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2546/3121] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:55 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:56.272220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4015b13c-8715-46b7-baa1-c919a00391e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:56.272824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4015b13c-8715-46b7-baa1-c919a00391e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ec965ba6-7484-49dc-9efe-4accdc1361e5] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:56.278621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4015b13c-8715-46b7-baa1-c919a00391e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:56.279101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4015b13c-8715-46b7-baa1-c919a00391e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:56.279853 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4015b13c-8715-46b7-baa1-c919a00391e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:56.280312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4015b13c-8715-46b7-baa1-c919a00391e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:56.293684 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-4015b13c-8715-46b7-baa1-c919a00391e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] HTTP exception thrown: Instance ec965ba6-7484-49dc-9efe-4accdc1361e5 could not be found. Nov 02 23:41:56.294258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4015b13c-8715-46b7-baa1-c919a00391e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Returning 404 to user: Instance ec965ba6-7484-49dc-9efe-4accdc1361e5 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:41:56.295088 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4015b13c-8715-46b7-baa1-c919a00391e7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5" status: 404 len: 111 microversion: 2.1 time: 0.026531 Nov 02 23:41:56.295600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2547/3122] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:56 2021] GET /compute/v2.1/servers/ec965ba6-7484-49dc-9efe-4accdc1361e5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 23:41:56.887480 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cda1d7fb-e7b5-4114-bfd7-02035df37e47 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:56.888163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cda1d7fb-e7b5-4114-bfd7-02035df37e47 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:56.894351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cda1d7fb-e7b5-4114-bfd7-02035df37e47 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:56.894796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cda1d7fb-e7b5-4114-bfd7-02035df37e47 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:56.895585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cda1d7fb-e7b5-4114-bfd7-02035df37e47 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:56.896016 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cda1d7fb-e7b5-4114-bfd7-02035df37e47 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:56.953556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cda1d7fb-e7b5-4114-bfd7-02035df37e47 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:56.961020 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cda1d7fb-e7b5-4114-bfd7-02035df37e47 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077254 Nov 02 23:41:56.962149 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2548/3123] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:56 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:57.977679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-17b401c7-6562-4bdb-8632-ad1bbbe5cce6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:57.978312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-17b401c7-6562-4bdb-8632-ad1bbbe5cce6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:57.984499 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17b401c7-6562-4bdb-8632-ad1bbbe5cce6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:57.984944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17b401c7-6562-4bdb-8632-ad1bbbe5cce6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:57.985703 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17b401c7-6562-4bdb-8632-ad1bbbe5cce6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:57.986134 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17b401c7-6562-4bdb-8632-ad1bbbe5cce6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:58.043405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-17b401c7-6562-4bdb-8632-ad1bbbe5cce6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:58.050889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-17b401c7-6562-4bdb-8632-ad1bbbe5cce6 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077342 Nov 02 23:41:58.051472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2549/3124] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:57 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:41:59.068032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c0fc9bb6-bd63-42e4-b40d-66e32afcd2af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:41:59.068724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c0fc9bb6-bd63-42e4-b40d-66e32afcd2af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:41:59.075442 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0fc9bb6-bd63-42e4-b40d-66e32afcd2af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:59.075889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0fc9bb6-bd63-42e4-b40d-66e32afcd2af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:59.076649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0fc9bb6-bd63-42e4-b40d-66e32afcd2af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:41:59.077079 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c0fc9bb6-bd63-42e4-b40d-66e32afcd2af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:41:59.137459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c0fc9bb6-bd63-42e4-b40d-66e32afcd2af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:41:59.145057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c0fc9bb6-bd63-42e4-b40d-66e32afcd2af tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080670 Nov 02 23:41:59.145613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2550/3125] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:41:59 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:00.161204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-328e8428-4a35-4906-9f47-897d3d5a70c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:00.161811 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-328e8428-4a35-4906-9f47-897d3d5a70c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:00.168465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-328e8428-4a35-4906-9f47-897d3d5a70c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:00.168899 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-328e8428-4a35-4906-9f47-897d3d5a70c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:00.169649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-328e8428-4a35-4906-9f47-897d3d5a70c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:00.170070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-328e8428-4a35-4906-9f47-897d3d5a70c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:00.228437 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-328e8428-4a35-4906-9f47-897d3d5a70c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:00.236141 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-328e8428-4a35-4906-9f47-897d3d5a70c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078603 Nov 02 23:42:00.236694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2551/3126] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:00 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:01.252973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c366f184-c864-47ee-b4a5-27639e7344c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:01.253636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c366f184-c864-47ee-b4a5-27639e7344c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:01.259839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c366f184-c864-47ee-b4a5-27639e7344c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:01.260282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c366f184-c864-47ee-b4a5-27639e7344c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:01.261041 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c366f184-c864-47ee-b4a5-27639e7344c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:01.261474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c366f184-c864-47ee-b4a5-27639e7344c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:01.319203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c366f184-c864-47ee-b4a5-27639e7344c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:01.326986 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c366f184-c864-47ee-b4a5-27639e7344c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077614 Nov 02 23:42:01.327551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2552/3127] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:01 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:02.344015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4d416303-e17c-4b3a-8db6-77dc00d54837 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:02.344672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4d416303-e17c-4b3a-8db6-77dc00d54837 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:02.350978 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d416303-e17c-4b3a-8db6-77dc00d54837 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:02.351420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d416303-e17c-4b3a-8db6-77dc00d54837 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:02.352795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d416303-e17c-4b3a-8db6-77dc00d54837 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:02.353222 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4d416303-e17c-4b3a-8db6-77dc00d54837 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:02.410164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4d416303-e17c-4b3a-8db6-77dc00d54837 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:02.418293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4d416303-e17c-4b3a-8db6-77dc00d54837 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077933 Nov 02 23:42:02.418854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2553/3128] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:02 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:03.435478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cdd84117-38e1-4969-9b18-8f0577db9c5f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:03.436175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cdd84117-38e1-4969-9b18-8f0577db9c5f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:03.442202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cdd84117-38e1-4969-9b18-8f0577db9c5f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:03.442643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cdd84117-38e1-4969-9b18-8f0577db9c5f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:03.443463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cdd84117-38e1-4969-9b18-8f0577db9c5f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:03.443889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cdd84117-38e1-4969-9b18-8f0577db9c5f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:03.501468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cdd84117-38e1-4969-9b18-8f0577db9c5f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:03.509284 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cdd84117-38e1-4969-9b18-8f0577db9c5f tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077736 Nov 02 23:42:03.509850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2554/3129] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:03 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:04.525792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c3e11fb8-dc2b-4d07-b27b-daa187d06a16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:04.526445 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c3e11fb8-dc2b-4d07-b27b-daa187d06a16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:04.532884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3e11fb8-dc2b-4d07-b27b-daa187d06a16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:04.533331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3e11fb8-dc2b-4d07-b27b-daa187d06a16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:04.534098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3e11fb8-dc2b-4d07-b27b-daa187d06a16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:04.534532 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c3e11fb8-dc2b-4d07-b27b-daa187d06a16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:04.593072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c3e11fb8-dc2b-4d07-b27b-daa187d06a16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:04.600574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c3e11fb8-dc2b-4d07-b27b-daa187d06a16 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078951 Nov 02 23:42:04.601127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2555/3130] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:04 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:05.616736 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f08ae7b2-cfe2-4e5f-bd50-2d0856e15a1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:05.617966 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f08ae7b2-cfe2-4e5f-bd50-2d0856e15a1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:05.624326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f08ae7b2-cfe2-4e5f-bd50-2d0856e15a1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:05.624765 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f08ae7b2-cfe2-4e5f-bd50-2d0856e15a1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:05.625533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f08ae7b2-cfe2-4e5f-bd50-2d0856e15a1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:05.625963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f08ae7b2-cfe2-4e5f-bd50-2d0856e15a1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:05.688042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f08ae7b2-cfe2-4e5f-bd50-2d0856e15a1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:05.695732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f08ae7b2-cfe2-4e5f-bd50-2d0856e15a1a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.082622 Nov 02 23:42:05.696289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2556/3131] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:05 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:06.712638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-95c9dbc0-1a3c-44cc-bb28-8138b1442232 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:06.713295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-95c9dbc0-1a3c-44cc-bb28-8138b1442232 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:06.719500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-95c9dbc0-1a3c-44cc-bb28-8138b1442232 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:06.719963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-95c9dbc0-1a3c-44cc-bb28-8138b1442232 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:06.720722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-95c9dbc0-1a3c-44cc-bb28-8138b1442232 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:06.721158 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-95c9dbc0-1a3c-44cc-bb28-8138b1442232 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:06.779306 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-95c9dbc0-1a3c-44cc-bb28-8138b1442232 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:06.786805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-95c9dbc0-1a3c-44cc-bb28-8138b1442232 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078402 Nov 02 23:42:06.787402 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2557/3132] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:06 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:07.803797 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-71c89ad2-4b0d-437c-b35c-f7863f6dea70 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:07.804418 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-71c89ad2-4b0d-437c-b35c-f7863f6dea70 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:07.811276 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-71c89ad2-4b0d-437c-b35c-f7863f6dea70 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:07.811719 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-71c89ad2-4b0d-437c-b35c-f7863f6dea70 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:07.812466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-71c89ad2-4b0d-437c-b35c-f7863f6dea70 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:07.812889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-71c89ad2-4b0d-437c-b35c-f7863f6dea70 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:07.870187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-71c89ad2-4b0d-437c-b35c-f7863f6dea70 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:07.877674 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-71c89ad2-4b0d-437c-b35c-f7863f6dea70 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077586 Nov 02 23:42:07.878225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2558/3133] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:07 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:08.893884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d56feae8-a8d8-4bf3-87d5-ba563ff74a50 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:08.894592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d56feae8-a8d8-4bf3-87d5-ba563ff74a50 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:08.900684 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d56feae8-a8d8-4bf3-87d5-ba563ff74a50 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:08.901125 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d56feae8-a8d8-4bf3-87d5-ba563ff74a50 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:08.901881 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d56feae8-a8d8-4bf3-87d5-ba563ff74a50 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:08.902313 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d56feae8-a8d8-4bf3-87d5-ba563ff74a50 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:08.959591 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d56feae8-a8d8-4bf3-87d5-ba563ff74a50 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:08.968014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d56feae8-a8d8-4bf3-87d5-ba563ff74a50 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077754 Nov 02 23:42:08.968572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2559/3134] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:08 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:09.984402 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-db4e0bb1-783b-4e57-a574-f645951e094b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:09.985063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-db4e0bb1-783b-4e57-a574-f645951e094b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:09.991378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db4e0bb1-783b-4e57-a574-f645951e094b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:09.991817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db4e0bb1-783b-4e57-a574-f645951e094b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:09.992570 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db4e0bb1-783b-4e57-a574-f645951e094b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:09.992996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db4e0bb1-783b-4e57-a574-f645951e094b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:10.050066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-db4e0bb1-783b-4e57-a574-f645951e094b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:10.057888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-db4e0bb1-783b-4e57-a574-f645951e094b tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077319 Nov 02 23:42:10.058446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2560/3135] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:09 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:11.073774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a9da1942-4002-4c56-bd20-2be8966a869a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:11.074502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a9da1942-4002-4c56-bd20-2be8966a869a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:11.080641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9da1942-4002-4c56-bd20-2be8966a869a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:11.081089 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9da1942-4002-4c56-bd20-2be8966a869a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:11.081854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9da1942-4002-4c56-bd20-2be8966a869a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:11.082288 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a9da1942-4002-4c56-bd20-2be8966a869a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:11.140543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a9da1942-4002-4c56-bd20-2be8966a869a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:11.148092 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a9da1942-4002-4c56-bd20-2be8966a869a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078486 Nov 02 23:42:11.148657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2561/3136] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:11 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:12.164391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8cf93271-87cb-432d-9b74-b0cfb9ce6c4a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:12.165641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8cf93271-87cb-432d-9b74-b0cfb9ce6c4a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:12.171810 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8cf93271-87cb-432d-9b74-b0cfb9ce6c4a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:12.172258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8cf93271-87cb-432d-9b74-b0cfb9ce6c4a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:12.173020 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8cf93271-87cb-432d-9b74-b0cfb9ce6c4a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:12.173456 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8cf93271-87cb-432d-9b74-b0cfb9ce6c4a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:12.234722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8cf93271-87cb-432d-9b74-b0cfb9ce6c4a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:12.242511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8cf93271-87cb-432d-9b74-b0cfb9ce6c4a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081866 Nov 02 23:42:12.243107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2562/3137] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:12 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:13.259474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2985c885-58cf-4785-a96e-5f09e2ce2bdc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:13.260115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2985c885-58cf-4785-a96e-5f09e2ce2bdc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:13.266275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2985c885-58cf-4785-a96e-5f09e2ce2bdc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:13.266721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2985c885-58cf-4785-a96e-5f09e2ce2bdc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:13.267515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2985c885-58cf-4785-a96e-5f09e2ce2bdc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:13.267951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2985c885-58cf-4785-a96e-5f09e2ce2bdc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:13.329695 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2985c885-58cf-4785-a96e-5f09e2ce2bdc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:13.338029 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2985c885-58cf-4785-a96e-5f09e2ce2bdc tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.082360 Nov 02 23:42:13.338596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2563/3138] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:13 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:14.354729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-057a95f5-e067-4d70-9ed9-86fce8d30b92 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:14.355392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-057a95f5-e067-4d70-9ed9-86fce8d30b92 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:14.361557 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-057a95f5-e067-4d70-9ed9-86fce8d30b92 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:14.361997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-057a95f5-e067-4d70-9ed9-86fce8d30b92 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:14.362748 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-057a95f5-e067-4d70-9ed9-86fce8d30b92 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:14.363207 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-057a95f5-e067-4d70-9ed9-86fce8d30b92 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:14.420336 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-057a95f5-e067-4d70-9ed9-86fce8d30b92 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:14.427755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-057a95f5-e067-4d70-9ed9-86fce8d30b92 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.076993 Nov 02 23:42:14.428310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2564/3139] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:14 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:15.445086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3abd9c61-7cee-4d00-9557-dd7bcc5a1e6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:15.445750 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3abd9c61-7cee-4d00-9557-dd7bcc5a1e6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:15.451954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3abd9c61-7cee-4d00-9557-dd7bcc5a1e6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:15.452414 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3abd9c61-7cee-4d00-9557-dd7bcc5a1e6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:15.453155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3abd9c61-7cee-4d00-9557-dd7bcc5a1e6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:15.453588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3abd9c61-7cee-4d00-9557-dd7bcc5a1e6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:15.511623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3abd9c61-7cee-4d00-9557-dd7bcc5a1e6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:15.519382 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3abd9c61-7cee-4d00-9557-dd7bcc5a1e6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077912 Nov 02 23:42:15.520039 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2565/3140] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:15 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:16.536316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-df99161b-7a26-4ef2-ad80-744f74a1cba5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:16.536968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-df99161b-7a26-4ef2-ad80-744f74a1cba5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:16.543592 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-df99161b-7a26-4ef2-ad80-744f74a1cba5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:16.544055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-df99161b-7a26-4ef2-ad80-744f74a1cba5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:16.544798 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-df99161b-7a26-4ef2-ad80-744f74a1cba5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:16.545226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-df99161b-7a26-4ef2-ad80-744f74a1cba5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:16.603577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-df99161b-7a26-4ef2-ad80-744f74a1cba5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:16.611094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-df99161b-7a26-4ef2-ad80-744f74a1cba5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078425 Nov 02 23:42:16.611657 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2566/3141] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:16 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:17.628090 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6966b185-65bb-429e-8e2e-901b9909849e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:17.628694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6966b185-65bb-429e-8e2e-901b9909849e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:17.635512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6966b185-65bb-429e-8e2e-901b9909849e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:17.635949 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6966b185-65bb-429e-8e2e-901b9909849e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:17.636707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6966b185-65bb-429e-8e2e-901b9909849e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:17.637132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6966b185-65bb-429e-8e2e-901b9909849e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:17.694522 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-6966b185-65bb-429e-8e2e-901b9909849e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:17.702762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6966b185-65bb-429e-8e2e-901b9909849e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078390 Nov 02 23:42:17.703359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2567/3142] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:17 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:18.718084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0d0c7d84-c8ad-4d7d-a9d6-a58be9c1e20a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:18.718756 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0d0c7d84-c8ad-4d7d-a9d6-a58be9c1e20a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:18.724884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d0c7d84-c8ad-4d7d-a9d6-a58be9c1e20a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:18.725326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d0c7d84-c8ad-4d7d-a9d6-a58be9c1e20a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:18.726076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d0c7d84-c8ad-4d7d-a9d6-a58be9c1e20a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:18.726503 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0d0c7d84-c8ad-4d7d-a9d6-a58be9c1e20a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:18.787779 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0d0c7d84-c8ad-4d7d-a9d6-a58be9c1e20a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:18.795828 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0d0c7d84-c8ad-4d7d-a9d6-a58be9c1e20a tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.081418 Nov 02 23:42:18.796397 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2568/3143] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:18 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:19.812395 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-88da6428-6a14-4bd7-9d38-8a4a5d1bbd7c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:19.813030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-88da6428-6a14-4bd7-9d38-8a4a5d1bbd7c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:19.819081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88da6428-6a14-4bd7-9d38-8a4a5d1bbd7c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:19.819533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88da6428-6a14-4bd7-9d38-8a4a5d1bbd7c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:19.820294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88da6428-6a14-4bd7-9d38-8a4a5d1bbd7c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:19.820720 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-88da6428-6a14-4bd7-9d38-8a4a5d1bbd7c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:19.878033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-88da6428-6a14-4bd7-9d38-8a4a5d1bbd7c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:19.886215 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-88da6428-6a14-4bd7-9d38-8a4a5d1bbd7c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077531 Nov 02 23:42:19.886780 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2569/3144] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:19 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:20.903295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cca5521a-191b-4bf0-9ce3-52da4919478e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:20.903979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cca5521a-191b-4bf0-9ce3-52da4919478e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:20.909685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cca5521a-191b-4bf0-9ce3-52da4919478e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:20.910125 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cca5521a-191b-4bf0-9ce3-52da4919478e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:20.910888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cca5521a-191b-4bf0-9ce3-52da4919478e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:20.911344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cca5521a-191b-4bf0-9ce3-52da4919478e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:20.968909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cca5521a-191b-4bf0-9ce3-52da4919478e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:20.976467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cca5521a-191b-4bf0-9ce3-52da4919478e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077670 Nov 02 23:42:20.977024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2570/3145] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:20 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:21.993413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0e546ea1-7c1b-4d32-9ae3-87ef43db0782 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:21.994032 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0e546ea1-7c1b-4d32-9ae3-87ef43db0782 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:22.000158 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e546ea1-7c1b-4d32-9ae3-87ef43db0782 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:22.000596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e546ea1-7c1b-4d32-9ae3-87ef43db0782 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:22.001347 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e546ea1-7c1b-4d32-9ae3-87ef43db0782 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:22.001773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e546ea1-7c1b-4d32-9ae3-87ef43db0782 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:22.059892 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0e546ea1-7c1b-4d32-9ae3-87ef43db0782 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:22.067434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0e546ea1-7c1b-4d32-9ae3-87ef43db0782 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078178 Nov 02 23:42:22.067991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2571/3146] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:21 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:23.084111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fbd95133-bb02-4ea4-ae74-bd1a8170bcac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:23.084791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fbd95133-bb02-4ea4-ae74-bd1a8170bcac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:23.091392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbd95133-bb02-4ea4-ae74-bd1a8170bcac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:23.091840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbd95133-bb02-4ea4-ae74-bd1a8170bcac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:23.092735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbd95133-bb02-4ea4-ae74-bd1a8170bcac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:23.093233 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fbd95133-bb02-4ea4-ae74-bd1a8170bcac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:23.156666 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fbd95133-bb02-4ea4-ae74-bd1a8170bcac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:23.164338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fbd95133-bb02-4ea4-ae74-bd1a8170bcac tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.083863 Nov 02 23:42:23.164902 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2572/3147] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:23 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:24.181287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-51481ab2-abf4-42c4-a954-68bf1f904c9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:24.181946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-51481ab2-abf4-42c4-a954-68bf1f904c9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:24.188151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-51481ab2-abf4-42c4-a954-68bf1f904c9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:24.188604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-51481ab2-abf4-42c4-a954-68bf1f904c9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:24.189369 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-51481ab2-abf4-42c4-a954-68bf1f904c9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:24.189805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-51481ab2-abf4-42c4-a954-68bf1f904c9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:24.248843 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-51481ab2-abf4-42c4-a954-68bf1f904c9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:24.256546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-51481ab2-abf4-42c4-a954-68bf1f904c9d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079636 Nov 02 23:42:24.257108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2573/3148] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:24 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:25.272214 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a5c36d00-83fe-45d1-b1e9-ff3761c64186 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:25.272838 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a5c36d00-83fe-45d1-b1e9-ff3761c64186 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:25.279577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5c36d00-83fe-45d1-b1e9-ff3761c64186 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:25.280017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5c36d00-83fe-45d1-b1e9-ff3761c64186 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:25.280770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5c36d00-83fe-45d1-b1e9-ff3761c64186 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:25.281196 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a5c36d00-83fe-45d1-b1e9-ff3761c64186 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:25.341539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a5c36d00-83fe-45d1-b1e9-ff3761c64186 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:25.349122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a5c36d00-83fe-45d1-b1e9-ff3761c64186 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080584 Nov 02 23:42:25.349683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2574/3149] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:25 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:26.365163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5002373f-934b-4e13-8591-c51b849b0828 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:26.365761 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5002373f-934b-4e13-8591-c51b849b0828 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:26.372611 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5002373f-934b-4e13-8591-c51b849b0828 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:26.373050 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5002373f-934b-4e13-8591-c51b849b0828 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:26.373799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5002373f-934b-4e13-8591-c51b849b0828 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:26.374228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5002373f-934b-4e13-8591-c51b849b0828 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:26.433302 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5002373f-934b-4e13-8591-c51b849b0828 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:26.440962 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5002373f-934b-4e13-8591-c51b849b0828 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079434 Nov 02 23:42:26.441515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2575/3150] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:26 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:27.457087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d2c668b9-0e40-4f64-bbd2-d484b5e0db6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:27.457794 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d2c668b9-0e40-4f64-bbd2-d484b5e0db6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:27.464473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2c668b9-0e40-4f64-bbd2-d484b5e0db6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:27.464857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2c668b9-0e40-4f64-bbd2-d484b5e0db6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:27.465606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2c668b9-0e40-4f64-bbd2-d484b5e0db6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:27.466033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2c668b9-0e40-4f64-bbd2-d484b5e0db6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:27.523873 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d2c668b9-0e40-4f64-bbd2-d484b5e0db6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:27.531638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d2c668b9-0e40-4f64-bbd2-d484b5e0db6d tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078119 Nov 02 23:42:27.532219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2576/3151] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:27 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:28.547983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-23693e50-4978-41fc-8a9a-735252e69d82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:28.548616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-23693e50-4978-41fc-8a9a-735252e69d82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:28.554788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-23693e50-4978-41fc-8a9a-735252e69d82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:28.555265 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-23693e50-4978-41fc-8a9a-735252e69d82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:28.556277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-23693e50-4978-41fc-8a9a-735252e69d82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:28.556744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-23693e50-4978-41fc-8a9a-735252e69d82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:28.613730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-23693e50-4978-41fc-8a9a-735252e69d82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:28.621260 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-23693e50-4978-41fc-8a9a-735252e69d82 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.076987 Nov 02 23:42:28.621820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2577/3152] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:28 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:29.637368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d3011553-ce49-4f6d-bd79-67c9cc1805c7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:29.638005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d3011553-ce49-4f6d-bd79-67c9cc1805c7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:29.644116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3011553-ce49-4f6d-bd79-67c9cc1805c7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:29.644563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3011553-ce49-4f6d-bd79-67c9cc1805c7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:29.645312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3011553-ce49-4f6d-bd79-67c9cc1805c7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:29.645735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d3011553-ce49-4f6d-bd79-67c9cc1805c7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:29.703665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d3011553-ce49-4f6d-bd79-67c9cc1805c7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:29.711208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d3011553-ce49-4f6d-bd79-67c9cc1805c7 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077476 Nov 02 23:42:29.712282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2578/3153] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:29 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:30.728112 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c36006fc-e193-4a52-9852-fc5ba5b31386 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:30.728785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c36006fc-e193-4a52-9852-fc5ba5b31386 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:30.734807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c36006fc-e193-4a52-9852-fc5ba5b31386 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:30.735283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c36006fc-e193-4a52-9852-fc5ba5b31386 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:30.736040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c36006fc-e193-4a52-9852-fc5ba5b31386 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:30.736467 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c36006fc-e193-4a52-9852-fc5ba5b31386 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:30.794475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c36006fc-e193-4a52-9852-fc5ba5b31386 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:30.802001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c36006fc-e193-4a52-9852-fc5ba5b31386 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078108 Nov 02 23:42:30.802565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2579/3154] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:30 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:31.819664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3d83b67d-dac0-4c8a-bfc1-b0fb7578bef4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:31.820309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3d83b67d-dac0-4c8a-bfc1-b0fb7578bef4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:31.826941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3d83b67d-dac0-4c8a-bfc1-b0fb7578bef4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:31.827390 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3d83b67d-dac0-4c8a-bfc1-b0fb7578bef4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:31.828153 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3d83b67d-dac0-4c8a-bfc1-b0fb7578bef4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:31.828580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3d83b67d-dac0-4c8a-bfc1-b0fb7578bef4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:31.888687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3d83b67d-dac0-4c8a-bfc1-b0fb7578bef4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:31.896405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3d83b67d-dac0-4c8a-bfc1-b0fb7578bef4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080448 Nov 02 23:42:31.896965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2580/3155] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:31 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:32.911753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f91ff91d-ccc8-4a95-b621-bc55dbb5ad8c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:32.912431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f91ff91d-ccc8-4a95-b621-bc55dbb5ad8c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:32.919115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f91ff91d-ccc8-4a95-b621-bc55dbb5ad8c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:32.919552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f91ff91d-ccc8-4a95-b621-bc55dbb5ad8c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:32.920300 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f91ff91d-ccc8-4a95-b621-bc55dbb5ad8c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:32.920723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f91ff91d-ccc8-4a95-b621-bc55dbb5ad8c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:32.978100 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f91ff91d-ccc8-4a95-b621-bc55dbb5ad8c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:32.985591 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f91ff91d-ccc8-4a95-b621-bc55dbb5ad8c tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077409 Nov 02 23:42:32.986146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2581/3156] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:32 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:34.001387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c43474d3-4d5d-4b4c-a939-9b986508339e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:34.002031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c43474d3-4d5d-4b4c-a939-9b986508339e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:34.008139 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c43474d3-4d5d-4b4c-a939-9b986508339e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:34.008582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c43474d3-4d5d-4b4c-a939-9b986508339e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:34.009331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c43474d3-4d5d-4b4c-a939-9b986508339e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:34.009759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c43474d3-4d5d-4b4c-a939-9b986508339e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:34.067342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c43474d3-4d5d-4b4c-a939-9b986508339e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:34.074793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c43474d3-4d5d-4b4c-a939-9b986508339e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077088 Nov 02 23:42:34.075375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2582/3157] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:33 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:35.091393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5aa72f36-a66b-4930-9a7a-a019524f9ecd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:35.092079 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5aa72f36-a66b-4930-9a7a-a019524f9ecd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:35.098153 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5aa72f36-a66b-4930-9a7a-a019524f9ecd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:35.098595 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5aa72f36-a66b-4930-9a7a-a019524f9ecd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:35.099389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5aa72f36-a66b-4930-9a7a-a019524f9ecd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:35.099824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5aa72f36-a66b-4930-9a7a-a019524f9ecd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:35.157896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5aa72f36-a66b-4930-9a7a-a019524f9ecd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:35.166466 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5aa72f36-a66b-4930-9a7a-a019524f9ecd tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078674 Nov 02 23:42:35.167061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2583/3158] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:35 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:36.183788 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-fb7b3921-fd4b-46c9-87a0-e7ae51911084 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:36.184495 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-fb7b3921-fd4b-46c9-87a0-e7ae51911084 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:36.190566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fb7b3921-fd4b-46c9-87a0-e7ae51911084 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:36.191037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fb7b3921-fd4b-46c9-87a0-e7ae51911084 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:36.191824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fb7b3921-fd4b-46c9-87a0-e7ae51911084 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:36.192258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-fb7b3921-fd4b-46c9-87a0-e7ae51911084 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:36.250561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-fb7b3921-fd4b-46c9-87a0-e7ae51911084 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:36.258294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-fb7b3921-fd4b-46c9-87a0-e7ae51911084 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079085 Nov 02 23:42:36.258861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2584/3159] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:36 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:37.273960 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0b35268d-163a-4dc6-bb6d-3166ddeaa3fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:37.274585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0b35268d-163a-4dc6-bb6d-3166ddeaa3fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:37.280800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b35268d-163a-4dc6-bb6d-3166ddeaa3fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:37.281245 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b35268d-163a-4dc6-bb6d-3166ddeaa3fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:37.282004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b35268d-163a-4dc6-bb6d-3166ddeaa3fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:37.282435 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0b35268d-163a-4dc6-bb6d-3166ddeaa3fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:37.340191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0b35268d-163a-4dc6-bb6d-3166ddeaa3fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:37.347908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0b35268d-163a-4dc6-bb6d-3166ddeaa3fa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077586 Nov 02 23:42:37.348676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2585/3160] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:37 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:38.364301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cdf1643c-1491-432e-8d04-98ea1095a57e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:38.364958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cdf1643c-1491-432e-8d04-98ea1095a57e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:38.371328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cdf1643c-1491-432e-8d04-98ea1095a57e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:38.371781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cdf1643c-1491-432e-8d04-98ea1095a57e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:38.372547 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cdf1643c-1491-432e-8d04-98ea1095a57e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:38.372979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cdf1643c-1491-432e-8d04-98ea1095a57e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:38.433299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cdf1643c-1491-432e-8d04-98ea1095a57e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:38.440894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cdf1643c-1491-432e-8d04-98ea1095a57e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.080291 Nov 02 23:42:38.441450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2586/3161] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:38 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:39.457299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a062d755-5eae-460e-b282-15758eef15d9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:39.457967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a062d755-5eae-460e-b282-15758eef15d9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:39.464227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a062d755-5eae-460e-b282-15758eef15d9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:39.464628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a062d755-5eae-460e-b282-15758eef15d9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:39.465423 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a062d755-5eae-460e-b282-15758eef15d9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:39.465860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a062d755-5eae-460e-b282-15758eef15d9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:39.525188 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a062d755-5eae-460e-b282-15758eef15d9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:39.533448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a062d755-5eae-460e-b282-15758eef15d9 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079678 Nov 02 23:42:39.534050 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2587/3162] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:39 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:40.549918 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-15b68791-9c3d-464f-81df-08cc5a7bba72 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:40.550602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-15b68791-9c3d-464f-81df-08cc5a7bba72 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:40.556982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15b68791-9c3d-464f-81df-08cc5a7bba72 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:40.557428 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15b68791-9c3d-464f-81df-08cc5a7bba72 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:40.558222 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15b68791-9c3d-464f-81df-08cc5a7bba72 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:40.558653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15b68791-9c3d-464f-81df-08cc5a7bba72 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:40.616450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-15b68791-9c3d-464f-81df-08cc5a7bba72 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:40.624108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-15b68791-9c3d-464f-81df-08cc5a7bba72 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077864 Nov 02 23:42:40.624674 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2588/3163] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:40 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:41.639942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0296af6c-0801-431f-b9aa-bfa01cd981f4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:41.640582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0296af6c-0801-431f-b9aa-bfa01cd981f4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:41.646729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0296af6c-0801-431f-b9aa-bfa01cd981f4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:41.647213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0296af6c-0801-431f-b9aa-bfa01cd981f4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:41.647973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0296af6c-0801-431f-b9aa-bfa01cd981f4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:41.648404 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0296af6c-0801-431f-b9aa-bfa01cd981f4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:41.706676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0296af6c-0801-431f-b9aa-bfa01cd981f4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:41.714672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0296af6c-0801-431f-b9aa-bfa01cd981f4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078398 Nov 02 23:42:41.715271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2589/3164] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:41 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:42.731542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1f006baa-e6ac-4d07-9459-8d8667ab86c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:42.732223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1f006baa-e6ac-4d07-9459-8d8667ab86c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:42.738513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f006baa-e6ac-4d07-9459-8d8667ab86c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:42.738981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f006baa-e6ac-4d07-9459-8d8667ab86c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:42.739744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f006baa-e6ac-4d07-9459-8d8667ab86c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:42.740168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1f006baa-e6ac-4d07-9459-8d8667ab86c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:42.799533 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1f006baa-e6ac-4d07-9459-8d8667ab86c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:42.810543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1f006baa-e6ac-4d07-9459-8d8667ab86c1 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.082699 Nov 02 23:42:42.811449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2590/3165] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:42 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:43.827241 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b0ea23d8-2c94-4936-ba5c-69e2169566a5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:43.827844 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b0ea23d8-2c94-4936-ba5c-69e2169566a5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:43.833900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b0ea23d8-2c94-4936-ba5c-69e2169566a5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:43.834341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b0ea23d8-2c94-4936-ba5c-69e2169566a5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:43.835116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b0ea23d8-2c94-4936-ba5c-69e2169566a5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:43.835540 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b0ea23d8-2c94-4936-ba5c-69e2169566a5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:43.892651 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b0ea23d8-2c94-4936-ba5c-69e2169566a5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:43.900672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b0ea23d8-2c94-4936-ba5c-69e2169566a5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077195 Nov 02 23:42:43.901227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2591/3166] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:43 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:44.916974 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a82055e0-7aa0-4182-8282-9fa656f5ece4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:44.917663 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a82055e0-7aa0-4182-8282-9fa656f5ece4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:44.923764 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a82055e0-7aa0-4182-8282-9fa656f5ece4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:44.924210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a82055e0-7aa0-4182-8282-9fa656f5ece4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:44.924969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a82055e0-7aa0-4182-8282-9fa656f5ece4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:44.925409 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a82055e0-7aa0-4182-8282-9fa656f5ece4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:44.985602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a82055e0-7aa0-4182-8282-9fa656f5ece4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:44.993678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a82055e0-7aa0-4182-8282-9fa656f5ece4 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.079905 Nov 02 23:42:44.994238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2592/3167] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:44 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:46.009749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d53a68cc-fa0e-49f3-82ad-dd92e0237ea5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:46.010419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d53a68cc-fa0e-49f3-82ad-dd92e0237ea5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:46.016565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d53a68cc-fa0e-49f3-82ad-dd92e0237ea5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:46.017008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d53a68cc-fa0e-49f3-82ad-dd92e0237ea5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:46.017761 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d53a68cc-fa0e-49f3-82ad-dd92e0237ea5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:46.018186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d53a68cc-fa0e-49f3-82ad-dd92e0237ea5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:46.075623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d53a68cc-fa0e-49f3-82ad-dd92e0237ea5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:46.083201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d53a68cc-fa0e-49f3-82ad-dd92e0237ea5 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077462 Nov 02 23:42:46.083758 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2593/3168] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:46 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:47.100023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-27abf44e-af25-426f-8c27-b751937196aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:47.100674 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-27abf44e-af25-426f-8c27-b751937196aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:47.107344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27abf44e-af25-426f-8c27-b751937196aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:47.107787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27abf44e-af25-426f-8c27-b751937196aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:47.108538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27abf44e-af25-426f-8c27-b751937196aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:47.108968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27abf44e-af25-426f-8c27-b751937196aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:47.167218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-27abf44e-af25-426f-8c27-b751937196aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:47.174595 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-27abf44e-af25-426f-8c27-b751937196aa tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078222 Nov 02 23:42:47.175178 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2594/3169] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:47 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:48.190158 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f3fdb987-7d80-48f6-9cfb-0cd66235c586 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:48.190825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f3fdb987-7d80-48f6-9cfb-0cd66235c586 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:48.197608 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3fdb987-7d80-48f6-9cfb-0cd66235c586 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:48.198053 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3fdb987-7d80-48f6-9cfb-0cd66235c586 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:48.198815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3fdb987-7d80-48f6-9cfb-0cd66235c586 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:48.199275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f3fdb987-7d80-48f6-9cfb-0cd66235c586 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:48.257153 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f3fdb987-7d80-48f6-9cfb-0cd66235c586 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:48.265333 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f3fdb987-7d80-48f6-9cfb-0cd66235c586 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078914 Nov 02 23:42:48.265900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2595/3170] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:48 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:49.281676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9d6d0dbf-5702-4e56-a293-5c32d80d532e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:49.282277 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9d6d0dbf-5702-4e56-a293-5c32d80d532e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:49.288478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d6d0dbf-5702-4e56-a293-5c32d80d532e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:49.288926 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d6d0dbf-5702-4e56-a293-5c32d80d532e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:49.289677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d6d0dbf-5702-4e56-a293-5c32d80d532e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:49.290609 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9d6d0dbf-5702-4e56-a293-5c32d80d532e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:49.347525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9d6d0dbf-5702-4e56-a293-5c32d80d532e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:49.355720 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9d6d0dbf-5702-4e56-a293-5c32d80d532e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.077669 Nov 02 23:42:49.356286 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2596/3171] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:49 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:50.371598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d2cb3d11-1a29-4ec3-9bd8-95ccb7f4859e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:50.372227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d2cb3d11-1a29-4ec3-9bd8-95ccb7f4859e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:50.378605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2cb3d11-1a29-4ec3-9bd8-95ccb7f4859e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:50.379081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2cb3d11-1a29-4ec3-9bd8-95ccb7f4859e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:50.379845 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2cb3d11-1a29-4ec3-9bd8-95ccb7f4859e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:50.380271 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2cb3d11-1a29-4ec3-9bd8-95ccb7f4859e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:50.438545 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d2cb3d11-1a29-4ec3-9bd8-95ccb7f4859e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:50.446034 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d2cb3d11-1a29-4ec3-9bd8-95ccb7f4859e tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.078177 Nov 02 23:42:50.446588 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2597/3172] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:50 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:51.462305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-896063c1-d799-4754-b151-cdd26b3d1d98 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:51.463035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-896063c1-d799-4754-b151-cdd26b3d1d98 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:51.469106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-896063c1-d799-4754-b151-cdd26b3d1d98 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:51.469540 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-896063c1-d799-4754-b151-cdd26b3d1d98 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:51.470416 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-896063c1-d799-4754-b151-cdd26b3d1d98 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:51.470943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-896063c1-d799-4754-b151-cdd26b3d1d98 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:51.535124 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-896063c1-d799-4754-b151-cdd26b3d1d98 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5267e5616db14207a6b998f39a2dd8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a186c3447bfc4c1f984007590ba27d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:51.544248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-896063c1-d799-4754-b151-cdd26b3d1d98 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 200 len: 1353 microversion: 2.1 time: 0.085659 Nov 02 23:42:51.544834 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2598/3173] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:51 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:52.562029 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8443bb89-2c96-419b-9974-c6753acf7820 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:52.562674 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8443bb89-2c96-419b-9974-c6753acf7820 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] [instance: e7bf8316-893d-4fad-b5f0-4ecad89120b3] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:52.568801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8443bb89-2c96-419b-9974-c6753acf7820 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:52.569250 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8443bb89-2c96-419b-9974-c6753acf7820 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:52.570007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8443bb89-2c96-419b-9974-c6753acf7820 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:52.570441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8443bb89-2c96-419b-9974-c6753acf7820 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:52.583954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-8443bb89-2c96-419b-9974-c6753acf7820 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] HTTP exception thrown: Instance e7bf8316-893d-4fad-b5f0-4ecad89120b3 could not be found. Nov 02 23:42:52.584528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8443bb89-2c96-419b-9974-c6753acf7820 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] Returning 404 to user: Instance e7bf8316-893d-4fad-b5f0-4ecad89120b3 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:42:52.585363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8443bb89-2c96-419b-9974-c6753acf7820 tempest-ServerRescueNegativeTestJSON-1871323645 tempest-ServerRescueNegativeTestJSON-1871323645-project] 10.222.0.41 "GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3" status: 404 len: 111 microversion: 2.1 time: 0.027071 Nov 02 23:42:52.585876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2599/3174] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:52 2021] GET /compute/v2.1/servers/e7bf8316-893d-4fad-b5f0-4ecad89120b3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 23:42:53.799529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-66d70b94-d405-4d00-a150-2e98d9eb2ca7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:53.800334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-66d70b94-d405-4d00-a150-2e98d9eb2ca7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:53.806677 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66d70b94-d405-4d00-a150-2e98d9eb2ca7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:53.807151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66d70b94-d405-4d00-a150-2e98d9eb2ca7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:53.807918 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66d70b94-d405-4d00-a150-2e98d9eb2ca7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:53.808356 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66d70b94-d405-4d00-a150-2e98d9eb2ca7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:53.835817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-66d70b94-d405-4d00-a150-2e98d9eb2ca7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Going to try to terminate instance {{(pid=115800) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 23:42:53.912469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-66d70b94-d405-4d00-a150-2e98d9eb2ca7 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 204 len: 0 microversion: 2.1 time: 0.116689 Nov 02 23:42:53.913223 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2600/3175] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:42:53 2021] DELETE /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 23:42:53.922585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-63c4e30f-00f2-4e6d-b5c0-6bf2af8063a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:53.923476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-63c4e30f-00f2-4e6d-b5c0-6bf2af8063a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:53.929453 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-63c4e30f-00f2-4e6d-b5c0-6bf2af8063a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:53.929926 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-63c4e30f-00f2-4e6d-b5c0-6bf2af8063a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:53.931474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-63c4e30f-00f2-4e6d-b5c0-6bf2af8063a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:53.931924 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-63c4e30f-00f2-4e6d-b5c0-6bf2af8063a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:54.065927 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-63c4e30f-00f2-4e6d-b5c0-6bf2af8063a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:54.073903 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-63c4e30f-00f2-4e6d-b5c0-6bf2af8063a0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1514 microversion: 2.1 time: 0.155871 Nov 02 23:42:54.074494 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2601/3176] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:53 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:55.090678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4bb51222-48d5-4e71-910f-6a391dc69cbd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:55.091349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4bb51222-48d5-4e71-910f-6a391dc69cbd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:55.101244 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4bb51222-48d5-4e71-910f-6a391dc69cbd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:55.101699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4bb51222-48d5-4e71-910f-6a391dc69cbd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:55.102539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4bb51222-48d5-4e71-910f-6a391dc69cbd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:55.103003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4bb51222-48d5-4e71-910f-6a391dc69cbd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:55.642763 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4bb51222-48d5-4e71-910f-6a391dc69cbd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:55.661934 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4bb51222-48d5-4e71-910f-6a391dc69cbd tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1514 microversion: 2.1 time: 0.575365 Nov 02 23:42:55.663489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2602/3177] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:55 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1514 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:55.936679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-965c187f-9c15-4764-b8ef-84f19c6a8414 req-e6eb3a77-b8fa-4e09-8a3d-f44c2f21c1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21eb9b39-67de-489a-aa38-4f0b94947a68", "name": "network-vif-deleted", "tag": "8c7d0507-2ba2-4059-80b8-14aa3f7ce582"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:42:55.938909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:42:55.938909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:42:55.948125 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-965c187f-9c15-4764-b8ef-84f19c6a8414 req-e6eb3a77-b8fa-4e09-8a3d-f44c2f21c1d3 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:55.949629 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-965c187f-9c15-4764-b8ef-84f19c6a8414 req-e6eb3a77-b8fa-4e09-8a3d-f44c2f21c1d3 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:55.969635 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-965c187f-9c15-4764-b8ef-84f19c6a8414 req-e6eb3a77-b8fa-4e09-8a3d-f44c2f21c1d3 service nova] Creating event network-vif-deleted:8c7d0507-2ba2-4059-80b8-14aa3f7ce582 for instance 21eb9b39-67de-489a-aa38-4f0b94947a68 on hv-cinder-81584 Nov 02 23:42:55.977093 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-965c187f-9c15-4764-b8ef-84f19c6a8414 req-e6eb3a77-b8fa-4e09-8a3d-f44c2f21c1d3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.311571 Nov 02 23:42:55.978274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2603/3178] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:42:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:42:56.680126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-095c74b9-6814-4b54-861b-722da576c168 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:56.681632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-095c74b9-6814-4b54-861b-722da576c168 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:56.687294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-095c74b9-6814-4b54-861b-722da576c168 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:56.687737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-095c74b9-6814-4b54-861b-722da576c168 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:56.688493 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-095c74b9-6814-4b54-861b-722da576c168 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:56.688919 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-095c74b9-6814-4b54-861b-722da576c168 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:56.748519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-095c74b9-6814-4b54-861b-722da576c168 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:56.755551 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-095c74b9-6814-4b54-861b-722da576c168 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1472 microversion: 2.1 time: 0.080954 Nov 02 23:42:56.756107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2604/3179] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:56 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1472 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:42:57.772630 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0311e49b-6727-4b09-843e-202cafa096c0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:57.773311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0311e49b-6727-4b09-843e-202cafa096c0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:57.779768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0311e49b-6727-4b09-843e-202cafa096c0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:57.780252 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0311e49b-6727-4b09-843e-202cafa096c0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:57.781085 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0311e49b-6727-4b09-843e-202cafa096c0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:57.781612 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0311e49b-6727-4b09-843e-202cafa096c0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:57.863600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0311e49b-6727-4b09-843e-202cafa096c0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:57.871428 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0311e49b-6727-4b09-843e-202cafa096c0 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1472 microversion: 2.1 time: 0.102472 Nov 02 23:42:57.871981 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2605/3180] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:57 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1472 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:58.003869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-f3e2b054-d262-4828-8a3c-7e2d38939880 req-f78a1bc0-1bca-4daa-9667-ed6cd29ac87e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac92ad6f-13c2-4a74-bf07-98d2935a9b26", "name": "network-vif-deleted", "tag": "cf4d550b-19f6-4434-904e-99469026b6db"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:42:58.005373 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:42:58.005373 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:42:58.012967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-f3e2b054-d262-4828-8a3c-7e2d38939880 req-f78a1bc0-1bca-4daa-9667-ed6cd29ac87e service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:58.013401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-f3e2b054-d262-4828-8a3c-7e2d38939880 req-f78a1bc0-1bca-4daa-9667-ed6cd29ac87e service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:58.024580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-f3e2b054-d262-4828-8a3c-7e2d38939880 req-f78a1bc0-1bca-4daa-9667-ed6cd29ac87e service nova] Creating event network-vif-deleted:cf4d550b-19f6-4434-904e-99469026b6db for instance ac92ad6f-13c2-4a74-bf07-98d2935a9b26 on hv-cinder-81584 Nov 02 23:42:58.029450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-f3e2b054-d262-4828-8a3c-7e2d38939880 req-f78a1bc0-1bca-4daa-9667-ed6cd29ac87e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029054 Nov 02 23:42:58.030078 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2606/3181] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:42:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:42:58.889890 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e411c564-b8a2-4b2d-99f4-bc263c916f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:58.890583 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e411c564-b8a2-4b2d-99f4-bc263c916f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:58.896593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e411c564-b8a2-4b2d-99f4-bc263c916f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:58.897043 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e411c564-b8a2-4b2d-99f4-bc263c916f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:58.897801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e411c564-b8a2-4b2d-99f4-bc263c916f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:58.898234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e411c564-b8a2-4b2d-99f4-bc263c916f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:58.956723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e411c564-b8a2-4b2d-99f4-bc263c916f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:42:58.964403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e411c564-b8a2-4b2d-99f4-bc263c916f7d tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1472 microversion: 2.1 time: 0.079042 Nov 02 23:42:58.964988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2607/3182] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:58 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1472 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:42:59.982664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2d6c7488-5cbc-498c-a26f-a742b5a269ab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:42:59.983432 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2d6c7488-5cbc-498c-a26f-a742b5a269ab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:42:59.989795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d6c7488-5cbc-498c-a26f-a742b5a269ab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:59.990240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d6c7488-5cbc-498c-a26f-a742b5a269ab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:42:59.991031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d6c7488-5cbc-498c-a26f-a742b5a269ab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:42:59.991461 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d6c7488-5cbc-498c-a26f-a742b5a269ab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:43:00.030684 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d6c7488-5cbc-498c-a26f-a742b5a269ab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:43:00.031155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2d6c7488-5cbc-498c-a26f-a742b5a269ab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:43:00.031968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.objects.instance [None req-2d6c7488-5cbc-498c-a26f-a742b5a269ab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lazy-loading 'fault' on Instance uuid ac92ad6f-13c2-4a74-bf07-98d2935a9b26 {{(pid=115800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 23:43:00.101490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2d6c7488-5cbc-498c-a26f-a742b5a269ab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a16c3887f94b4d825e21e2fe34e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f70e69ec3db4f378ac856e1e93b45e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:43:00.108621 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2d6c7488-5cbc-498c-a26f-a742b5a269ab tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 200 len: 1308 microversion: 2.1 time: 0.131124 Nov 02 23:43:00.109179 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2608/3183] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:42:59 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 1308 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:43:01.130991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d9f74210-fe81-4ec2-a825-50503b8352a5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:43:01.130991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d9f74210-fe81-4ec2-a825-50503b8352a5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] [instance: ac92ad6f-13c2-4a74-bf07-98d2935a9b26] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:43:01.132202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9f74210-fe81-4ec2-a825-50503b8352a5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:43:01.132866 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9f74210-fe81-4ec2-a825-50503b8352a5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:43:01.133664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9f74210-fe81-4ec2-a825-50503b8352a5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:43:01.134096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9f74210-fe81-4ec2-a825-50503b8352a5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:43:01.147704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-d9f74210-fe81-4ec2-a825-50503b8352a5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] HTTP exception thrown: Instance ac92ad6f-13c2-4a74-bf07-98d2935a9b26 could not be found. Nov 02 23:43:01.148296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d9f74210-fe81-4ec2-a825-50503b8352a5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] Returning 404 to user: Instance ac92ad6f-13c2-4a74-bf07-98d2935a9b26 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:43:01.149243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d9f74210-fe81-4ec2-a825-50503b8352a5 tempest-AttachVolumeNegativeTest-1245381785 tempest-AttachVolumeNegativeTest-1245381785-project] 10.222.0.41 "GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26" status: 404 len: 111 microversion: 2.1 time: 0.027536 Nov 02 23:43:01.149790 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2609/3184] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:43:01 2021] GET /compute/v2.1/servers/ac92ad6f-13c2-4a74-bf07-98d2935a9b26 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 23:43:20.524378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1ef8f1cf-6fbd-4958-8b21-4edb5750f900 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Action: 'create', calling method: .version_select at 0x7fd858361c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-204735838"}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:43:20.546638 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-1ef8f1cf-6fbd-4958-8b21-4edb5750f900 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Getting quotas for project 8bfa88b966b74bb8a210e5c128cd055f. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:43:20.551211 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-1ef8f1cf-6fbd-4958-8b21-4edb5750f900 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Getting quotas for user 158606c8e7a343e398b51938b828d2e9 and project 8bfa88b966b74bb8a210e5c128cd055f. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:43:20.747192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-1ef8f1cf-6fbd-4958-8b21-4edb5750f900 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Getting quotas for project 8bfa88b966b74bb8a210e5c128cd055f. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:43:20.751248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-1ef8f1cf-6fbd-4958-8b21-4edb5750f900 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Getting quotas for user 158606c8e7a343e398b51938b828d2e9 and project 8bfa88b966b74bb8a210e5c128cd055f. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:43:20.765186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1ef8f1cf-6fbd-4958-8b21-4edb5750f900 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.514184 Nov 02 23:43:20.765784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2610/3185] 10.222.0.41 () {60 vars in 1157 bytes} [Tue Nov 2 23:43:20 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:43:56.848309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:43:56.848872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:43:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 23:44:03.009808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-66b64c51-57c7-4faa-9761-ab8124faef7f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1001120956", "imageRef": "4159c567-fd66-4bbb-9bf4-6ce0afd65d88", "flavorRef": "452"}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:44:03.273605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.network.neutron [None req-66b64c51-57c7-4faa-9761-ab8124faef7f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] validate_networks() for None {{(pid=115800) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 23:44:03.623095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-66b64c51-57c7-4faa-9761-ab8124faef7f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Flavor limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 23:44:03.623585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-66b64c51-57c7-4faa-9761-ab8124faef7f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Image limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 23:44:03.624087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-66b64c51-57c7-4faa-9761-ab8124faef7f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Flavor pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 23:44:03.624490 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-66b64c51-57c7-4faa-9761-ab8124faef7f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Image pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 23:44:03.624903 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-66b64c51-57c7-4faa-9761-ab8124faef7f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 23:44:03.633641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66b64c51-57c7-4faa-9761-ab8124faef7f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:03.634243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66b64c51-57c7-4faa-9761-ab8124faef7f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:03.635122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66b64c51-57c7-4faa-9761-ab8124faef7f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:03.635583 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66b64c51-57c7-4faa-9761-ab8124faef7f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:03.654152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-66b64c51-57c7-4faa-9761-ab8124faef7f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Getting quotas for project 8ef76418186e4ae798604939bc87a46c. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:44:03.658018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-66b64c51-57c7-4faa-9761-ab8124faef7f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Getting quotas for user 3996bec51ee54f3fb3c8762dffde217a and project 8ef76418186e4ae798604939bc87a46c. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:44:03.669420 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-66b64c51-57c7-4faa-9761-ab8124faef7f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Going to run 1 instances... {{(pid=115800) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 23:44:03.671772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-66b64c51-57c7-4faa-9761-ab8124faef7f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] [instance: e5ca1b7a-26ab-49b8-bc41-ecb553af8944] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4159c567-fd66-4bbb-9bf4-6ce0afd65d88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 23:44:03.718992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-66b64c51-57c7-4faa-9761-ab8124faef7f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.712872 Nov 02 23:44:03.719636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2611/3186] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 2 23:44:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 23:44:03.735930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f06861ed-b715-4e72-81d1-acbb68c89c14 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:03.737168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f06861ed-b715-4e72-81d1-acbb68c89c14 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] [instance: e5ca1b7a-26ab-49b8-bc41-ecb553af8944] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:03.799757 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f06861ed-b715-4e72-81d1-acbb68c89c14 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3996bec51ee54f3fb3c8762dffde217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef76418186e4ae798604939bc87a46c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:03.807263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f06861ed-b715-4e72-81d1-acbb68c89c14 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] 10.222.0.41 "GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944" status: 200 len: 1215 microversion: 2.1 time: 0.081914 Nov 02 23:44:03.807864 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2612/3187] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:03 2021] GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944 => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:44:04.824140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-deb07dcf-2ed0-4236-b941-30ca64626a45 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:04.824797 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-deb07dcf-2ed0-4236-b941-30ca64626a45 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] [instance: e5ca1b7a-26ab-49b8-bc41-ecb553af8944] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:04.831376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-deb07dcf-2ed0-4236-b941-30ca64626a45 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:04.831835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-deb07dcf-2ed0-4236-b941-30ca64626a45 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:04.832612 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-deb07dcf-2ed0-4236-b941-30ca64626a45 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:04.833049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-deb07dcf-2ed0-4236-b941-30ca64626a45 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:04.895190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-deb07dcf-2ed0-4236-b941-30ca64626a45 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3996bec51ee54f3fb3c8762dffde217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef76418186e4ae798604939bc87a46c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:04.909154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-deb07dcf-2ed0-4236-b941-30ca64626a45 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] 10.222.0.41 "GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944" status: 200 len: 1267 microversion: 2.1 time: 0.088614 Nov 02 23:44:04.919653 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2613/3188] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:04 2021] GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944 => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:44:05.928888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-404a83b6-418e-483e-ac93-3f1605ce2f55 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:05.929556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-404a83b6-418e-483e-ac93-3f1605ce2f55 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] [instance: e5ca1b7a-26ab-49b8-bc41-ecb553af8944] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:05.936768 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-404a83b6-418e-483e-ac93-3f1605ce2f55 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:05.937217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-404a83b6-418e-483e-ac93-3f1605ce2f55 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:05.938006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-404a83b6-418e-483e-ac93-3f1605ce2f55 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:05.938446 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-404a83b6-418e-483e-ac93-3f1605ce2f55 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:06.008772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-404a83b6-418e-483e-ac93-3f1605ce2f55 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3996bec51ee54f3fb3c8762dffde217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef76418186e4ae798604939bc87a46c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:06.017316 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-404a83b6-418e-483e-ac93-3f1605ce2f55 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] 10.222.0.41 "GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944" status: 200 len: 1273 microversion: 2.1 time: 0.094091 Nov 02 23:44:06.024900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2614/3189] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:05 2021] GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944 => generated 1273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:44:06.896087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-784d607b-6160-4112-827c-1e3de0e900f6 req-d991f3c9-5b6b-415f-b24b-b129ab028709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5ca1b7a-26ab-49b8-bc41-ecb553af8944", "tag": "21980c16-68dd-47f0-bb99-7481f5775e34"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:44:06.898248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:44:06.898248 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:44:06.909654 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-784d607b-6160-4112-827c-1e3de0e900f6 req-d991f3c9-5b6b-415f-b24b-b129ab028709 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:06.910489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-784d607b-6160-4112-827c-1e3de0e900f6 req-d991f3c9-5b6b-415f-b24b-b129ab028709 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:06.927290 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-784d607b-6160-4112-827c-1e3de0e900f6 req-d991f3c9-5b6b-415f-b24b-b129ab028709 service nova] Creating event network-changed:21980c16-68dd-47f0-bb99-7481f5775e34 for instance e5ca1b7a-26ab-49b8-bc41-ecb553af8944 on hv-cinder-81584 Nov 02 23:44:06.934457 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-784d607b-6160-4112-827c-1e3de0e900f6 req-d991f3c9-5b6b-415f-b24b-b129ab028709 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043265 Nov 02 23:44:06.935468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2615/3190] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:44:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:44:07.036345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3657d005-7b51-41a2-8035-21774f8874f3 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:07.037052 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3657d005-7b51-41a2-8035-21774f8874f3 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] [instance: e5ca1b7a-26ab-49b8-bc41-ecb553af8944] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:07.044542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3657d005-7b51-41a2-8035-21774f8874f3 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:07.044996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3657d005-7b51-41a2-8035-21774f8874f3 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:07.045795 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3657d005-7b51-41a2-8035-21774f8874f3 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:07.046472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3657d005-7b51-41a2-8035-21774f8874f3 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:07.194013 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3657d005-7b51-41a2-8035-21774f8874f3 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3996bec51ee54f3fb3c8762dffde217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef76418186e4ae798604939bc87a46c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:07.201242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3657d005-7b51-41a2-8035-21774f8874f3 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] 10.222.0.41 "GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944" status: 200 len: 1315 microversion: 2.1 time: 0.169415 Nov 02 23:44:07.201855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2616/3191] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:07 2021] GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:44:07.696250 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d9a03168-db02-4595-9873-d313237cd499 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-859442884", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-204735838", "security_groups": [{"name": "tempest-secgroup-smoke-1962067282"}], "networks": [{"uuid": "9f19f645-ea1b-4f66-8f9c-0a5440e3be5b"}], "block_device_mapping_v2": [{"uuid": "d37774e9-719c-4b63-8f40-97dc76362899", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:44:07.813095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.network.neutron [None req-d9a03168-db02-4595-9873-d313237cd499 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] validate_networks() for [('9f19f645-ea1b-4f66-8f9c-0a5440e3be5b', None, None, None, None, None)] {{(pid=115800) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 23:44:08.322145 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-d9a03168-db02-4595-9873-d313237cd499 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Flavor limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 23:44:08.323221 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-d9a03168-db02-4595-9873-d313237cd499 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Image limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 23:44:08.323865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-d9a03168-db02-4595-9873-d313237cd499 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Flavor pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 23:44:08.324379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-d9a03168-db02-4595-9873-d313237cd499 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Image pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 23:44:08.324865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-d9a03168-db02-4595-9873-d313237cd499 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 23:44:08.336062 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9a03168-db02-4595-9873-d313237cd499 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:08.336509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9a03168-db02-4595-9873-d313237cd499 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:08.337310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9a03168-db02-4595-9873-d313237cd499 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:08.337773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9a03168-db02-4595-9873-d313237cd499 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:08.354127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-d9a03168-db02-4595-9873-d313237cd499 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Getting quotas for project 8bfa88b966b74bb8a210e5c128cd055f. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:44:08.358741 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-d9a03168-db02-4595-9873-d313237cd499 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Getting quotas for user 158606c8e7a343e398b51938b828d2e9 and project 8bfa88b966b74bb8a210e5c128cd055f. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:44:08.413071 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d9a03168-db02-4595-9873-d313237cd499 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Going to run 1 instances... {{(pid=115800) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 23:44:08.415226 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d9a03168-db02-4595-9873-d313237cd499 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d37774e9-719c-4b63-8f40-97dc76362899',volume_size=None,volume_type=None)] {{(pid=115800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 23:44:08.552895 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d9a03168-db02-4595-9873-d313237cd499 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.860140 Nov 02 23:44:08.553769 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2617/3192] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 2 23:44:07 2021] POST /compute/v2.1/servers => generated 406 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 23:44:08.558505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e6e5cf6a-cf4d-4e64-bac2-75a37dd16c07 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:08.562422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e6e5cf6a-cf4d-4e64-bac2-75a37dd16c07 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] [instance: e5ca1b7a-26ab-49b8-bc41-ecb553af8944] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:08.571022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e6e5cf6a-cf4d-4e64-bac2-75a37dd16c07 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:08.571650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e6e5cf6a-cf4d-4e64-bac2-75a37dd16c07 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:08.573548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e6e5cf6a-cf4d-4e64-bac2-75a37dd16c07 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:08.574237 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e6e5cf6a-cf4d-4e64-bac2-75a37dd16c07 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:08.743370 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e6e5cf6a-cf4d-4e64-bac2-75a37dd16c07 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3996bec51ee54f3fb3c8762dffde217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef76418186e4ae798604939bc87a46c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:08.751642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e6e5cf6a-cf4d-4e64-bac2-75a37dd16c07 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] 10.222.0.41 "GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944" status: 200 len: 1315 microversion: 2.1 time: 0.195887 Nov 02 23:44:08.763045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2618/3193] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:08 2021] GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:44:08.769333 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9e1a5d10-62f3-4bf4-9cf4-133df8e74964 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:08.769957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9e1a5d10-62f3-4bf4-9cf4-133df8e74964 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:08.830146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9e1a5d10-62f3-4bf4-9cf4-133df8e74964 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:08.836699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9e1a5d10-62f3-4bf4-9cf4-133df8e74964 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1087 microversion: 2.1 time: 0.083099 Nov 02 23:44:08.837386 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2619/3194] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:08 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1087 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:44:09.770600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2e99c26f-f021-4905-99db-cf55814ea8c0 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:09.771216 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2e99c26f-f021-4905-99db-cf55814ea8c0 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] [instance: e5ca1b7a-26ab-49b8-bc41-ecb553af8944] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:09.778859 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2e99c26f-f021-4905-99db-cf55814ea8c0 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:09.779454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2e99c26f-f021-4905-99db-cf55814ea8c0 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:09.780295 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2e99c26f-f021-4905-99db-cf55814ea8c0 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:09.780796 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2e99c26f-f021-4905-99db-cf55814ea8c0 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:09.916644 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2e99c26f-f021-4905-99db-cf55814ea8c0 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3996bec51ee54f3fb3c8762dffde217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef76418186e4ae798604939bc87a46c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:09.924536 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2e99c26f-f021-4905-99db-cf55814ea8c0 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] 10.222.0.41 "GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944" status: 200 len: 1315 microversion: 2.1 time: 0.157701 Nov 02 23:44:09.925102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2620/3195] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:09 2021] GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:44:09.929266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-9aac2dcf-da3a-404b-820f-7036038c2792 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:09.929872 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-9aac2dcf-da3a-404b-820f-7036038c2792 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:09.935584 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9aac2dcf-da3a-404b-820f-7036038c2792 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:09.936036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9aac2dcf-da3a-404b-820f-7036038c2792 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:09.936800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9aac2dcf-da3a-404b-820f-7036038c2792 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:09.937243 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-9aac2dcf-da3a-404b-820f-7036038c2792 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:09.995292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-9aac2dcf-da3a-404b-820f-7036038c2792 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:10.002410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-9aac2dcf-da3a-404b-820f-7036038c2792 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1203 microversion: 2.1 time: 0.076366 Nov 02 23:44:10.002999 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2621/3196] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:09 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1203 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:44:10.941686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-920e2694-ada3-432c-a936-a25db98b1308 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:10.943125 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-920e2694-ada3-432c-a936-a25db98b1308 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] [instance: e5ca1b7a-26ab-49b8-bc41-ecb553af8944] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:10.951834 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-920e2694-ada3-432c-a936-a25db98b1308 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:10.953376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-920e2694-ada3-432c-a936-a25db98b1308 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:10.955716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-920e2694-ada3-432c-a936-a25db98b1308 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:10.957037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-920e2694-ada3-432c-a936-a25db98b1308 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:11.251996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-920e2694-ada3-432c-a936-a25db98b1308 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3996bec51ee54f3fb3c8762dffde217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef76418186e4ae798604939bc87a46c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:11.263893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-920e2694-ada3-432c-a936-a25db98b1308 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] 10.222.0.41 "GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944" status: 200 len: 1315 microversion: 2.1 time: 0.324585 Nov 02 23:44:11.274086 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2622/3197] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:10 2021] GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:44:11.282436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-eba2d045-74bd-4df5-b399-c49357a3c5ce tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:11.283739 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-eba2d045-74bd-4df5-b399-c49357a3c5ce tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:11.293496 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eba2d045-74bd-4df5-b399-c49357a3c5ce tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:11.294937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eba2d045-74bd-4df5-b399-c49357a3c5ce tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:11.295917 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eba2d045-74bd-4df5-b399-c49357a3c5ce tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:11.296574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-eba2d045-74bd-4df5-b399-c49357a3c5ce tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:11.514623 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-eba2d045-74bd-4df5-b399-c49357a3c5ce tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:11.524710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-eba2d045-74bd-4df5-b399-c49357a3c5ce tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1271 microversion: 2.1 time: 0.249201 Nov 02 23:44:11.527002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2623/3198] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:11 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1271 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:44:11.535240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-96ab3030-c564-4950-b6a8-9538fff6564d req-0f5a22ab-38eb-4983-b146-d494b4a849ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a5250e-9bbd-4b25-b636-be74c540c2e0", "tag": "2164064c-8a25-4db4-90c4-9e83b8647e2f"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:44:11.535240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:44:11.535240 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:44:11.540113 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-96ab3030-c564-4950-b6a8-9538fff6564d req-0f5a22ab-38eb-4983-b146-d494b4a849ea service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:11.540555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-96ab3030-c564-4950-b6a8-9538fff6564d req-0f5a22ab-38eb-4983-b146-d494b4a849ea service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:11.553029 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-96ab3030-c564-4950-b6a8-9538fff6564d req-0f5a22ab-38eb-4983-b146-d494b4a849ea service nova] Creating event network-changed:2164064c-8a25-4db4-90c4-9e83b8647e2f for instance 11a5250e-9bbd-4b25-b636-be74c540c2e0 on hv-cinder-81584 Nov 02 23:44:11.558806 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-96ab3030-c564-4950-b6a8-9538fff6564d req-0f5a22ab-38eb-4983-b146-d494b4a849ea service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030441 Nov 02 23:44:11.559716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2624/3199] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:44:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:44:12.281893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f780849f-349a-4361-b96d-059c5e6f2bb0 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:12.282749 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f780849f-349a-4361-b96d-059c5e6f2bb0 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] [instance: e5ca1b7a-26ab-49b8-bc41-ecb553af8944] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:12.289328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f780849f-349a-4361-b96d-059c5e6f2bb0 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:12.289770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f780849f-349a-4361-b96d-059c5e6f2bb0 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:12.290529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f780849f-349a-4361-b96d-059c5e6f2bb0 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:12.290973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f780849f-349a-4361-b96d-059c5e6f2bb0 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:12.417250 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f780849f-349a-4361-b96d-059c5e6f2bb0 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3996bec51ee54f3fb3c8762dffde217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef76418186e4ae798604939bc87a46c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:12.424364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f780849f-349a-4361-b96d-059c5e6f2bb0 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] 10.222.0.41 "GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944" status: 200 len: 1315 microversion: 2.1 time: 0.146721 Nov 02 23:44:12.424929 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2625/3200] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:12 2021] GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:44:12.543118 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-135025fd-c17f-4455-98f5-84b498d9fac4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:12.543641 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-135025fd-c17f-4455-98f5-84b498d9fac4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:12.549354 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-135025fd-c17f-4455-98f5-84b498d9fac4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:12.549799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-135025fd-c17f-4455-98f5-84b498d9fac4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:12.550585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-135025fd-c17f-4455-98f5-84b498d9fac4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:12.551056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-135025fd-c17f-4455-98f5-84b498d9fac4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:12.685187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-135025fd-c17f-4455-98f5-84b498d9fac4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:12.693182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-135025fd-c17f-4455-98f5-84b498d9fac4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1259 microversion: 2.1 time: 0.154255 Nov 02 23:44:12.693740 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2626/3201] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:12 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:44:13.115820 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-f1511a22-3117-4626-8dab-0ec9d0b1f71c req-58d022e0-933b-4136-a249-57afec65e990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ca1b7a-26ab-49b8-bc41-ecb553af8944", "name": "network-vif-plugged", "status": "completed", "tag": "21980c16-68dd-47f0-bb99-7481f5775e34"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:44:13.117512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:44:13.117512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:44:13.124245 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-f1511a22-3117-4626-8dab-0ec9d0b1f71c req-58d022e0-933b-4136-a249-57afec65e990 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:13.124694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-f1511a22-3117-4626-8dab-0ec9d0b1f71c req-58d022e0-933b-4136-a249-57afec65e990 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:13.136425 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-f1511a22-3117-4626-8dab-0ec9d0b1f71c req-58d022e0-933b-4136-a249-57afec65e990 service nova] Creating event network-vif-plugged:21980c16-68dd-47f0-bb99-7481f5775e34 for instance e5ca1b7a-26ab-49b8-bc41-ecb553af8944 on hv-cinder-81584 Nov 02 23:44:13.141281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-f1511a22-3117-4626-8dab-0ec9d0b1f71c req-58d022e0-933b-4136-a249-57afec65e990 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159745 Nov 02 23:44:13.141874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2627/3202] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:44:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:44:13.442191 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f77e6edd-059b-439f-85e5-13554cb20fac tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:13.442891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f77e6edd-059b-439f-85e5-13554cb20fac tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] [instance: e5ca1b7a-26ab-49b8-bc41-ecb553af8944] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:13.449500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f77e6edd-059b-439f-85e5-13554cb20fac tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:13.449946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f77e6edd-059b-439f-85e5-13554cb20fac tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:13.450715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f77e6edd-059b-439f-85e5-13554cb20fac tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:13.451173 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f77e6edd-059b-439f-85e5-13554cb20fac tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:13.583278 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f77e6edd-059b-439f-85e5-13554cb20fac tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3996bec51ee54f3fb3c8762dffde217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef76418186e4ae798604939bc87a46c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:13.590586 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f77e6edd-059b-439f-85e5-13554cb20fac tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] 10.222.0.41 "GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944" status: 200 len: 1315 microversion: 2.1 time: 0.152867 Nov 02 23:44:13.591175 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2628/3203] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:13 2021] GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:44:13.709312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c095959a-c27b-4612-bb52-0a630e37ca23 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:13.709908 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c095959a-c27b-4612-bb52-0a630e37ca23 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:13.716103 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c095959a-c27b-4612-bb52-0a630e37ca23 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:13.716546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c095959a-c27b-4612-bb52-0a630e37ca23 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:13.717309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c095959a-c27b-4612-bb52-0a630e37ca23 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:13.717772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c095959a-c27b-4612-bb52-0a630e37ca23 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:13.853431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c095959a-c27b-4612-bb52-0a630e37ca23 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:13.861155 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c095959a-c27b-4612-bb52-0a630e37ca23 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1259 microversion: 2.1 time: 0.155480 Nov 02 23:44:13.861710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2629/3204] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:13 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:44:14.606987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-173f5105-917f-4efd-a662-991294f2c5eb tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:14.608238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-173f5105-917f-4efd-a662-991294f2c5eb tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] [instance: e5ca1b7a-26ab-49b8-bc41-ecb553af8944] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:14.614414 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-173f5105-917f-4efd-a662-991294f2c5eb tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:14.614858 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-173f5105-917f-4efd-a662-991294f2c5eb tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:14.615642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-173f5105-917f-4efd-a662-991294f2c5eb tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:14.616069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-173f5105-917f-4efd-a662-991294f2c5eb tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:14.744140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-173f5105-917f-4efd-a662-991294f2c5eb tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3996bec51ee54f3fb3c8762dffde217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef76418186e4ae798604939bc87a46c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:14.751349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-173f5105-917f-4efd-a662-991294f2c5eb tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] 10.222.0.41 "GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944" status: 200 len: 1315 microversion: 2.1 time: 0.148034 Nov 02 23:44:14.751912 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2630/3205] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:14 2021] GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:44:14.877235 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8226ca91-f0ab-487b-a9c8-339d9b8720b4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:14.877880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8226ca91-f0ab-487b-a9c8-339d9b8720b4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:14.883775 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8226ca91-f0ab-487b-a9c8-339d9b8720b4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:14.884222 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8226ca91-f0ab-487b-a9c8-339d9b8720b4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:14.884996 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8226ca91-f0ab-487b-a9c8-339d9b8720b4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:14.886044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8226ca91-f0ab-487b-a9c8-339d9b8720b4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:15.056700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8226ca91-f0ab-487b-a9c8-339d9b8720b4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:15.066003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8226ca91-f0ab-487b-a9c8-339d9b8720b4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1259 microversion: 2.1 time: 0.192417 Nov 02 23:44:15.066573 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2631/3206] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:14 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:44:15.768116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-acac7a17-e384-498c-b825-c7ffc81da633 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:15.769123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-acac7a17-e384-498c-b825-c7ffc81da633 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] [instance: e5ca1b7a-26ab-49b8-bc41-ecb553af8944] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:15.776546 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-acac7a17-e384-498c-b825-c7ffc81da633 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:15.777108 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-acac7a17-e384-498c-b825-c7ffc81da633 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:15.777988 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-acac7a17-e384-498c-b825-c7ffc81da633 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:15.778665 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-acac7a17-e384-498c-b825-c7ffc81da633 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:15.915925 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-acac7a17-e384-498c-b825-c7ffc81da633 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3996bec51ee54f3fb3c8762dffde217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef76418186e4ae798604939bc87a46c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:15.923678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-acac7a17-e384-498c-b825-c7ffc81da633 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] 10.222.0.41 "GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944" status: 200 len: 1465 microversion: 2.1 time: 0.159391 Nov 02 23:44:15.924338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2632/3207] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:15 2021] GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944 => generated 1465 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:44:15.964950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-66ee202e-3bba-4d10-8d6d-10eaa4593ebf tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:15.965517 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-66ee202e-3bba-4d10-8d6d-10eaa4593ebf tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] [instance: e5ca1b7a-26ab-49b8-bc41-ecb553af8944] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:15.971341 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66ee202e-3bba-4d10-8d6d-10eaa4593ebf tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:15.971948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66ee202e-3bba-4d10-8d6d-10eaa4593ebf tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:15.972747 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66ee202e-3bba-4d10-8d6d-10eaa4593ebf tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:15.973177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-66ee202e-3bba-4d10-8d6d-10eaa4593ebf tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:15.997854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-66ee202e-3bba-4d10-8d6d-10eaa4593ebf tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] [instance: e5ca1b7a-26ab-49b8-bc41-ecb553af8944] Going to try to terminate instance {{(pid=115800) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 23:44:16.075867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-66ee202e-3bba-4d10-8d6d-10eaa4593ebf tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] 10.222.0.41 "DELETE /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944" status: 204 len: 0 microversion: 2.1 time: 0.114187 Nov 02 23:44:16.079715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2633/3208] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:44:15 2021] DELETE /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 23:44:16.085282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d2b251ab-bc47-428f-92e8-46a95903e736 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:16.085973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d2b251ab-bc47-428f-92e8-46a95903e736 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:16.094229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2b251ab-bc47-428f-92e8-46a95903e736 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:16.094730 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2b251ab-bc47-428f-92e8-46a95903e736 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:16.095538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2b251ab-bc47-428f-92e8-46a95903e736 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:16.095969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2b251ab-bc47-428f-92e8-46a95903e736 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:16.237194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d2b251ab-bc47-428f-92e8-46a95903e736 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:16.247552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d2b251ab-bc47-428f-92e8-46a95903e736 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1259 microversion: 2.1 time: 0.164912 Nov 02 23:44:16.247552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2634/3209] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:16 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:44:16.250642 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b98137d5-9cfd-432a-ad39-b7fd16262abe tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:16.251330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b98137d5-9cfd-432a-ad39-b7fd16262abe tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] [instance: e5ca1b7a-26ab-49b8-bc41-ecb553af8944] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:16.257156 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b98137d5-9cfd-432a-ad39-b7fd16262abe tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:16.257610 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b98137d5-9cfd-432a-ad39-b7fd16262abe tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:16.258384 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b98137d5-9cfd-432a-ad39-b7fd16262abe tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:16.258809 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b98137d5-9cfd-432a-ad39-b7fd16262abe tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:16.392115 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b98137d5-9cfd-432a-ad39-b7fd16262abe tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3996bec51ee54f3fb3c8762dffde217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef76418186e4ae798604939bc87a46c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:16.399279 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b98137d5-9cfd-432a-ad39-b7fd16262abe tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] 10.222.0.41 "GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944" status: 200 len: 1471 microversion: 2.1 time: 0.151952 Nov 02 23:44:16.399840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2635/3210] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:16 2021] GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944 => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:44:17.261887 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8c9ff422-5652-4af3-ac40-253c51435cd9 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:17.262476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8c9ff422-5652-4af3-ac40-253c51435cd9 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:17.269427 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c9ff422-5652-4af3-ac40-253c51435cd9 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:17.269949 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c9ff422-5652-4af3-ac40-253c51435cd9 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:17.270733 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c9ff422-5652-4af3-ac40-253c51435cd9 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:17.271201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c9ff422-5652-4af3-ac40-253c51435cd9 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:17.399345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8c9ff422-5652-4af3-ac40-253c51435cd9 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:17.406410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8c9ff422-5652-4af3-ac40-253c51435cd9 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1259 microversion: 2.1 time: 0.148911 Nov 02 23:44:17.406993 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2636/3211] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:17 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:44:17.416717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bd92e68f-5d8c-436b-aa29-d524f661f0c1 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:17.417322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bd92e68f-5d8c-436b-aa29-d524f661f0c1 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] [instance: e5ca1b7a-26ab-49b8-bc41-ecb553af8944] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:17.422990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bd92e68f-5d8c-436b-aa29-d524f661f0c1 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:17.423440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bd92e68f-5d8c-436b-aa29-d524f661f0c1 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:17.424203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bd92e68f-5d8c-436b-aa29-d524f661f0c1 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:17.424636 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bd92e68f-5d8c-436b-aa29-d524f661f0c1 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:17.560037 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bd92e68f-5d8c-436b-aa29-d524f661f0c1 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3996bec51ee54f3fb3c8762dffde217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef76418186e4ae798604939bc87a46c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:17.566762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bd92e68f-5d8c-436b-aa29-d524f661f0c1 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] 10.222.0.41 "GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944" status: 200 len: 1471 microversion: 2.1 time: 0.153464 Nov 02 23:44:17.567357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2637/3212] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:17 2021] GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:44:18.422473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c50b995b-fcde-4fd5-b01f-afa72811a0b3 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:18.423219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c50b995b-fcde-4fd5-b01f-afa72811a0b3 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:18.429315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c50b995b-fcde-4fd5-b01f-afa72811a0b3 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:18.429753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c50b995b-fcde-4fd5-b01f-afa72811a0b3 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:18.430759 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c50b995b-fcde-4fd5-b01f-afa72811a0b3 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:18.431219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c50b995b-fcde-4fd5-b01f-afa72811a0b3 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:18.568544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c50b995b-fcde-4fd5-b01f-afa72811a0b3 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:18.575840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c50b995b-fcde-4fd5-b01f-afa72811a0b3 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1259 microversion: 2.1 time: 0.157065 Nov 02 23:44:18.576421 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2638/3213] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:18 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:44:18.583339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-898127d7-9ea9-40ec-a678-422674a07066 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:18.584005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-898127d7-9ea9-40ec-a678-422674a07066 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] [instance: e5ca1b7a-26ab-49b8-bc41-ecb553af8944] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:18.590878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-898127d7-9ea9-40ec-a678-422674a07066 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:18.591344 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-898127d7-9ea9-40ec-a678-422674a07066 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:18.592120 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-898127d7-9ea9-40ec-a678-422674a07066 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:18.592708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-898127d7-9ea9-40ec-a678-422674a07066 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:18.733397 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-898127d7-9ea9-40ec-a678-422674a07066 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3996bec51ee54f3fb3c8762dffde217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef76418186e4ae798604939bc87a46c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:18.740689 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-898127d7-9ea9-40ec-a678-422674a07066 tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] 10.222.0.41 "GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944" status: 200 len: 1471 microversion: 2.1 time: 0.160780 Nov 02 23:44:18.741342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2639/3214] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:18 2021] GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944 => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:44:18.824803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-82c92fe6-9f8d-4cc6-9ede-040092924e50 req-739df686-6c99-4ab1-8e78-44bf229ed870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ca1b7a-26ab-49b8-bc41-ecb553af8944", "name": "network-vif-deleted", "tag": "21980c16-68dd-47f0-bb99-7481f5775e34"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:44:18.826505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:44:18.826505 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:44:18.833693 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-82c92fe6-9f8d-4cc6-9ede-040092924e50 req-739df686-6c99-4ab1-8e78-44bf229ed870 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:18.834136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-82c92fe6-9f8d-4cc6-9ede-040092924e50 req-739df686-6c99-4ab1-8e78-44bf229ed870 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:18.852342 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-82c92fe6-9f8d-4cc6-9ede-040092924e50 req-739df686-6c99-4ab1-8e78-44bf229ed870 service nova] Creating event network-vif-deleted:21980c16-68dd-47f0-bb99-7481f5775e34 for instance e5ca1b7a-26ab-49b8-bc41-ecb553af8944 on hv-cinder-81584 Nov 02 23:44:18.858062 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-82c92fe6-9f8d-4cc6-9ede-040092924e50 req-739df686-6c99-4ab1-8e78-44bf229ed870 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037209 Nov 02 23:44:18.858658 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2640/3215] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:44:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:44:19.592926 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b9ca5a51-ba4c-4937-bb9b-9d4644d610e5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:19.593626 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b9ca5a51-ba4c-4937-bb9b-9d4644d610e5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:19.599753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9ca5a51-ba4c-4937-bb9b-9d4644d610e5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:19.600200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9ca5a51-ba4c-4937-bb9b-9d4644d610e5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:19.600965 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9ca5a51-ba4c-4937-bb9b-9d4644d610e5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:19.601396 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9ca5a51-ba4c-4937-bb9b-9d4644d610e5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:19.736909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b9ca5a51-ba4c-4937-bb9b-9d4644d610e5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:19.744218 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b9ca5a51-ba4c-4937-bb9b-9d4644d610e5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1259 microversion: 2.1 time: 0.155953 Nov 02 23:44:19.744781 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2641/3216] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:19 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:44:19.756712 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e9bdcf9a-6745-4908-b80b-cbb9b7e6e52f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:19.757336 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e9bdcf9a-6745-4908-b80b-cbb9b7e6e52f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] [instance: e5ca1b7a-26ab-49b8-bc41-ecb553af8944] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:19.762786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9bdcf9a-6745-4908-b80b-cbb9b7e6e52f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:19.763289 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9bdcf9a-6745-4908-b80b-cbb9b7e6e52f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:19.764059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9bdcf9a-6745-4908-b80b-cbb9b7e6e52f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:19.764494 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9bdcf9a-6745-4908-b80b-cbb9b7e6e52f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:19.777122 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-e9bdcf9a-6745-4908-b80b-cbb9b7e6e52f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] HTTP exception thrown: Instance e5ca1b7a-26ab-49b8-bc41-ecb553af8944 could not be found. Nov 02 23:44:19.777696 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e9bdcf9a-6745-4908-b80b-cbb9b7e6e52f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] Returning 404 to user: Instance e5ca1b7a-26ab-49b8-bc41-ecb553af8944 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:44:19.778498 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e9bdcf9a-6745-4908-b80b-cbb9b7e6e52f tempest-VolumesNegativeTest-1614676921 tempest-VolumesNegativeTest-1614676921-project] 10.222.0.41 "GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944" status: 404 len: 111 microversion: 2.1 time: 0.025091 Nov 02 23:44:19.779036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2642/3217] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:19 2021] GET /compute/v2.1/servers/e5ca1b7a-26ab-49b8-bc41-ecb553af8944 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 23:44:20.761370 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-69e88a36-a521-4083-bd64-9eaf2f3689fa tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:20.762055 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-69e88a36-a521-4083-bd64-9eaf2f3689fa tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:20.768598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-69e88a36-a521-4083-bd64-9eaf2f3689fa tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:20.769113 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-69e88a36-a521-4083-bd64-9eaf2f3689fa tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:20.769946 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-69e88a36-a521-4083-bd64-9eaf2f3689fa tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:20.770448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-69e88a36-a521-4083-bd64-9eaf2f3689fa tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:20.925834 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-69e88a36-a521-4083-bd64-9eaf2f3689fa tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:20.936883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-69e88a36-a521-4083-bd64-9eaf2f3689fa tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1259 microversion: 2.1 time: 0.177086 Nov 02 23:44:20.936883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2643/3218] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:20 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:44:21.953700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bc75d020-3d6a-4b75-be7b-2202e99e60a5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:21.954333 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bc75d020-3d6a-4b75-be7b-2202e99e60a5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:21.961485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc75d020-3d6a-4b75-be7b-2202e99e60a5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:21.961957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc75d020-3d6a-4b75-be7b-2202e99e60a5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:21.962731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc75d020-3d6a-4b75-be7b-2202e99e60a5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:21.963202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bc75d020-3d6a-4b75-be7b-2202e99e60a5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:22.115860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bc75d020-3d6a-4b75-be7b-2202e99e60a5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:22.123331 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bc75d020-3d6a-4b75-be7b-2202e99e60a5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1259 microversion: 2.1 time: 0.173445 Nov 02 23:44:22.124602 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2644/3219] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:21 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:44:23.007049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-1a3926d4-7c46-4232-a91b-64ac7eec48ec req-c1c4c251-2da6-4893-adde-81615b02bff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a5250e-9bbd-4b25-b636-be74c540c2e0", "name": "network-vif-plugged", "status": "completed", "tag": "2164064c-8a25-4db4-90c4-9e83b8647e2f"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:44:23.008556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:44:23.008556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:44:23.016575 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-1a3926d4-7c46-4232-a91b-64ac7eec48ec req-c1c4c251-2da6-4893-adde-81615b02bff8 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:23.017020 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-1a3926d4-7c46-4232-a91b-64ac7eec48ec req-c1c4c251-2da6-4893-adde-81615b02bff8 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:23.030684 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-1a3926d4-7c46-4232-a91b-64ac7eec48ec req-c1c4c251-2da6-4893-adde-81615b02bff8 service nova] Creating event network-vif-plugged:2164064c-8a25-4db4-90c4-9e83b8647e2f for instance 11a5250e-9bbd-4b25-b636-be74c540c2e0 on hv-cinder-81584 Nov 02 23:44:23.035535 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-1a3926d4-7c46-4232-a91b-64ac7eec48ec req-c1c4c251-2da6-4893-adde-81615b02bff8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032134 Nov 02 23:44:23.036157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2645/3220] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:44:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:44:23.141804 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3d5e0ef6-3337-41dc-9a90-a33b87623a1f tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:23.142472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3d5e0ef6-3337-41dc-9a90-a33b87623a1f tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:23.148596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3d5e0ef6-3337-41dc-9a90-a33b87623a1f tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:23.149046 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3d5e0ef6-3337-41dc-9a90-a33b87623a1f tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:23.149807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3d5e0ef6-3337-41dc-9a90-a33b87623a1f tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:23.150238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3d5e0ef6-3337-41dc-9a90-a33b87623a1f tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:23.304716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3d5e0ef6-3337-41dc-9a90-a33b87623a1f tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:23.312761 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3d5e0ef6-3337-41dc-9a90-a33b87623a1f tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1259 microversion: 2.1 time: 0.175642 Nov 02 23:44:23.313410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2646/3221] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:23 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:44:24.330201 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5768047b-e9b9-44c4-96b3-ec3fc3b8a25d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:24.331014 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5768047b-e9b9-44c4-96b3-ec3fc3b8a25d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:24.340600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5768047b-e9b9-44c4-96b3-ec3fc3b8a25d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:24.341210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5768047b-e9b9-44c4-96b3-ec3fc3b8a25d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:24.342868 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5768047b-e9b9-44c4-96b3-ec3fc3b8a25d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:24.343338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5768047b-e9b9-44c4-96b3-ec3fc3b8a25d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:24.482349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5768047b-e9b9-44c4-96b3-ec3fc3b8a25d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:24.489527 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5768047b-e9b9-44c4-96b3-ec3fc3b8a25d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1259 microversion: 2.1 time: 0.164460 Nov 02 23:44:24.490084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2647/3222] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:24 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:44:25.506753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-13dfe86c-4f8b-45c2-809f-7b610807c8bc tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:25.507463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-13dfe86c-4f8b-45c2-809f-7b610807c8bc tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:25.516008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-13dfe86c-4f8b-45c2-809f-7b610807c8bc tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:25.516699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-13dfe86c-4f8b-45c2-809f-7b610807c8bc tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:25.517515 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-13dfe86c-4f8b-45c2-809f-7b610807c8bc tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:25.517955 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-13dfe86c-4f8b-45c2-809f-7b610807c8bc tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:25.821835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-13dfe86c-4f8b-45c2-809f-7b610807c8bc tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:25.830818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-13dfe86c-4f8b-45c2-809f-7b610807c8bc tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1442 microversion: 2.1 time: 0.328740 Nov 02 23:44:25.831632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2648/3223] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:25 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1442 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:44:25.850469 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-cd6131d4-58aa-412a-b854-74bc6eebf8c8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:44:25.851497 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-cd6131d4-58aa-412a-b854-74bc6eebf8c8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:44:25.860101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd6131d4-58aa-412a-b854-74bc6eebf8c8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:25.860556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd6131d4-58aa-412a-b854-74bc6eebf8c8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:25.861373 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd6131d4-58aa-412a-b854-74bc6eebf8c8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:25.861976 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-cd6131d4-58aa-412a-b854-74bc6eebf8c8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:26.152102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-cd6131d4-58aa-412a-b854-74bc6eebf8c8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:44:26.159715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-cd6131d4-58aa-412a-b854-74bc6eebf8c8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1442 microversion: 2.1 time: 0.314302 Nov 02 23:44:26.160672 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2649/3224] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:44:25 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1442 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:44:28.641280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-cdf53541-d743-41b4-b2eb-6b3acf10d46e req-66c16bf7-8924-463b-adb0-8e38e18ed3ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a5250e-9bbd-4b25-b636-be74c540c2e0", "tag": "2164064c-8a25-4db4-90c4-9e83b8647e2f"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:44:28.643618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:44:28.643618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:44:28.654601 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-cdf53541-d743-41b4-b2eb-6b3acf10d46e req-66c16bf7-8924-463b-adb0-8e38e18ed3ed service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:44:28.655305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-cdf53541-d743-41b4-b2eb-6b3acf10d46e req-66c16bf7-8924-463b-adb0-8e38e18ed3ed service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:44:28.669786 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-cdf53541-d743-41b4-b2eb-6b3acf10d46e req-66c16bf7-8924-463b-adb0-8e38e18ed3ed service nova] Creating event network-changed:2164064c-8a25-4db4-90c4-9e83b8647e2f for instance 11a5250e-9bbd-4b25-b636-be74c540c2e0 on hv-cinder-81584 Nov 02 23:44:28.677880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-cdf53541-d743-41b4-b2eb-6b3acf10d46e req-66c16bf7-8924-463b-adb0-8e38e18ed3ed service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042423 Nov 02 23:44:28.679095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2650/3225] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:44:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:44:34.760436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0879770e-83ac-4771-a526-7371f86e511d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Action: 'create', calling method: .version_select at 0x7fd85c6eab80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-426019499"}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:44:34.779754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-0879770e-83ac-4771-a526-7371f86e511d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Getting quotas for project efb44064bb93455f8407c8eec29a03f0. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:44:34.784167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-0879770e-83ac-4771-a526-7371f86e511d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Getting quotas for user 7be44ffed515408bafef59166c9d0175 and project efb44064bb93455f8407c8eec29a03f0. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:44:35.075727 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-0879770e-83ac-4771-a526-7371f86e511d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Getting quotas for project efb44064bb93455f8407c8eec29a03f0. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:44:35.079340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-0879770e-83ac-4771-a526-7371f86e511d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Getting quotas for user 7be44ffed515408bafef59166c9d0175 and project efb44064bb93455f8407c8eec29a03f0. Resources: {'key_pairs'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:44:35.092869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0879770e-83ac-4771-a526-7371f86e511d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.513367 Nov 02 23:44:35.093990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2651/3226] 10.222.0.41 () {60 vars in 1157 bytes} [Tue Nov 2 23:44:34 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:45:15.369084 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-6e2aba09-8ead-42d3-88e6-7031798465f9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-57198689", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-426019499", "security_groups": [{"name": "tempest-secgroup-smoke-1479964763"}], "block_device_mapping_v2": [{"uuid": "d27df533-1edb-4313-a0ae-6c1694e65fd2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6cf98e03-e201-449c-a229-2b590bdb1187"}]}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:45:15.476264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.network.neutron [None req-6e2aba09-8ead-42d3-88e6-7031798465f9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] validate_networks() for [('6cf98e03-e201-449c-a229-2b590bdb1187', None, None, None, None, None)] {{(pid=115800) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 23:45:15.837644 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-6e2aba09-8ead-42d3-88e6-7031798465f9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Flavor limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 23:45:15.838064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-6e2aba09-8ead-42d3-88e6-7031798465f9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Image limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 23:45:15.838603 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-6e2aba09-8ead-42d3-88e6-7031798465f9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Flavor pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 23:45:15.838956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-6e2aba09-8ead-42d3-88e6-7031798465f9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Image pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 23:45:15.839364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-6e2aba09-8ead-42d3-88e6-7031798465f9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 23:45:15.848444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e2aba09-8ead-42d3-88e6-7031798465f9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:15.848902 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e2aba09-8ead-42d3-88e6-7031798465f9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:15.849694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e2aba09-8ead-42d3-88e6-7031798465f9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:15.850119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-6e2aba09-8ead-42d3-88e6-7031798465f9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:15.865862 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-6e2aba09-8ead-42d3-88e6-7031798465f9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Getting quotas for project efb44064bb93455f8407c8eec29a03f0. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:45:15.869851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-6e2aba09-8ead-42d3-88e6-7031798465f9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Getting quotas for user 7be44ffed515408bafef59166c9d0175 and project efb44064bb93455f8407c8eec29a03f0. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:45:15.924516 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6e2aba09-8ead-42d3-88e6-7031798465f9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Going to run 1 instances... {{(pid=115800) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 23:45:15.926799 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-6e2aba09-8ead-42d3-88e6-7031798465f9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d27df533-1edb-4313-a0ae-6c1694e65fd2',volume_size=None,volume_type=None)] {{(pid=115800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 23:45:16.048275 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-6e2aba09-8ead-42d3-88e6-7031798465f9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.683053 Nov 02 23:45:16.049387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2652/3227] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 2 23:45:15 2021] POST /compute/v2.1/servers => generated 406 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 23:45:16.058860 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-25ed2bc1-3cf2-436f-be1b-f4a4218f43e2 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:45:16.059771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-25ed2bc1-3cf2-436f-be1b-f4a4218f43e2 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:45:16.111550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-25ed2bc1-3cf2-436f-be1b-f4a4218f43e2 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:45:16.118129 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-25ed2bc1-3cf2-436f-be1b-f4a4218f43e2 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 200 len: 1092 microversion: 2.1 time: 0.062870 Nov 02 23:45:16.127823 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2653/3228] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:45:16 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 1092 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:45:17.133933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f8c5bc50-ef4c-495f-9670-40602080e8fd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:45:17.134545 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f8c5bc50-ef4c-495f-9670-40602080e8fd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:45:17.147789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8c5bc50-ef4c-495f-9670-40602080e8fd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:17.148253 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8c5bc50-ef4c-495f-9670-40602080e8fd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:17.149043 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8c5bc50-ef4c-495f-9670-40602080e8fd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:17.149485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8c5bc50-ef4c-495f-9670-40602080e8fd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:17.217458 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f8c5bc50-ef4c-495f-9670-40602080e8fd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:45:17.225581 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f8c5bc50-ef4c-495f-9670-40602080e8fd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 200 len: 1208 microversion: 2.1 time: 0.095289 Nov 02 23:45:17.226281 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2654/3229] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:45:17 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 1208 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:45:18.243214 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2cd339f3-e455-4e03-be84-aa69a29c414a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:45:18.244650 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2cd339f3-e455-4e03-be84-aa69a29c414a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:45:18.252091 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2cd339f3-e455-4e03-be84-aa69a29c414a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:18.252620 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2cd339f3-e455-4e03-be84-aa69a29c414a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:18.253486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2cd339f3-e455-4e03-be84-aa69a29c414a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:18.254040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2cd339f3-e455-4e03-be84-aa69a29c414a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:18.392992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2cd339f3-e455-4e03-be84-aa69a29c414a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:45:18.400415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2cd339f3-e455-4e03-be84-aa69a29c414a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 200 len: 1264 microversion: 2.1 time: 0.160912 Nov 02 23:45:18.401057 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2655/3230] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:45:18 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:45:18.430670 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-3aa72994-bdcb-4f82-b025-4512b578cd09 req-75fa49a0-9ce2-46ab-955d-41308835575a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbde8758-7f43-4f8d-adef-8bbd2dfab2e8", "tag": "52407ebc-50ed-414a-b308-65e90ac03f63"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:45:18.433076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:45:18.433076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:45:18.452234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-3aa72994-bdcb-4f82-b025-4512b578cd09 req-75fa49a0-9ce2-46ab-955d-41308835575a service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:18.452611 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-3aa72994-bdcb-4f82-b025-4512b578cd09 req-75fa49a0-9ce2-46ab-955d-41308835575a service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:18.474572 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-3aa72994-bdcb-4f82-b025-4512b578cd09 req-75fa49a0-9ce2-46ab-955d-41308835575a service nova] Creating event network-changed:52407ebc-50ed-414a-b308-65e90ac03f63 for instance cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 on hv-cinder-81584 Nov 02 23:45:18.479508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-3aa72994-bdcb-4f82-b025-4512b578cd09 req-75fa49a0-9ce2-46ab-955d-41308835575a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058775 Nov 02 23:45:18.480459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2656/3231] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:45:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:45:19.418328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-695702f7-ca0a-45b0-b0a0-414e7c92ac9c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:45:19.419081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-695702f7-ca0a-45b0-b0a0-414e7c92ac9c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:45:19.425027 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-695702f7-ca0a-45b0-b0a0-414e7c92ac9c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:19.425477 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-695702f7-ca0a-45b0-b0a0-414e7c92ac9c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:19.426273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-695702f7-ca0a-45b0-b0a0-414e7c92ac9c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:19.426709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-695702f7-ca0a-45b0-b0a0-414e7c92ac9c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:19.557500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-695702f7-ca0a-45b0-b0a0-414e7c92ac9c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:45:19.564700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-695702f7-ca0a-45b0-b0a0-414e7c92ac9c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 200 len: 1264 microversion: 2.1 time: 0.150808 Nov 02 23:45:19.565283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2657/3232] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:45:19 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:45:20.581274 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dcf35ee8-529e-49c9-a88a-b62fe661b74f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:45:20.581909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dcf35ee8-529e-49c9-a88a-b62fe661b74f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:45:20.588548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dcf35ee8-529e-49c9-a88a-b62fe661b74f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:20.588984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dcf35ee8-529e-49c9-a88a-b62fe661b74f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:20.589734 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dcf35ee8-529e-49c9-a88a-b62fe661b74f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:20.590161 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dcf35ee8-529e-49c9-a88a-b62fe661b74f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:20.717292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dcf35ee8-529e-49c9-a88a-b62fe661b74f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:45:20.724448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dcf35ee8-529e-49c9-a88a-b62fe661b74f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 200 len: 1264 microversion: 2.1 time: 0.146868 Nov 02 23:45:20.725008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2658/3233] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:45:20 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:45:21.741348 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-aad1b7c2-7d14-4476-b017-6be5814a4b99 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:45:21.742042 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-aad1b7c2-7d14-4476-b017-6be5814a4b99 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:45:21.747914 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aad1b7c2-7d14-4476-b017-6be5814a4b99 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:21.748360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aad1b7c2-7d14-4476-b017-6be5814a4b99 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:21.749120 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aad1b7c2-7d14-4476-b017-6be5814a4b99 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:21.749560 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-aad1b7c2-7d14-4476-b017-6be5814a4b99 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:21.879969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-aad1b7c2-7d14-4476-b017-6be5814a4b99 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:45:21.887134 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-aad1b7c2-7d14-4476-b017-6be5814a4b99 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 200 len: 1264 microversion: 2.1 time: 0.150014 Nov 02 23:45:21.887704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2659/3234] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:45:21 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:45:22.903816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-235a542f-e8f0-455c-9972-61cf8a83fda9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:45:22.904448 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-235a542f-e8f0-455c-9972-61cf8a83fda9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:45:22.911098 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-235a542f-e8f0-455c-9972-61cf8a83fda9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:22.911541 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-235a542f-e8f0-455c-9972-61cf8a83fda9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:22.912293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-235a542f-e8f0-455c-9972-61cf8a83fda9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:22.912716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-235a542f-e8f0-455c-9972-61cf8a83fda9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:23.040936 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-235a542f-e8f0-455c-9972-61cf8a83fda9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:45:23.047984 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-235a542f-e8f0-455c-9972-61cf8a83fda9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 200 len: 1264 microversion: 2.1 time: 0.147804 Nov 02 23:45:23.048541 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2660/3235] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:45:22 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:45:24.065040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2c3a03b3-528a-499e-9f95-7a1ef0625b18 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:45:24.065652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2c3a03b3-528a-499e-9f95-7a1ef0625b18 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:45:24.072434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2c3a03b3-528a-499e-9f95-7a1ef0625b18 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:24.072871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2c3a03b3-528a-499e-9f95-7a1ef0625b18 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:24.073622 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2c3a03b3-528a-499e-9f95-7a1ef0625b18 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:24.074049 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2c3a03b3-528a-499e-9f95-7a1ef0625b18 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:24.201468 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2c3a03b3-528a-499e-9f95-7a1ef0625b18 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:45:24.208747 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2c3a03b3-528a-499e-9f95-7a1ef0625b18 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 200 len: 1264 microversion: 2.1 time: 0.147307 Nov 02 23:45:24.209717 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2661/3236] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:45:24 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:45:25.225375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-87858e55-3cf2-4a42-b948-e7cad60225b3 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:45:25.226087 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-87858e55-3cf2-4a42-b948-e7cad60225b3 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:45:25.232361 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87858e55-3cf2-4a42-b948-e7cad60225b3 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:25.232805 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87858e55-3cf2-4a42-b948-e7cad60225b3 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:25.233584 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87858e55-3cf2-4a42-b948-e7cad60225b3 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:25.234028 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-87858e55-3cf2-4a42-b948-e7cad60225b3 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:25.365871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-87858e55-3cf2-4a42-b948-e7cad60225b3 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:45:25.372969 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-87858e55-3cf2-4a42-b948-e7cad60225b3 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 200 len: 1264 microversion: 2.1 time: 0.151635 Nov 02 23:45:25.373531 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2662/3237] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:45:25 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:45:26.389028 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e43eea2f-c390-4168-9d87-d756bdad9fae tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:45:26.389632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e43eea2f-c390-4168-9d87-d756bdad9fae tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:45:26.396297 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e43eea2f-c390-4168-9d87-d756bdad9fae tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:26.396745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e43eea2f-c390-4168-9d87-d756bdad9fae tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:26.397506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e43eea2f-c390-4168-9d87-d756bdad9fae tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:26.397933 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e43eea2f-c390-4168-9d87-d756bdad9fae tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:26.524723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e43eea2f-c390-4168-9d87-d756bdad9fae tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:45:26.531987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e43eea2f-c390-4168-9d87-d756bdad9fae tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 200 len: 1264 microversion: 2.1 time: 0.146524 Nov 02 23:45:26.532549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2663/3238] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:45:26 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:45:27.548827 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0072da6b-1de5-49e2-b047-dde504a38830 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:45:27.549434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0072da6b-1de5-49e2-b047-dde504a38830 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:45:27.556492 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0072da6b-1de5-49e2-b047-dde504a38830 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:27.556966 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0072da6b-1de5-49e2-b047-dde504a38830 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:27.557721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0072da6b-1de5-49e2-b047-dde504a38830 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:27.558151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0072da6b-1de5-49e2-b047-dde504a38830 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:27.686529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0072da6b-1de5-49e2-b047-dde504a38830 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:45:27.693789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0072da6b-1de5-49e2-b047-dde504a38830 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 200 len: 1264 microversion: 2.1 time: 0.148621 Nov 02 23:45:27.694355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2664/3239] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:45:27 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:45:28.710105 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-350aa9e7-1672-4074-a2e9-c93fc2533ddd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:45:28.710713 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-350aa9e7-1672-4074-a2e9-c93fc2533ddd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:45:28.717035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-350aa9e7-1672-4074-a2e9-c93fc2533ddd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:28.717474 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-350aa9e7-1672-4074-a2e9-c93fc2533ddd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:28.718230 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-350aa9e7-1672-4074-a2e9-c93fc2533ddd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:28.718655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-350aa9e7-1672-4074-a2e9-c93fc2533ddd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:28.846899 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-350aa9e7-1672-4074-a2e9-c93fc2533ddd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:45:28.854562 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-350aa9e7-1672-4074-a2e9-c93fc2533ddd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 200 len: 1264 microversion: 2.1 time: 0.148185 Nov 02 23:45:28.855151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2665/3240] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:45:28 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:45:29.870832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e42d0e9f-cec5-4f9e-a125-4d45547de074 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:45:29.871442 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e42d0e9f-cec5-4f9e-a125-4d45547de074 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:45:29.877489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e42d0e9f-cec5-4f9e-a125-4d45547de074 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:29.877936 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e42d0e9f-cec5-4f9e-a125-4d45547de074 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:29.878688 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e42d0e9f-cec5-4f9e-a125-4d45547de074 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:29.879144 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e42d0e9f-cec5-4f9e-a125-4d45547de074 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:30.005712 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e42d0e9f-cec5-4f9e-a125-4d45547de074 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:45:30.012787 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e42d0e9f-cec5-4f9e-a125-4d45547de074 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 200 len: 1264 microversion: 2.1 time: 0.145672 Nov 02 23:45:30.013355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2666/3241] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:45:29 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:45:30.853385 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-afac3196-bd84-413b-b7e4-bf3f4560f1ea req-5197d35c-a711-437e-a407-3ca24f8d54e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbde8758-7f43-4f8d-adef-8bbd2dfab2e8", "name": "network-vif-plugged", "status": "completed", "tag": "52407ebc-50ed-414a-b308-65e90ac03f63"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:45:30.854896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:45:30.854896 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:45:30.862040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-afac3196-bd84-413b-b7e4-bf3f4560f1ea req-5197d35c-a711-437e-a407-3ca24f8d54e4 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:30.862520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-afac3196-bd84-413b-b7e4-bf3f4560f1ea req-5197d35c-a711-437e-a407-3ca24f8d54e4 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:30.873594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-afac3196-bd84-413b-b7e4-bf3f4560f1ea req-5197d35c-a711-437e-a407-3ca24f8d54e4 service nova] Creating event network-vif-plugged:52407ebc-50ed-414a-b308-65e90ac03f63 for instance cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 on hv-cinder-81584 Nov 02 23:45:30.878690 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-afac3196-bd84-413b-b7e4-bf3f4560f1ea req-5197d35c-a711-437e-a407-3ca24f8d54e4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028956 Nov 02 23:45:30.879324 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2667/3242] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:45:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:45:31.029440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0bafac13-f8a4-4fc5-a98c-4fb27226dccb tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:45:31.030128 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0bafac13-f8a4-4fc5-a98c-4fb27226dccb tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:45:31.036664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0bafac13-f8a4-4fc5-a98c-4fb27226dccb tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:31.037345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0bafac13-f8a4-4fc5-a98c-4fb27226dccb tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:31.038131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0bafac13-f8a4-4fc5-a98c-4fb27226dccb tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:31.038556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0bafac13-f8a4-4fc5-a98c-4fb27226dccb tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:31.172047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0bafac13-f8a4-4fc5-a98c-4fb27226dccb tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:45:31.180023 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0bafac13-f8a4-4fc5-a98c-4fb27226dccb tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 200 len: 1264 microversion: 2.1 time: 0.154630 Nov 02 23:45:31.180607 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2668/3243] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:45:31 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:45:32.197229 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8968b458-a2df-4c53-8995-1dc81e8c5316 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:45:32.197849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8968b458-a2df-4c53-8995-1dc81e8c5316 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:45:32.204056 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8968b458-a2df-4c53-8995-1dc81e8c5316 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:32.204501 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8968b458-a2df-4c53-8995-1dc81e8c5316 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:32.205258 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8968b458-a2df-4c53-8995-1dc81e8c5316 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:32.205681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8968b458-a2df-4c53-8995-1dc81e8c5316 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:32.339375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8968b458-a2df-4c53-8995-1dc81e8c5316 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:45:32.346376 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8968b458-a2df-4c53-8995-1dc81e8c5316 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 200 len: 1264 microversion: 2.1 time: 0.152786 Nov 02 23:45:32.346960 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2669/3244] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:45:32 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:45:33.361681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-effc265e-aad4-4391-b23d-0d324fad87ba tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:45:33.362283 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-effc265e-aad4-4391-b23d-0d324fad87ba tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:45:33.368447 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-effc265e-aad4-4391-b23d-0d324fad87ba tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:33.368886 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-effc265e-aad4-4391-b23d-0d324fad87ba tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:33.369632 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-effc265e-aad4-4391-b23d-0d324fad87ba tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:33.370081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-effc265e-aad4-4391-b23d-0d324fad87ba tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:33.499280 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-effc265e-aad4-4391-b23d-0d324fad87ba tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:45:33.506854 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-effc265e-aad4-4391-b23d-0d324fad87ba tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 200 len: 1452 microversion: 2.1 time: 0.148836 Nov 02 23:45:33.507440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2670/3245] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:45:33 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:45:33.522415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b4245835-c9bc-4a40-9d45-1397d16915fe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:45:33.523035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b4245835-c9bc-4a40-9d45-1397d16915fe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:45:33.528325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b4245835-c9bc-4a40-9d45-1397d16915fe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:33.528762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b4245835-c9bc-4a40-9d45-1397d16915fe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:33.529542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b4245835-c9bc-4a40-9d45-1397d16915fe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:33.529967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b4245835-c9bc-4a40-9d45-1397d16915fe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:33.657444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b4245835-c9bc-4a40-9d45-1397d16915fe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:45:33.664885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b4245835-c9bc-4a40-9d45-1397d16915fe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 200 len: 1452 microversion: 2.1 time: 0.146418 Nov 02 23:45:33.665450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2671/3246] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:45:33 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 1452 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:45:35.585529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-527f293c-e937-40ba-bc37-7a1730065c72 req-69abd2cb-8de5-4d47-ad79-b063122e052b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbde8758-7f43-4f8d-adef-8bbd2dfab2e8", "tag": "52407ebc-50ed-414a-b308-65e90ac03f63"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:45:35.591027 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:45:35.591027 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:45:35.595526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-527f293c-e937-40ba-bc37-7a1730065c72 req-69abd2cb-8de5-4d47-ad79-b063122e052b service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:45:35.596081 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-527f293c-e937-40ba-bc37-7a1730065c72 req-69abd2cb-8de5-4d47-ad79-b063122e052b service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:45:35.610146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-527f293c-e937-40ba-bc37-7a1730065c72 req-69abd2cb-8de5-4d47-ad79-b063122e052b service nova] Creating event network-changed:52407ebc-50ed-414a-b308-65e90ac03f63 for instance cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 on hv-cinder-81584 Nov 02 23:45:35.615190 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-527f293c-e937-40ba-bc37-7a1730065c72 req-69abd2cb-8de5-4d47-ad79-b063122e052b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033607 Nov 02 23:45:35.615784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2672/3247] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:45:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:47:08.762451 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5309f22a-28e5-4b31-a11e-919f0c01ecc7 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:47:08.763126 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5309f22a-28e5-4b31-a11e-919f0c01ecc7 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:08.769110 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5309f22a-28e5-4b31-a11e-919f0c01ecc7 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:08.769559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5309f22a-28e5-4b31-a11e-919f0c01ecc7 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:08.770325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5309f22a-28e5-4b31-a11e-919f0c01ecc7 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:08.770767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5309f22a-28e5-4b31-a11e-919f0c01ecc7 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:08.793406 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.objects.instance [None req-5309f22a-28e5-4b31-a11e-919f0c01ecc7 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lazy-loading 'flavor' on Instance uuid 11a5250e-9bbd-4b25-b636-be74c540c2e0 {{(pid=115800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 23:47:08.862058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5309f22a-28e5-4b31-a11e-919f0c01ecc7 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "POST /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0/action" status: 202 len: 0 microversion: 2.1 time: 0.104844 Nov 02 23:47:08.862648 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2673/3248] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:47:08 2021] POST /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:47:08.870899 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-caeb43dc-2268-486a-8075-9b8a19ecadb9 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:08.871631 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-caeb43dc-2268-486a-8075-9b8a19ecadb9 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:08.877824 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-caeb43dc-2268-486a-8075-9b8a19ecadb9 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:08.878257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-caeb43dc-2268-486a-8075-9b8a19ecadb9 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:08.879058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-caeb43dc-2268-486a-8075-9b8a19ecadb9 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:08.879489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-caeb43dc-2268-486a-8075-9b8a19ecadb9 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:09.011282 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-caeb43dc-2268-486a-8075-9b8a19ecadb9 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:09.018577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-caeb43dc-2268-486a-8075-9b8a19ecadb9 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1566 microversion: 2.1 time: 0.151529 Nov 02 23:47:09.019182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2674/3249] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:08 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:10.036372 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3f185058-763d-4720-b04c-cb16a8db6856 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:10.037003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3f185058-763d-4720-b04c-cb16a8db6856 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:10.043700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f185058-763d-4720-b04c-cb16a8db6856 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:10.044143 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f185058-763d-4720-b04c-cb16a8db6856 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:10.044900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f185058-763d-4720-b04c-cb16a8db6856 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:10.045322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3f185058-763d-4720-b04c-cb16a8db6856 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:10.172722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3f185058-763d-4720-b04c-cb16a8db6856 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:10.180171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3f185058-763d-4720-b04c-cb16a8db6856 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1566 microversion: 2.1 time: 0.147489 Nov 02 23:47:10.180738 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2675/3250] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:10 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:11.197392 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-8c1a03c9-6dc7-4047-bd02-107304b7b216 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:11.198519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-8c1a03c9-6dc7-4047-bd02-107304b7b216 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:11.204843 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c1a03c9-6dc7-4047-bd02-107304b7b216 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:11.205287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c1a03c9-6dc7-4047-bd02-107304b7b216 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:11.206051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c1a03c9-6dc7-4047-bd02-107304b7b216 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:11.206485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-8c1a03c9-6dc7-4047-bd02-107304b7b216 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:11.332544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-8c1a03c9-6dc7-4047-bd02-107304b7b216 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:11.339723 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-8c1a03c9-6dc7-4047-bd02-107304b7b216 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1566 microversion: 2.1 time: 0.146081 Nov 02 23:47:11.340347 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2676/3251] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:11 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1566 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:12.356388 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c2ff0192-4096-4c03-9476-dfef1a82ef00 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:12.357024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c2ff0192-4096-4c03-9476-dfef1a82ef00 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:12.363260 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2ff0192-4096-4c03-9476-dfef1a82ef00 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:12.363711 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2ff0192-4096-4c03-9476-dfef1a82ef00 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:12.364478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2ff0192-4096-4c03-9476-dfef1a82ef00 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:12.364913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2ff0192-4096-4c03-9476-dfef1a82ef00 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:12.495356 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c2ff0192-4096-4c03-9476-dfef1a82ef00 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:12.502440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c2ff0192-4096-4c03-9476-dfef1a82ef00 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1566 microversion: 2.1 time: 0.149774 Nov 02 23:47:12.503024 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2677/3252] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:12 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:13.519770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-86bff9d0-2619-407c-a479-6dff7327df74 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:13.520359 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-86bff9d0-2619-407c-a479-6dff7327df74 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:13.527137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86bff9d0-2619-407c-a479-6dff7327df74 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:13.527587 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86bff9d0-2619-407c-a479-6dff7327df74 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:13.528351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86bff9d0-2619-407c-a479-6dff7327df74 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:13.528782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-86bff9d0-2619-407c-a479-6dff7327df74 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:13.656415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-86bff9d0-2619-407c-a479-6dff7327df74 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:13.663867 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-86bff9d0-2619-407c-a479-6dff7327df74 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1566 microversion: 2.1 time: 0.147768 Nov 02 23:47:13.664481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2678/3253] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:13 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:14.680687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b9e0bc9e-141d-4219-a725-10f0f8617fb0 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:14.681311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b9e0bc9e-141d-4219-a725-10f0f8617fb0 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:14.688163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9e0bc9e-141d-4219-a725-10f0f8617fb0 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:14.688608 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9e0bc9e-141d-4219-a725-10f0f8617fb0 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:14.689366 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9e0bc9e-141d-4219-a725-10f0f8617fb0 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:14.689802 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b9e0bc9e-141d-4219-a725-10f0f8617fb0 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:14.821349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b9e0bc9e-141d-4219-a725-10f0f8617fb0 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:14.828755 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b9e0bc9e-141d-4219-a725-10f0f8617fb0 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1566 microversion: 2.1 time: 0.151990 Nov 02 23:47:14.829322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2679/3254] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:14 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:15.845287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d2e47212-442d-430b-939d-f71425b4d035 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:15.845941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d2e47212-442d-430b-939d-f71425b4d035 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:15.852045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2e47212-442d-430b-939d-f71425b4d035 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:15.852489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2e47212-442d-430b-939d-f71425b4d035 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:15.853244 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2e47212-442d-430b-939d-f71425b4d035 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:15.853670 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d2e47212-442d-430b-939d-f71425b4d035 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:15.980869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d2e47212-442d-430b-939d-f71425b4d035 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:15.987989 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d2e47212-442d-430b-939d-f71425b4d035 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1566 microversion: 2.1 time: 0.146476 Nov 02 23:47:15.988643 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2680/3255] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:15 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:17.005228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-2fcceb9f-cd37-4e47-a1c2-9b13eb8782ef tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:17.005874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-2fcceb9f-cd37-4e47-a1c2-9b13eb8782ef tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:17.012058 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2fcceb9f-cd37-4e47-a1c2-9b13eb8782ef tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:17.012510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2fcceb9f-cd37-4e47-a1c2-9b13eb8782ef tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:17.013267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2fcceb9f-cd37-4e47-a1c2-9b13eb8782ef tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:17.013696 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-2fcceb9f-cd37-4e47-a1c2-9b13eb8782ef tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:17.144921 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-2fcceb9f-cd37-4e47-a1c2-9b13eb8782ef tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:17.152605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-2fcceb9f-cd37-4e47-a1c2-9b13eb8782ef tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1566 microversion: 2.1 time: 0.151009 Nov 02 23:47:17.153160 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2681/3256] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:17 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:17.746025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:47:17.746186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:47:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 23:47:18.169480 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f97602b5-191d-4c18-81a1-edfc8caeb509 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:18.170072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f97602b5-191d-4c18-81a1-edfc8caeb509 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:18.175971 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f97602b5-191d-4c18-81a1-edfc8caeb509 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:18.176418 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f97602b5-191d-4c18-81a1-edfc8caeb509 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:18.177176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f97602b5-191d-4c18-81a1-edfc8caeb509 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:18.177606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f97602b5-191d-4c18-81a1-edfc8caeb509 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:18.309709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f97602b5-191d-4c18-81a1-edfc8caeb509 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:18.316865 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f97602b5-191d-4c18-81a1-edfc8caeb509 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1566 microversion: 2.1 time: 0.151487 Nov 02 23:47:18.317422 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2682/3257] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:18 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:19.333345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4309d48e-2ee7-4383-887b-af5be9a94ff4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:19.333970 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4309d48e-2ee7-4383-887b-af5be9a94ff4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:19.340269 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4309d48e-2ee7-4383-887b-af5be9a94ff4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:19.340710 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4309d48e-2ee7-4383-887b-af5be9a94ff4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:19.341465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4309d48e-2ee7-4383-887b-af5be9a94ff4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:19.341891 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4309d48e-2ee7-4383-887b-af5be9a94ff4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:19.477328 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4309d48e-2ee7-4383-887b-af5be9a94ff4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:19.484670 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4309d48e-2ee7-4383-887b-af5be9a94ff4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1566 microversion: 2.1 time: 0.155029 Nov 02 23:47:19.485305 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2683/3258] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:19 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:20.501315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0afa98ac-7b1a-4810-bca5-f98bb069870d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:20.501959 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0afa98ac-7b1a-4810-bca5-f98bb069870d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:20.508047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0afa98ac-7b1a-4810-bca5-f98bb069870d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:20.508518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0afa98ac-7b1a-4810-bca5-f98bb069870d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:20.509267 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0afa98ac-7b1a-4810-bca5-f98bb069870d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:20.509697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0afa98ac-7b1a-4810-bca5-f98bb069870d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:20.640536 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0afa98ac-7b1a-4810-bca5-f98bb069870d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:20.647870 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0afa98ac-7b1a-4810-bca5-f98bb069870d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1566 microversion: 2.1 time: 0.150187 Nov 02 23:47:20.648433 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2684/3259] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:20 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:21.665192 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d9c1e554-4896-41bd-b8cf-36935a6251a8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:21.665793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d9c1e554-4896-41bd-b8cf-36935a6251a8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:21.672027 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9c1e554-4896-41bd-b8cf-36935a6251a8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:21.672472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9c1e554-4896-41bd-b8cf-36935a6251a8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:21.673238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9c1e554-4896-41bd-b8cf-36935a6251a8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:21.673673 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d9c1e554-4896-41bd-b8cf-36935a6251a8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:21.814871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d9c1e554-4896-41bd-b8cf-36935a6251a8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:21.822276 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d9c1e554-4896-41bd-b8cf-36935a6251a8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1566 microversion: 2.1 time: 0.160919 Nov 02 23:47:21.823495 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2685/3260] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:21 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:22.840164 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-13e37a15-edb6-4bc2-a1f4-5c80816fa570 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:22.840879 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-13e37a15-edb6-4bc2-a1f4-5c80816fa570 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:22.846882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-13e37a15-edb6-4bc2-a1f4-5c80816fa570 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:22.847354 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-13e37a15-edb6-4bc2-a1f4-5c80816fa570 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:22.848106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-13e37a15-edb6-4bc2-a1f4-5c80816fa570 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:22.848539 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-13e37a15-edb6-4bc2-a1f4-5c80816fa570 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:22.976047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-13e37a15-edb6-4bc2-a1f4-5c80816fa570 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:22.983259 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-13e37a15-edb6-4bc2-a1f4-5c80816fa570 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1507 microversion: 2.1 time: 0.147308 Nov 02 23:47:22.983823 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2686/3261] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:22 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:22.999059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-54a2fd84-15d4-4298-a736-5396dda9a285 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:47:22.999608 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-54a2fd84-15d4-4298-a736-5396dda9a285 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:23.004913 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-54a2fd84-15d4-4298-a736-5396dda9a285 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:23.005353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-54a2fd84-15d4-4298-a736-5396dda9a285 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:23.006099 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-54a2fd84-15d4-4298-a736-5396dda9a285 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:23.006521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-54a2fd84-15d4-4298-a736-5396dda9a285 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:23.092070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-54a2fd84-15d4-4298-a736-5396dda9a285 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "POST /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0/action" status: 202 len: 0 microversion: 2.1 time: 0.096007 Nov 02 23:47:23.092639 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2687/3262] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 2 23:47:22 2021] POST /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:47:23.100234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-73695eeb-cc3e-4a83-aedd-0665572b379a tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:23.100833 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-73695eeb-cc3e-4a83-aedd-0665572b379a tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:23.106712 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73695eeb-cc3e-4a83-aedd-0665572b379a tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:23.107194 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73695eeb-cc3e-4a83-aedd-0665572b379a tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:23.108027 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73695eeb-cc3e-4a83-aedd-0665572b379a tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:23.108458 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-73695eeb-cc3e-4a83-aedd-0665572b379a tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:23.241987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-73695eeb-cc3e-4a83-aedd-0665572b379a tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:23.250217 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-73695eeb-cc3e-4a83-aedd-0665572b379a tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1515 microversion: 2.1 time: 0.153258 Nov 02 23:47:23.250597 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2688/3263] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:23 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:24.266800 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-650e30af-a379-43ec-807f-763e522d29ea tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:24.267571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-650e30af-a379-43ec-807f-763e522d29ea tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:24.274489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-650e30af-a379-43ec-807f-763e522d29ea tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:24.274956 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-650e30af-a379-43ec-807f-763e522d29ea tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:24.276327 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-650e30af-a379-43ec-807f-763e522d29ea tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:24.276760 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-650e30af-a379-43ec-807f-763e522d29ea tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:24.403975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-650e30af-a379-43ec-807f-763e522d29ea tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:24.411500 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-650e30af-a379-43ec-807f-763e522d29ea tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1517 microversion: 2.1 time: 0.148308 Nov 02 23:47:24.412259 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2689/3264] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:24 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1517 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:25.282527 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-8070966e-890f-4703-9f66-efa7693831d9 req-0267489d-d2d2-42aa-9d40-01c661424d18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a5250e-9bbd-4b25-b636-be74c540c2e0", "name": "network-vif-unplugged", "status": "completed", "tag": "2164064c-8a25-4db4-90c4-9e83b8647e2f"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:47:25.284070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:47:25.284070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:47:25.292676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-8070966e-890f-4703-9f66-efa7693831d9 req-0267489d-d2d2-42aa-9d40-01c661424d18 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:25.293113 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-8070966e-890f-4703-9f66-efa7693831d9 req-0267489d-d2d2-42aa-9d40-01c661424d18 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:25.305679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-8070966e-890f-4703-9f66-efa7693831d9 req-0267489d-d2d2-42aa-9d40-01c661424d18 service nova] Creating event network-vif-unplugged:2164064c-8a25-4db4-90c4-9e83b8647e2f for instance 11a5250e-9bbd-4b25-b636-be74c540c2e0 on hv-cinder-81584 Nov 02 23:47:25.310732 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-8070966e-890f-4703-9f66-efa7693831d9 req-0267489d-d2d2-42aa-9d40-01c661424d18 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032173 Nov 02 23:47:25.311843 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2690/3265] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:47:25 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:47:25.430163 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-112dbb47-f3d1-49e5-8b2d-60739dace253 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:25.430849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-112dbb47-f3d1-49e5-8b2d-60739dace253 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:25.436878 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-112dbb47-f3d1-49e5-8b2d-60739dace253 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:25.437320 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-112dbb47-f3d1-49e5-8b2d-60739dace253 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:25.438077 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-112dbb47-f3d1-49e5-8b2d-60739dace253 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:25.438537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-112dbb47-f3d1-49e5-8b2d-60739dace253 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:25.571355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-112dbb47-f3d1-49e5-8b2d-60739dace253 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:25.578528 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-112dbb47-f3d1-49e5-8b2d-60739dace253 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1573 microversion: 2.1 time: 0.152709 Nov 02 23:47:25.579111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2691/3266] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:25 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:26.594676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-edf925aa-9f6c-4723-bed6-3f75f3baafc4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:26.595294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-edf925aa-9f6c-4723-bed6-3f75f3baafc4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:26.601419 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-edf925aa-9f6c-4723-bed6-3f75f3baafc4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:26.601857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-edf925aa-9f6c-4723-bed6-3f75f3baafc4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:26.602616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-edf925aa-9f6c-4723-bed6-3f75f3baafc4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:26.603101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-edf925aa-9f6c-4723-bed6-3f75f3baafc4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:26.730104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-edf925aa-9f6c-4723-bed6-3f75f3baafc4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:26.737204 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-edf925aa-9f6c-4723-bed6-3f75f3baafc4 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1573 microversion: 2.1 time: 0.146127 Nov 02 23:47:26.737762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2692/3267] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:26 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1573 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:27.754615 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-60063dd6-0159-48fc-9c71-b06b505cc768 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:27.755236 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-60063dd6-0159-48fc-9c71-b06b505cc768 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:27.762047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-60063dd6-0159-48fc-9c71-b06b505cc768 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:27.762362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-60063dd6-0159-48fc-9c71-b06b505cc768 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:27.763210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-60063dd6-0159-48fc-9c71-b06b505cc768 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:27.763525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-60063dd6-0159-48fc-9c71-b06b505cc768 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:27.895943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-60063dd6-0159-48fc-9c71-b06b505cc768 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:27.903142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-60063dd6-0159-48fc-9c71-b06b505cc768 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1573 microversion: 2.1 time: 0.152190 Nov 02 23:47:27.903699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2693/3268] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:27 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:28.920147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3d880903-3dcd-4e9b-8b2d-b675d884d6af tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:28.920773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3d880903-3dcd-4e9b-8b2d-b675d884d6af tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:28.927074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3d880903-3dcd-4e9b-8b2d-b675d884d6af tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:28.927521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3d880903-3dcd-4e9b-8b2d-b675d884d6af tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:28.928542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3d880903-3dcd-4e9b-8b2d-b675d884d6af tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:28.928971 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3d880903-3dcd-4e9b-8b2d-b675d884d6af tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:29.055840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3d880903-3dcd-4e9b-8b2d-b675d884d6af tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:29.063536 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3d880903-3dcd-4e9b-8b2d-b675d884d6af tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1573 microversion: 2.1 time: 0.147184 Nov 02 23:47:29.064104 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2694/3269] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:28 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1573 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:30.080980 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ed625123-81c6-4ba6-bf73-99b4130b1713 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:30.081585 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ed625123-81c6-4ba6-bf73-99b4130b1713 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:30.087911 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ed625123-81c6-4ba6-bf73-99b4130b1713 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:30.088355 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ed625123-81c6-4ba6-bf73-99b4130b1713 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:30.089600 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ed625123-81c6-4ba6-bf73-99b4130b1713 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:30.090066 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ed625123-81c6-4ba6-bf73-99b4130b1713 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:30.217449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ed625123-81c6-4ba6-bf73-99b4130b1713 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:30.224707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ed625123-81c6-4ba6-bf73-99b4130b1713 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1573 microversion: 2.1 time: 0.147552 Nov 02 23:47:30.225272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2695/3270] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:30 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:31.241266 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-564d9b70-ba29-4682-bf41-6aa07cc966a5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:31.241875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-564d9b70-ba29-4682-bf41-6aa07cc966a5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:31.248298 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-564d9b70-ba29-4682-bf41-6aa07cc966a5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:31.248742 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-564d9b70-ba29-4682-bf41-6aa07cc966a5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:31.249502 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-564d9b70-ba29-4682-bf41-6aa07cc966a5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:31.249932 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-564d9b70-ba29-4682-bf41-6aa07cc966a5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:31.625683 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-564d9b70-ba29-4682-bf41-6aa07cc966a5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:31.632874 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-564d9b70-ba29-4682-bf41-6aa07cc966a5 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1573 microversion: 2.1 time: 0.395316 Nov 02 23:47:31.633476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2696/3271] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:31 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1573 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:32.649272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0757d941-0d8f-4461-8685-b61c53e0acea tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:32.649863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0757d941-0d8f-4461-8685-b61c53e0acea tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:32.656709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0757d941-0d8f-4461-8685-b61c53e0acea tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:32.657184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0757d941-0d8f-4461-8685-b61c53e0acea tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:32.657975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0757d941-0d8f-4461-8685-b61c53e0acea tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:32.658408 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0757d941-0d8f-4461-8685-b61c53e0acea tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:32.793979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0757d941-0d8f-4461-8685-b61c53e0acea tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:32.801293 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0757d941-0d8f-4461-8685-b61c53e0acea tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1573 microversion: 2.1 time: 0.155681 Nov 02 23:47:32.801850 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2697/3272] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:32 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:33.819405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c2385f05-3a2a-4179-ba64-8311f21210a7 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:33.820130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c2385f05-3a2a-4179-ba64-8311f21210a7 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:33.827660 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2385f05-3a2a-4179-ba64-8311f21210a7 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:33.828114 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2385f05-3a2a-4179-ba64-8311f21210a7 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:33.828926 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2385f05-3a2a-4179-ba64-8311f21210a7 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:33.829362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c2385f05-3a2a-4179-ba64-8311f21210a7 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:33.962015 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c2385f05-3a2a-4179-ba64-8311f21210a7 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:33.969225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c2385f05-3a2a-4179-ba64-8311f21210a7 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1560 microversion: 2.1 time: 0.154014 Nov 02 23:47:33.969793 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2698/3273] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:33 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:37.400737 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-cea82c08-415e-4533-bbfc-770fbc563bf9 req-3e794e74-74a8-471e-bc19-81d46a1b7cdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a5250e-9bbd-4b25-b636-be74c540c2e0", "name": "network-vif-plugged", "status": "completed", "tag": "2164064c-8a25-4db4-90c4-9e83b8647e2f"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:47:37.402272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:47:37.402272 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:47:37.409973 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-cea82c08-415e-4533-bbfc-770fbc563bf9 req-3e794e74-74a8-471e-bc19-81d46a1b7cdf service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:37.410532 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-cea82c08-415e-4533-bbfc-770fbc563bf9 req-3e794e74-74a8-471e-bc19-81d46a1b7cdf service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:37.421658 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-cea82c08-415e-4533-bbfc-770fbc563bf9 req-3e794e74-74a8-471e-bc19-81d46a1b7cdf service nova] Creating event network-vif-plugged:2164064c-8a25-4db4-90c4-9e83b8647e2f for instance 11a5250e-9bbd-4b25-b636-be74c540c2e0 on hv-cinder-81584 Nov 02 23:47:37.426541 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-cea82c08-415e-4533-bbfc-770fbc563bf9 req-3e794e74-74a8-471e-bc19-81d46a1b7cdf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029318 Nov 02 23:47:37.427312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2699/3274] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:47:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:47:49.534902 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5f9561ff-68c3-4f08-a1f8-937f9370aba1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:49.535552 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5f9561ff-68c3-4f08-a1f8-937f9370aba1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:49.541483 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f9561ff-68c3-4f08-a1f8-937f9370aba1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:49.541932 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f9561ff-68c3-4f08-a1f8-937f9370aba1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:49.542687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f9561ff-68c3-4f08-a1f8-937f9370aba1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:49.543151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f9561ff-68c3-4f08-a1f8-937f9370aba1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:49.567151 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5f9561ff-68c3-4f08-a1f8-937f9370aba1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Going to try to terminate instance {{(pid=115800) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 23:47:49.644106 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5f9561ff-68c3-4f08-a1f8-937f9370aba1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "DELETE /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 204 len: 0 microversion: 2.1 time: 0.113195 Nov 02 23:47:49.645343 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2700/3275] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:47:49 2021] DELETE /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 23:47:49.653476 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c590ec12-62f7-4ff6-b870-7817286f983c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:49.654147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c590ec12-62f7-4ff6-b870-7817286f983c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:49.659922 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c590ec12-62f7-4ff6-b870-7817286f983c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:49.660363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c590ec12-62f7-4ff6-b870-7817286f983c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:49.661117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c590ec12-62f7-4ff6-b870-7817286f983c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:49.661624 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c590ec12-62f7-4ff6-b870-7817286f983c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:49.790534 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c590ec12-62f7-4ff6-b870-7817286f983c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:49.798131 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c590ec12-62f7-4ff6-b870-7817286f983c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 200 len: 1577 microversion: 2.1 time: 0.148536 Nov 02 23:47:49.798695 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2701/3276] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:49 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:50.560937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-05e993af-9938-4a23-8383-e9e22d60f0fb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:50.561534 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-05e993af-9938-4a23-8383-e9e22d60f0fb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:50.567659 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05e993af-9938-4a23-8383-e9e22d60f0fb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:50.568095 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05e993af-9938-4a23-8383-e9e22d60f0fb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:50.568848 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05e993af-9938-4a23-8383-e9e22d60f0fb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:50.569273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05e993af-9938-4a23-8383-e9e22d60f0fb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:50.581753 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-05e993af-9938-4a23-8383-e9e22d60f0fb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] HTTP exception thrown: Instance ef96c6ca-e054-45d7-b346-b5af72ea945f could not be found. Nov 02 23:47:50.582317 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-05e993af-9938-4a23-8383-e9e22d60f0fb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Returning 404 to user: Instance ef96c6ca-e054-45d7-b346-b5af72ea945f could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:47:50.583311 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-05e993af-9938-4a23-8383-e9e22d60f0fb tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f" status: 404 len: 111 microversion: 2.1 time: 0.026655 Nov 02 23:47:50.583818 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2702/3277] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:47:50 2021] DELETE /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 23:47:50.590648 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-27a51bad-6bba-416e-aed1-2dc54750678f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:50.591249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-27a51bad-6bba-416e-aed1-2dc54750678f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: ef96c6ca-e054-45d7-b346-b5af72ea945f] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:50.596377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27a51bad-6bba-416e-aed1-2dc54750678f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:50.596825 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27a51bad-6bba-416e-aed1-2dc54750678f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:50.597563 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27a51bad-6bba-416e-aed1-2dc54750678f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:50.597992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-27a51bad-6bba-416e-aed1-2dc54750678f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:50.610963 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-27a51bad-6bba-416e-aed1-2dc54750678f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] HTTP exception thrown: Instance ef96c6ca-e054-45d7-b346-b5af72ea945f could not be found. Nov 02 23:47:50.611520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-27a51bad-6bba-416e-aed1-2dc54750678f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Returning 404 to user: Instance ef96c6ca-e054-45d7-b346-b5af72ea945f could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:47:50.612294 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-27a51bad-6bba-416e-aed1-2dc54750678f tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f" status: 404 len: 111 microversion: 2.1 time: 0.024814 Nov 02 23:47:50.612889 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2703/3278] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:50 2021] GET /compute/v2.1/servers/ef96c6ca-e054-45d7-b346-b5af72ea945f => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 23:47:50.815577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-47ecf59b-300e-4b6a-aae6-7dd132bd178d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:50.816101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-47ecf59b-300e-4b6a-aae6-7dd132bd178d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:50.821861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47ecf59b-300e-4b6a-aae6-7dd132bd178d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:50.822299 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47ecf59b-300e-4b6a-aae6-7dd132bd178d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:50.823080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47ecf59b-300e-4b6a-aae6-7dd132bd178d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:50.823509 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-47ecf59b-300e-4b6a-aae6-7dd132bd178d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:50.952006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-47ecf59b-300e-4b6a-aae6-7dd132bd178d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:50.959566 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-47ecf59b-300e-4b6a-aae6-7dd132bd178d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 200 len: 1577 microversion: 2.1 time: 0.147800 Nov 02 23:47:50.960123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2704/3279] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:50 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:51.889709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-19f83a34-017b-48ba-85a7-c543e0709419 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:51.890303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-19f83a34-017b-48ba-85a7-c543e0709419 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:51.896212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19f83a34-017b-48ba-85a7-c543e0709419 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:51.896668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19f83a34-017b-48ba-85a7-c543e0709419 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:51.897440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19f83a34-017b-48ba-85a7-c543e0709419 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:51.897871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-19f83a34-017b-48ba-85a7-c543e0709419 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:51.910701 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-19f83a34-017b-48ba-85a7-c543e0709419 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] HTTP exception thrown: Instance 15750fff-dec6-4bcc-a69c-0f9576f7970e could not be found. Nov 02 23:47:51.911309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-19f83a34-017b-48ba-85a7-c543e0709419 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Returning 404 to user: Instance 15750fff-dec6-4bcc-a69c-0f9576f7970e could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:47:51.912130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-19f83a34-017b-48ba-85a7-c543e0709419 tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "DELETE /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 404 len: 111 microversion: 2.1 time: 0.026363 Nov 02 23:47:51.912678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2705/3280] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:47:51 2021] DELETE /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 23:47:51.920471 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-04eef13d-69cd-4404-8441-f0261bb8d1ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:51.921007 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-04eef13d-69cd-4404-8441-f0261bb8d1ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] [instance: 15750fff-dec6-4bcc-a69c-0f9576f7970e] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:51.926452 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-04eef13d-69cd-4404-8441-f0261bb8d1ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:51.926905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-04eef13d-69cd-4404-8441-f0261bb8d1ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:51.927949 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-04eef13d-69cd-4404-8441-f0261bb8d1ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:51.928393 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-04eef13d-69cd-4404-8441-f0261bb8d1ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:51.943418 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-04eef13d-69cd-4404-8441-f0261bb8d1ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] HTTP exception thrown: Instance 15750fff-dec6-4bcc-a69c-0f9576f7970e could not be found. Nov 02 23:47:51.944004 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-04eef13d-69cd-4404-8441-f0261bb8d1ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] Returning 404 to user: Instance 15750fff-dec6-4bcc-a69c-0f9576f7970e could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:47:51.944814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-04eef13d-69cd-4404-8441-f0261bb8d1ca tempest-AttachVolumeShelveTestJSON-802361815 tempest-AttachVolumeShelveTestJSON-802361815-project] 10.222.0.41 "GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e" status: 404 len: 111 microversion: 2.1 time: 0.028274 Nov 02 23:47:51.945343 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2706/3281] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:51 2021] GET /compute/v2.1/servers/15750fff-dec6-4bcc-a69c-0f9576f7970e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 23:47:51.976625 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-53280875-34b1-4683-9ca3-eae621080b6a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:51.977234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-53280875-34b1-4683-9ca3-eae621080b6a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:51.983498 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53280875-34b1-4683-9ca3-eae621080b6a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:51.984005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53280875-34b1-4683-9ca3-eae621080b6a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:51.984715 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53280875-34b1-4683-9ca3-eae621080b6a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:51.985146 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-53280875-34b1-4683-9ca3-eae621080b6a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:52.207322 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-53280875-34b1-4683-9ca3-eae621080b6a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:52.221259 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-53280875-34b1-4683-9ca3-eae621080b6a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 200 len: 1577 microversion: 2.1 time: 0.248082 Nov 02 23:47:52.222068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2707/3282] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:51 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 1577 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:52.520005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-154c4175-d7e0-46db-a704-671812729119 req-9396b36c-bd4c-4ed2-87d3-010359a8242e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbde8758-7f43-4f8d-adef-8bbd2dfab2e8", "name": "network-vif-deleted", "tag": "52407ebc-50ed-414a-b308-65e90ac03f63"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:47:52.521441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:47:52.521441 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:47:52.530541 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-154c4175-d7e0-46db-a704-671812729119 req-9396b36c-bd4c-4ed2-87d3-010359a8242e service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:52.531157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-154c4175-d7e0-46db-a704-671812729119 req-9396b36c-bd4c-4ed2-87d3-010359a8242e service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:52.544186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-154c4175-d7e0-46db-a704-671812729119 req-9396b36c-bd4c-4ed2-87d3-010359a8242e service nova] Creating event network-vif-deleted:52407ebc-50ed-414a-b308-65e90ac03f63 for instance cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 on hv-cinder-81584 Nov 02 23:47:52.549625 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-154c4175-d7e0-46db-a704-671812729119 req-9396b36c-bd4c-4ed2-87d3-010359a8242e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033281 Nov 02 23:47:52.550383 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2708/3283] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:47:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:47:53.239259 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-64426127-4842-45d7-aef7-28026b13047a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:53.239948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-64426127-4842-45d7-aef7-28026b13047a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:53.248228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-64426127-4842-45d7-aef7-28026b13047a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:53.248900 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-64426127-4842-45d7-aef7-28026b13047a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:53.249871 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-64426127-4842-45d7-aef7-28026b13047a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:53.250477 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-64426127-4842-45d7-aef7-28026b13047a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:53.291846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-64426127-4842-45d7-aef7-28026b13047a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:53.292645 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-64426127-4842-45d7-aef7-28026b13047a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:53.293302 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.objects.instance [None req-64426127-4842-45d7-aef7-28026b13047a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lazy-loading 'fault' on Instance uuid cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 {{(pid=115800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 23:47:53.350426 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-64426127-4842-45d7-aef7-28026b13047a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:53.359036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-64426127-4842-45d7-aef7-28026b13047a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 200 len: 1228 microversion: 2.1 time: 0.123939 Nov 02 23:47:53.368558 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2709/3284] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:53 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 1228 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:54.375960 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b33083a7-f8b4-43a1-a663-734681e4e12d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:54.376510 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b33083a7-f8b4-43a1-a663-734681e4e12d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:54.383080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b33083a7-f8b4-43a1-a663-734681e4e12d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:54.383681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b33083a7-f8b4-43a1-a663-734681e4e12d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:54.384462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b33083a7-f8b4-43a1-a663-734681e4e12d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:54.384905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b33083a7-f8b4-43a1-a663-734681e4e12d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:54.399553 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-b33083a7-f8b4-43a1-a663-734681e4e12d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] HTTP exception thrown: Instance cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 could not be found. Nov 02 23:47:54.400168 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b33083a7-f8b4-43a1-a663-734681e4e12d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Returning 404 to user: Instance cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:47:54.401068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b33083a7-f8b4-43a1-a663-734681e4e12d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 404 len: 111 microversion: 2.1 time: 0.029364 Nov 02 23:47:54.401734 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2710/3285] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:54 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 23:47:54.493605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-52692ca4-3c0c-4346-91ab-9d93a6d0cada tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-358711121", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-426019499", "security_groups": [{"name": "tempest-secgroup-smoke-1479964763"}], "block_device_mapping_v2": [{"uuid": "d27df533-1edb-4313-a0ae-6c1694e65fd2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6cf98e03-e201-449c-a229-2b590bdb1187"}]}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:47:54.608387 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.network.neutron [None req-52692ca4-3c0c-4346-91ab-9d93a6d0cada tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] validate_networks() for [('6cf98e03-e201-449c-a229-2b590bdb1187', None, None, None, None, None)] {{(pid=115800) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 23:47:55.027200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-52692ca4-3c0c-4346-91ab-9d93a6d0cada tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Flavor limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 23:47:55.027618 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-52692ca4-3c0c-4346-91ab-9d93a6d0cada tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Image limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 23:47:55.028082 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-52692ca4-3c0c-4346-91ab-9d93a6d0cada tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Flavor pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 23:47:55.028508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-52692ca4-3c0c-4346-91ab-9d93a6d0cada tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Image pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 23:47:55.028910 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-52692ca4-3c0c-4346-91ab-9d93a6d0cada tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 23:47:55.037334 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52692ca4-3c0c-4346-91ab-9d93a6d0cada tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:55.037772 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52692ca4-3c0c-4346-91ab-9d93a6d0cada tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:55.038558 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52692ca4-3c0c-4346-91ab-9d93a6d0cada tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:55.039020 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-52692ca4-3c0c-4346-91ab-9d93a6d0cada tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:55.058808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-52692ca4-3c0c-4346-91ab-9d93a6d0cada tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Getting quotas for project efb44064bb93455f8407c8eec29a03f0. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:47:55.063671 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-52692ca4-3c0c-4346-91ab-9d93a6d0cada tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Getting quotas for user 7be44ffed515408bafef59166c9d0175 and project efb44064bb93455f8407c8eec29a03f0. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:47:55.130706 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-52692ca4-3c0c-4346-91ab-9d93a6d0cada tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Going to run 1 instances... {{(pid=115800) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 23:47:55.133458 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-52692ca4-3c0c-4346-91ab-9d93a6d0cada tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d27df533-1edb-4313-a0ae-6c1694e65fd2',volume_size=None,volume_type=None)] {{(pid=115800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 23:47:55.295594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-52692ca4-3c0c-4346-91ab-9d93a6d0cada tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.805543 Nov 02 23:47:55.296644 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2711/3286] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 2 23:47:54 2021] POST /compute/v2.1/servers => generated 406 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 23:47:55.306228 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4ae16662-f1bc-429d-be50-a857667023ad tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:55.306764 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4ae16662-f1bc-429d-be50-a857667023ad tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:55.362154 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4ae16662-f1bc-429d-be50-a857667023ad tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:55.369773 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4ae16662-f1bc-429d-be50-a857667023ad tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7" status: 200 len: 1093 microversion: 2.1 time: 0.067428 Nov 02 23:47:55.370338 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2712/3287] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:55 2021] GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:56.391832 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-67064973-81b7-4ada-94b2-254aaa1755c8 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:56.392478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-67064973-81b7-4ada-94b2-254aaa1755c8 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:56.403242 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67064973-81b7-4ada-94b2-254aaa1755c8 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:56.403687 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67064973-81b7-4ada-94b2-254aaa1755c8 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:56.404455 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67064973-81b7-4ada-94b2-254aaa1755c8 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:56.404884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67064973-81b7-4ada-94b2-254aaa1755c8 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:56.493580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-67064973-81b7-4ada-94b2-254aaa1755c8 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:56.504003 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-67064973-81b7-4ada-94b2-254aaa1755c8 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7" status: 200 len: 1199 microversion: 2.1 time: 0.121163 Nov 02 23:47:56.504582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2713/3288] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:56 2021] GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7 => generated 1199 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:47:57.519922 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d98842ee-8e86-4b43-9f1c-98e712cc1bf4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:57.520529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d98842ee-8e86-4b43-9f1c-98e712cc1bf4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:57.527977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d98842ee-8e86-4b43-9f1c-98e712cc1bf4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:57.528523 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d98842ee-8e86-4b43-9f1c-98e712cc1bf4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:57.529345 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d98842ee-8e86-4b43-9f1c-98e712cc1bf4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:57.529783 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d98842ee-8e86-4b43-9f1c-98e712cc1bf4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:57.684725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d98842ee-8e86-4b43-9f1c-98e712cc1bf4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:57.693195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d98842ee-8e86-4b43-9f1c-98e712cc1bf4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7" status: 200 len: 1265 microversion: 2.1 time: 0.176781 Nov 02 23:47:57.705784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2714/3289] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:57 2021] GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:58.057454 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-c96c5825-5cdd-4e1b-9979-3b0c60006fc2 req-3ddd9764-08de-420c-875d-10af99b841a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "805c9985-e8e5-4414-a1ec-068fcedefdf7", "tag": "c6be597a-fea4-470d-ad99-e5f17135b398"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:47:58.059697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:47:58.059697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:47:58.070875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-c96c5825-5cdd-4e1b-9979-3b0c60006fc2 req-3ddd9764-08de-420c-875d-10af99b841a2 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:58.071652 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-c96c5825-5cdd-4e1b-9979-3b0c60006fc2 req-3ddd9764-08de-420c-875d-10af99b841a2 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:58.087136 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-c96c5825-5cdd-4e1b-9979-3b0c60006fc2 req-3ddd9764-08de-420c-875d-10af99b841a2 service nova] Creating event network-changed:c6be597a-fea4-470d-ad99-e5f17135b398 for instance 805c9985-e8e5-4414-a1ec-068fcedefdf7 on hv-cinder-81584 Nov 02 23:47:58.099182 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-c96c5825-5cdd-4e1b-9979-3b0c60006fc2 req-3ddd9764-08de-420c-875d-10af99b841a2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211024 Nov 02 23:47:58.100071 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2715/3290] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:47:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:47:58.711869 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f8606edc-fc41-49ea-b3f6-eb97236e2ff4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:58.712561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-f8606edc-fc41-49ea-b3f6-eb97236e2ff4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:58.719082 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8606edc-fc41-49ea-b3f6-eb97236e2ff4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:58.719549 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8606edc-fc41-49ea-b3f6-eb97236e2ff4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:58.720307 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8606edc-fc41-49ea-b3f6-eb97236e2ff4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:58.720731 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-f8606edc-fc41-49ea-b3f6-eb97236e2ff4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:58.850648 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-f8606edc-fc41-49ea-b3f6-eb97236e2ff4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:47:58.857774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f8606edc-fc41-49ea-b3f6-eb97236e2ff4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7" status: 200 len: 1265 microversion: 2.1 time: 0.150756 Nov 02 23:47:58.858339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2716/3291] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:58 2021] GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:47:59.873353 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-703e1d5d-ddad-4982-8921-f835ce2180c9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:47:59.873958 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-703e1d5d-ddad-4982-8921-f835ce2180c9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:47:59.880171 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-703e1d5d-ddad-4982-8921-f835ce2180c9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:59.880617 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-703e1d5d-ddad-4982-8921-f835ce2180c9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:47:59.881379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-703e1d5d-ddad-4982-8921-f835ce2180c9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:47:59.881812 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-703e1d5d-ddad-4982-8921-f835ce2180c9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:00.011974 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-703e1d5d-ddad-4982-8921-f835ce2180c9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:48:00.019174 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-703e1d5d-ddad-4982-8921-f835ce2180c9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7" status: 200 len: 1265 microversion: 2.1 time: 0.149475 Nov 02 23:48:00.019785 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2717/3292] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:47:59 2021] GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:48:01.035888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-82c25491-37e6-4b5f-9a68-a8acee39928b tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:48:01.036488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-82c25491-37e6-4b5f-9a68-a8acee39928b tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:48:01.043225 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82c25491-37e6-4b5f-9a68-a8acee39928b tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:01.043702 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82c25491-37e6-4b5f-9a68-a8acee39928b tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:01.044578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82c25491-37e6-4b5f-9a68-a8acee39928b tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:01.045059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-82c25491-37e6-4b5f-9a68-a8acee39928b tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:01.171684 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-82c25491-37e6-4b5f-9a68-a8acee39928b tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:48:01.179130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-82c25491-37e6-4b5f-9a68-a8acee39928b tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7" status: 200 len: 1265 microversion: 2.1 time: 0.146971 Nov 02 23:48:01.179694 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2718/3293] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:48:01 2021] GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:48:02.196619 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-08732cd6-058e-42d4-9f34-ca94cc4bb255 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:48:02.197511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-08732cd6-058e-42d4-9f34-ca94cc4bb255 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:48:02.211488 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08732cd6-058e-42d4-9f34-ca94cc4bb255 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:02.211947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08732cd6-058e-42d4-9f34-ca94cc4bb255 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:02.212767 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08732cd6-058e-42d4-9f34-ca94cc4bb255 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:02.213206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-08732cd6-058e-42d4-9f34-ca94cc4bb255 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:02.373012 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-08732cd6-058e-42d4-9f34-ca94cc4bb255 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:48:02.380403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-08732cd6-058e-42d4-9f34-ca94cc4bb255 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7" status: 200 len: 1265 microversion: 2.1 time: 0.187901 Nov 02 23:48:02.381205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2719/3294] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:48:02 2021] GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:48:03.396957 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-248cfbfe-347a-471a-ac1d-82f7a058da8f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:48:03.397582 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-248cfbfe-347a-471a-ac1d-82f7a058da8f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:48:03.404537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-248cfbfe-347a-471a-ac1d-82f7a058da8f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:03.404982 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-248cfbfe-347a-471a-ac1d-82f7a058da8f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:03.405735 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-248cfbfe-347a-471a-ac1d-82f7a058da8f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:03.406157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-248cfbfe-347a-471a-ac1d-82f7a058da8f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:03.533318 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-248cfbfe-347a-471a-ac1d-82f7a058da8f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:48:03.540357 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-248cfbfe-347a-471a-ac1d-82f7a058da8f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7" status: 200 len: 1265 microversion: 2.1 time: 0.147074 Nov 02 23:48:03.540920 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2720/3295] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:48:03 2021] GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:48:04.557247 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d71fef43-7c8e-40c0-a1be-a65cc02c67b1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:48:04.558514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d71fef43-7c8e-40c0-a1be-a65cc02c67b1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:48:04.565410 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d71fef43-7c8e-40c0-a1be-a65cc02c67b1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:04.566001 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d71fef43-7c8e-40c0-a1be-a65cc02c67b1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:04.566803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d71fef43-7c8e-40c0-a1be-a65cc02c67b1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:04.567290 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d71fef43-7c8e-40c0-a1be-a65cc02c67b1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:04.700458 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-d71fef43-7c8e-40c0-a1be-a65cc02c67b1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:48:04.707757 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d71fef43-7c8e-40c0-a1be-a65cc02c67b1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7" status: 200 len: 1265 microversion: 2.1 time: 0.154322 Nov 02 23:48:04.708607 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2721/3296] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:48:04 2021] GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:48:05.724438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b3cc03bf-608f-49fd-8316-e574a33a5be0 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:48:05.725028 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b3cc03bf-608f-49fd-8316-e574a33a5be0 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:48:05.731234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3cc03bf-608f-49fd-8316-e574a33a5be0 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:05.731668 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3cc03bf-608f-49fd-8316-e574a33a5be0 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:05.732430 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3cc03bf-608f-49fd-8316-e574a33a5be0 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:05.733031 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b3cc03bf-608f-49fd-8316-e574a33a5be0 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:05.877821 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b3cc03bf-608f-49fd-8316-e574a33a5be0 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:48:05.885263 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b3cc03bf-608f-49fd-8316-e574a33a5be0 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7" status: 200 len: 1265 microversion: 2.1 time: 0.164487 Nov 02 23:48:05.885815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2722/3297] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:48:05 2021] GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:48:06.901326 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0f6661d4-0f1e-4d46-b19f-5666a129518d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:48:06.902815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0f6661d4-0f1e-4d46-b19f-5666a129518d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:48:06.909312 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0f6661d4-0f1e-4d46-b19f-5666a129518d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:06.909764 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0f6661d4-0f1e-4d46-b19f-5666a129518d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:06.910718 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0f6661d4-0f1e-4d46-b19f-5666a129518d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:06.911184 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0f6661d4-0f1e-4d46-b19f-5666a129518d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:07.052943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0f6661d4-0f1e-4d46-b19f-5666a129518d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:48:07.060083 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0f6661d4-0f1e-4d46-b19f-5666a129518d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7" status: 200 len: 1265 microversion: 2.1 time: 0.162490 Nov 02 23:48:07.060647 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2723/3298] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:48:06 2021] GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:48:08.076401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-537fbc21-c90f-4597-ba68-1e768338598f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:48:08.077047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-537fbc21-c90f-4597-ba68-1e768338598f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:48:08.083529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-537fbc21-c90f-4597-ba68-1e768338598f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:08.083983 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-537fbc21-c90f-4597-ba68-1e768338598f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:08.084751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-537fbc21-c90f-4597-ba68-1e768338598f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:08.085187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-537fbc21-c90f-4597-ba68-1e768338598f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:08.219022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-537fbc21-c90f-4597-ba68-1e768338598f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:48:08.226314 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-537fbc21-c90f-4597-ba68-1e768338598f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7" status: 200 len: 1265 microversion: 2.1 time: 0.153655 Nov 02 23:48:08.226880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2724/3299] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:48:08 2021] GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:48:09.242840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a53546f5-00bb-47ab-b15f-ddccd51df76d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:48:09.243473 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a53546f5-00bb-47ab-b15f-ddccd51df76d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:48:09.250351 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a53546f5-00bb-47ab-b15f-ddccd51df76d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:09.250816 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a53546f5-00bb-47ab-b15f-ddccd51df76d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:09.251606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a53546f5-00bb-47ab-b15f-ddccd51df76d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:09.252033 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a53546f5-00bb-47ab-b15f-ddccd51df76d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:09.380676 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a53546f5-00bb-47ab-b15f-ddccd51df76d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:48:09.387943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a53546f5-00bb-47ab-b15f-ddccd51df76d tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7" status: 200 len: 1265 microversion: 2.1 time: 0.148801 Nov 02 23:48:09.388506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2725/3300] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:48:09 2021] GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:48:09.533524 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-cebcf081-f822-44fa-aef3-376c3bf55cfd req-7a4632dd-c84e-4e1d-a36e-7a576000f6c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "805c9985-e8e5-4414-a1ec-068fcedefdf7", "name": "network-vif-plugged", "status": "completed", "tag": "c6be597a-fea4-470d-ad99-e5f17135b398"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:48:09.535040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:48:09.535040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:48:09.541885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-cebcf081-f822-44fa-aef3-376c3bf55cfd req-7a4632dd-c84e-4e1d-a36e-7a576000f6c3 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:09.542405 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-cebcf081-f822-44fa-aef3-376c3bf55cfd req-7a4632dd-c84e-4e1d-a36e-7a576000f6c3 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:09.554508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-cebcf081-f822-44fa-aef3-376c3bf55cfd req-7a4632dd-c84e-4e1d-a36e-7a576000f6c3 service nova] Creating event network-vif-plugged:c6be597a-fea4-470d-ad99-e5f17135b398 for instance 805c9985-e8e5-4414-a1ec-068fcedefdf7 on hv-cinder-81584 Nov 02 23:48:09.559371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-cebcf081-f822-44fa-aef3-376c3bf55cfd req-7a4632dd-c84e-4e1d-a36e-7a576000f6c3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029476 Nov 02 23:48:09.560107 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2726/3301] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:48:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:48:10.404574 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b15392ad-2ef0-42f7-929c-41a57a795dff tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:48:10.405262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b15392ad-2ef0-42f7-929c-41a57a795dff tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:48:10.411309 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b15392ad-2ef0-42f7-929c-41a57a795dff tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:10.411784 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b15392ad-2ef0-42f7-929c-41a57a795dff tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:10.412571 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b15392ad-2ef0-42f7-929c-41a57a795dff tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:10.413002 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b15392ad-2ef0-42f7-929c-41a57a795dff tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:10.542035 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b15392ad-2ef0-42f7-929c-41a57a795dff tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:48:10.549613 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b15392ad-2ef0-42f7-929c-41a57a795dff tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7" status: 200 len: 1265 microversion: 2.1 time: 0.149524 Nov 02 23:48:10.550177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2727/3302] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:48:10 2021] GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:48:11.566489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a4f39ab1-8f46-4812-93f0-aa079b3edc8c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:48:11.567166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a4f39ab1-8f46-4812-93f0-aa079b3edc8c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:48:11.573315 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a4f39ab1-8f46-4812-93f0-aa079b3edc8c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:11.573763 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a4f39ab1-8f46-4812-93f0-aa079b3edc8c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:11.575051 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a4f39ab1-8f46-4812-93f0-aa079b3edc8c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:11.575489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-a4f39ab1-8f46-4812-93f0-aa079b3edc8c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:11.726287 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a4f39ab1-8f46-4812-93f0-aa079b3edc8c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:48:11.733559 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a4f39ab1-8f46-4812-93f0-aa079b3edc8c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7" status: 200 len: 1452 microversion: 2.1 time: 0.170705 Nov 02 23:48:11.734135 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2728/3303] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:48:11 2021] GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7 => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:48:11.749401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5b7f3d23-2870-42d3-9f95-b0dc5522d22f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:48:11.750070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5b7f3d23-2870-42d3-9f95-b0dc5522d22f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:48:11.755746 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b7f3d23-2870-42d3-9f95-b0dc5522d22f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:11.756187 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b7f3d23-2870-42d3-9f95-b0dc5522d22f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:11.756942 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b7f3d23-2870-42d3-9f95-b0dc5522d22f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:11.757367 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b7f3d23-2870-42d3-9f95-b0dc5522d22f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:11.889388 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5b7f3d23-2870-42d3-9f95-b0dc5522d22f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:48:11.896766 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5b7f3d23-2870-42d3-9f95-b0dc5522d22f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7" status: 200 len: 1452 microversion: 2.1 time: 0.151295 Nov 02 23:48:11.897340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2729/3304] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:48:11 2021] GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:48:13.927708 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-d4d95e09-1459-4810-a625-072524dffc55 req-50ce6873-efbd-4c43-aa51-045774b5f6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "805c9985-e8e5-4414-a1ec-068fcedefdf7", "tag": "c6be597a-fea4-470d-ad99-e5f17135b398"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:48:13.929195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:48:13.929195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:48:13.937986 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-d4d95e09-1459-4810-a625-072524dffc55 req-50ce6873-efbd-4c43-aa51-045774b5f6b9 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:48:13.938438 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-d4d95e09-1459-4810-a625-072524dffc55 req-50ce6873-efbd-4c43-aa51-045774b5f6b9 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:48:13.950360 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-d4d95e09-1459-4810-a625-072524dffc55 req-50ce6873-efbd-4c43-aa51-045774b5f6b9 service nova] Creating event network-changed:c6be597a-fea4-470d-ad99-e5f17135b398 for instance 805c9985-e8e5-4414-a1ec-068fcedefdf7 on hv-cinder-81584 Nov 02 23:48:13.955716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-d4d95e09-1459-4810-a625-072524dffc55 req-50ce6873-efbd-4c43-aa51-045774b5f6b9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168748 Nov 02 23:48:13.956457 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2730/3305] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:48:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:49:18.455378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-d46039ea-7aff-4b1c-b3f0-d6135afc69b8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:49:18.455992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d46039ea-7aff-4b1c-b3f0-d6135afc69b8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:49:18.462076 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d46039ea-7aff-4b1c-b3f0-d6135afc69b8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:49:18.462550 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d46039ea-7aff-4b1c-b3f0-d6135afc69b8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:49:18.463365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d46039ea-7aff-4b1c-b3f0-d6135afc69b8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:49:18.463789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-d46039ea-7aff-4b1c-b3f0-d6135afc69b8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:49:18.488064 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-d46039ea-7aff-4b1c-b3f0-d6135afc69b8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Going to try to terminate instance {{(pid=115800) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 23:49:18.563352 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-d46039ea-7aff-4b1c-b3f0-d6135afc69b8 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "DELETE /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 204 len: 0 microversion: 2.1 time: 0.113091 Nov 02 23:49:18.563967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2731/3306] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:49:18 2021] DELETE /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 23:49:18.571914 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-073a85dd-471d-4500-9e25-f4d40a7224e1 req-90844129-9099-4b48-ab87-2ad9dea44563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a5250e-9bbd-4b25-b636-be74c540c2e0", "tag": "2164064c-8a25-4db4-90c4-9e83b8647e2f"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:49:18.573364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:49:18.573364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:49:18.580008 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-073a85dd-471d-4500-9e25-f4d40a7224e1 req-90844129-9099-4b48-ab87-2ad9dea44563 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:49:18.580465 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-073a85dd-471d-4500-9e25-f4d40a7224e1 req-90844129-9099-4b48-ab87-2ad9dea44563 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:49:18.591262 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-073a85dd-471d-4500-9e25-f4d40a7224e1 req-90844129-9099-4b48-ab87-2ad9dea44563 service nova] Creating event network-changed:2164064c-8a25-4db4-90c4-9e83b8647e2f for instance 11a5250e-9bbd-4b25-b636-be74c540c2e0 on hv-cinder-81584 Nov 02 23:49:18.596123 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-073a85dd-471d-4500-9e25-f4d40a7224e1 req-90844129-9099-4b48-ab87-2ad9dea44563 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030847 Nov 02 23:49:18.596707 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2732/3307] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:49:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:49:18.603915 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-bcf7febf-af18-4de5-b5df-f620a5ae741e tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:49:18.604593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-bcf7febf-af18-4de5-b5df-f620a5ae741e tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:49:18.610587 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcf7febf-af18-4de5-b5df-f620a5ae741e tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:49:18.611062 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcf7febf-af18-4de5-b5df-f620a5ae741e tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:49:18.611815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcf7febf-af18-4de5-b5df-f620a5ae741e tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:49:18.612238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-bcf7febf-af18-4de5-b5df-f620a5ae741e tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:49:18.860706 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-bcf7febf-af18-4de5-b5df-f620a5ae741e tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:49:18.868102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-bcf7febf-af18-4de5-b5df-f620a5ae741e tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1566 microversion: 2.1 time: 0.267898 Nov 02 23:49:18.868944 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2733/3308] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:49:18 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1566 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:49:19.885697 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-af488ba1-c58e-406c-9bee-4b52838ce947 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:49:19.886301 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-af488ba1-c58e-406c-9bee-4b52838ce947 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:49:19.892537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af488ba1-c58e-406c-9bee-4b52838ce947 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:49:19.892979 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af488ba1-c58e-406c-9bee-4b52838ce947 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:49:19.893771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af488ba1-c58e-406c-9bee-4b52838ce947 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:49:19.894198 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-af488ba1-c58e-406c-9bee-4b52838ce947 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:49:20.019704 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-af488ba1-c58e-406c-9bee-4b52838ce947 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:49:20.026815 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-af488ba1-c58e-406c-9bee-4b52838ce947 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1448 microversion: 2.1 time: 0.144736 Nov 02 23:49:20.027403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2734/3309] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:49:19 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1448 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:49:21.043596 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c6bcc4a4-8ffd-49fb-abde-a7dd4b1fe0a0 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:49:21.044463 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c6bcc4a4-8ffd-49fb-abde-a7dd4b1fe0a0 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:49:21.052061 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6bcc4a4-8ffd-49fb-abde-a7dd4b1fe0a0 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:49:21.052511 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6bcc4a4-8ffd-49fb-abde-a7dd4b1fe0a0 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:49:21.053279 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6bcc4a4-8ffd-49fb-abde-a7dd4b1fe0a0 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:49:21.053711 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c6bcc4a4-8ffd-49fb-abde-a7dd4b1fe0a0 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:49:21.121721 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c6bcc4a4-8ffd-49fb-abde-a7dd4b1fe0a0 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '158606c8e7a343e398b51938b828d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa88b966b74bb8a210e5c128cd055f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:49:21.130177 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c6bcc4a4-8ffd-49fb-abde-a7dd4b1fe0a0 tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 200 len: 1380 microversion: 2.1 time: 0.089503 Nov 02 23:49:21.130757 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2735/3310] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:49:21 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 1380 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:49:21.135415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-41b70257-c4e3-4593-a90a-cefe5cd2b963 req-645662f8-8cc4-41b1-9bbd-d4235bde5205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a5250e-9bbd-4b25-b636-be74c540c2e0", "name": "network-vif-deleted", "tag": "2164064c-8a25-4db4-90c4-9e83b8647e2f"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:49:21.137094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:49:21.137094 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:49:21.143861 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-41b70257-c4e3-4593-a90a-cefe5cd2b963 req-645662f8-8cc4-41b1-9bbd-d4235bde5205 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:49:21.144303 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-41b70257-c4e3-4593-a90a-cefe5cd2b963 req-645662f8-8cc4-41b1-9bbd-d4235bde5205 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:49:21.155088 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-41b70257-c4e3-4593-a90a-cefe5cd2b963 req-645662f8-8cc4-41b1-9bbd-d4235bde5205 service nova] Creating event network-vif-deleted:2164064c-8a25-4db4-90c4-9e83b8647e2f for instance 11a5250e-9bbd-4b25-b636-be74c540c2e0 on hv-cinder-81584 Nov 02 23:49:21.159893 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-41b70257-c4e3-4593-a90a-cefe5cd2b963 req-645662f8-8cc4-41b1-9bbd-d4235bde5205 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028023 Nov 02 23:49:21.160472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2736/3311] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:49:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:49:22.148771 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-db61a968-a9d8-4b30-b2b7-3be30cb22f5d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:49:22.149396 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-db61a968-a9d8-4b30-b2b7-3be30cb22f5d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] [instance: 11a5250e-9bbd-4b25-b636-be74c540c2e0] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:49:22.155415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db61a968-a9d8-4b30-b2b7-3be30cb22f5d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:49:22.155863 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db61a968-a9d8-4b30-b2b7-3be30cb22f5d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:49:22.156616 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db61a968-a9d8-4b30-b2b7-3be30cb22f5d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:49:22.157047 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-db61a968-a9d8-4b30-b2b7-3be30cb22f5d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:49:22.169537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-db61a968-a9d8-4b30-b2b7-3be30cb22f5d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] HTTP exception thrown: Instance 11a5250e-9bbd-4b25-b636-be74c540c2e0 could not be found. Nov 02 23:49:22.170111 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-db61a968-a9d8-4b30-b2b7-3be30cb22f5d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Returning 404 to user: Instance 11a5250e-9bbd-4b25-b636-be74c540c2e0 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:49:22.170909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-db61a968-a9d8-4b30-b2b7-3be30cb22f5d tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0" status: 404 len: 111 microversion: 2.1 time: 0.027564 Nov 02 23:49:22.171449 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2737/3312] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:49:22 2021] GET /compute/v2.1/servers/11a5250e-9bbd-4b25-b636-be74c540c2e0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 23:49:22.326884 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-f3c4c38c-6a65-40b2-8937-712580cd326b tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] Calling method '.version_select at 0x7fd85c6eba60>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:49:22.349972 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-f3c4c38c-6a65-40b2-8937-712580cd326b tempest-TestShelveInstance-1634938493 tempest-TestShelveInstance-1634938493-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-204735838" status: 202 len: 0 microversion: 2.1 time: 0.026663 Nov 02 23:49:22.350678 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2738/3313] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Nov 2 23:49:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-204735838 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:50:27.319709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-17208fed-0e83-458d-8939-f4c266b5aafe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1329223720", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-426019499", "security_groups": [{"name": "tempest-secgroup-smoke-1479964763"}], "block_device_mapping_v2": [{"uuid": "b9dbf74b-3d6d-451f-8f4e-807c1a5e8351", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6cf98e03-e201-449c-a229-2b590bdb1187"}]}} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:50:27.428079 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.network.neutron [None req-17208fed-0e83-458d-8939-f4c266b5aafe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] validate_networks() for [('6cf98e03-e201-449c-a229-2b590bdb1187', None, None, None, None, None)] {{(pid=115800) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 23:50:27.875724 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-17208fed-0e83-458d-8939-f4c266b5aafe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Flavor limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 23:50:27.876200 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-17208fed-0e83-458d-8939-f4c266b5aafe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Image limits 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 23:50:27.876696 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-17208fed-0e83-458d-8939-f4c266b5aafe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Flavor pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 23:50:27.877099 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-17208fed-0e83-458d-8939-f4c266b5aafe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Image pref 0:0:0 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 23:50:27.877556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.virt.hardware [None req-17208fed-0e83-458d-8939-f4c266b5aafe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 23:50:27.886436 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17208fed-0e83-458d-8939-f4c266b5aafe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:27.886876 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17208fed-0e83-458d-8939-f4c266b5aafe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:27.887700 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17208fed-0e83-458d-8939-f4c266b5aafe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:27.888138 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-17208fed-0e83-458d-8939-f4c266b5aafe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:27.904391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-17208fed-0e83-458d-8939-f4c266b5aafe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Getting quotas for project efb44064bb93455f8407c8eec29a03f0. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 23:50:27.908220 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.quota [None req-17208fed-0e83-458d-8939-f4c266b5aafe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Getting quotas for user 7be44ffed515408bafef59166c9d0175 and project efb44064bb93455f8407c8eec29a03f0. Resources: {'cores', 'instances', 'ram'} {{(pid=115800) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 23:50:27.961152 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-17208fed-0e83-458d-8939-f4c266b5aafe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Going to run 1 instances... {{(pid=115800) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 23:50:27.963268 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-17208fed-0e83-458d-8939-f4c266b5aafe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b9dbf74b-3d6d-451f-8f4e-807c1a5e8351',volume_size=None,volume_type=None)] {{(pid=115800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 23:50:28.081987 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: ERROR oslo.messaging._drivers.impl_rabbit [None req-17208fed-0e83-458d-8939-f4c266b5aafe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [ee1d70c2-7f81-41bf-8f74-9b584257f6bc] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 23:50:29.100296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [None req-17208fed-0e83-458d-8939-f4c266b5aafe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [ee1d70c2-7f81-41bf-8f74-9b584257f6bc] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 58914. Nov 02 23:50:29.104934 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-17208fed-0e83-458d-8939-f4c266b5aafe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.790179 Nov 02 23:50:29.105606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2739/3314] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 2 23:50:27 2021] POST /compute/v2.1/servers => generated 406 bytes in 1791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 23:50:29.114894 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-261d84be-e430-498a-a547-be1ab4c2f37b tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:50:29.115525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-261d84be-e430-498a-a547-be1ab4c2f37b tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:50:29.170304 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-261d84be-e430-498a-a547-be1ab4c2f37b tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:50:29.176997 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-261d84be-e430-498a-a547-be1ab4c2f37b tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1094 microversion: 2.1 time: 0.065512 Nov 02 23:50:29.177558 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2740/3315] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:50:29 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:50:30.193176 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b6bfced2-7e0b-400d-90d7-20856bd6f8c2 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:50:30.193807 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b6bfced2-7e0b-400d-90d7-20856bd6f8c2 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:50:30.245518 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b6bfced2-7e0b-400d-90d7-20856bd6f8c2 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:50:30.252532 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b6bfced2-7e0b-400d-90d7-20856bd6f8c2 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1094 microversion: 2.1 time: 0.062922 Nov 02 23:50:30.253090 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2741/3316] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:50:30 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1094 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:50:31.269219 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-a93e41a0-bd10-4111-aad7-5662a51476ec tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:50:31.269829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-a93e41a0-bd10-4111-aad7-5662a51476ec tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:50:31.319940 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-a93e41a0-bd10-4111-aad7-5662a51476ec tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:50:31.326883 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-a93e41a0-bd10-4111-aad7-5662a51476ec tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1094 microversion: 2.1 time: 0.061433 Nov 02 23:50:31.335951 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2742/3317] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:50:31 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1094 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:50:32.343216 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3ae7081f-e1aa-490e-9891-dce108d6191c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:50:32.343822 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3ae7081f-e1aa-490e-9891-dce108d6191c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:50:32.393526 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3ae7081f-e1aa-490e-9891-dce108d6191c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:50:32.400544 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3ae7081f-e1aa-490e-9891-dce108d6191c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1094 microversion: 2.1 time: 0.060997 Nov 02 23:50:32.403475 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2743/3318] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:50:32 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:50:33.419936 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-945d63d4-2859-412d-9330-a9dabba7d1bd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:50:33.420538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-945d63d4-2859-412d-9330-a9dabba7d1bd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:50:33.427072 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-945d63d4-2859-412d-9330-a9dabba7d1bd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:33.427521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-945d63d4-2859-412d-9330-a9dabba7d1bd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:33.428288 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-945d63d4-2859-412d-9330-a9dabba7d1bd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:33.428725 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-945d63d4-2859-412d-9330-a9dabba7d1bd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:33.485415 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-945d63d4-2859-412d-9330-a9dabba7d1bd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:50:33.492679 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-945d63d4-2859-412d-9330-a9dabba7d1bd tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1144 microversion: 2.1 time: 0.076366 Nov 02 23:50:33.493251 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2744/3319] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:50:33 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1144 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:50:34.509068 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5f76ecae-590e-42c6-9db7-1f3c64406e34 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:50:34.509769 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5f76ecae-590e-42c6-9db7-1f3c64406e34 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:50:34.516273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f76ecae-590e-42c6-9db7-1f3c64406e34 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:34.516722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f76ecae-590e-42c6-9db7-1f3c64406e34 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:34.517506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f76ecae-590e-42c6-9db7-1f3c64406e34 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:34.517941 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5f76ecae-590e-42c6-9db7-1f3c64406e34 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:34.578947 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5f76ecae-590e-42c6-9db7-1f3c64406e34 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:50:34.586296 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5f76ecae-590e-42c6-9db7-1f3c64406e34 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1210 microversion: 2.1 time: 0.080883 Nov 02 23:50:34.586888 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2745/3320] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:50:34 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1210 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:50:35.602849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7f3031c2-eaec-403d-831d-59273d1c8b49 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:50:35.603506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7f3031c2-eaec-403d-831d-59273d1c8b49 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:50:35.610142 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f3031c2-eaec-403d-831d-59273d1c8b49 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:35.610814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f3031c2-eaec-403d-831d-59273d1c8b49 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:35.611699 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f3031c2-eaec-403d-831d-59273d1c8b49 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:35.612257 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7f3031c2-eaec-403d-831d-59273d1c8b49 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:35.759403 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7f3031c2-eaec-403d-831d-59273d1c8b49 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:50:35.767010 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7f3031c2-eaec-403d-831d-59273d1c8b49 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1266 microversion: 2.1 time: 0.167778 Nov 02 23:50:35.767578 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2746/3321] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:50:35 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:50:35.895789 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-8182c859-5b7a-404b-bb28-b25c60c5458b req-3d3b3204-20d0-4008-aaea-a882b17bd60f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "696386c3-73b5-42d9-b14d-b303e9f44e2a", "tag": "7c4eb6fd-9745-4b8d-8be3-800a59a6dcf8"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:50:35.898167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:50:35.898167 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:50:35.905741 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-8182c859-5b7a-404b-bb28-b25c60c5458b req-3d3b3204-20d0-4008-aaea-a882b17bd60f service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:35.906205 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-8182c859-5b7a-404b-bb28-b25c60c5458b req-3d3b3204-20d0-4008-aaea-a882b17bd60f service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:35.919507 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-8182c859-5b7a-404b-bb28-b25c60c5458b req-3d3b3204-20d0-4008-aaea-a882b17bd60f service nova] Creating event network-changed:7c4eb6fd-9745-4b8d-8be3-800a59a6dcf8 for instance 696386c3-73b5-42d9-b14d-b303e9f44e2a on hv-cinder-81584 Nov 02 23:50:35.924508 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-8182c859-5b7a-404b-bb28-b25c60c5458b req-3d3b3204-20d0-4008-aaea-a882b17bd60f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041454 Nov 02 23:50:35.925173 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2747/3322] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:50:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:50:36.784594 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-749e277e-291d-42a3-968e-a3260852a1ec tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:50:36.785292 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-749e277e-291d-42a3-968e-a3260852a1ec tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:50:36.791361 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-749e277e-291d-42a3-968e-a3260852a1ec tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:36.791812 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-749e277e-291d-42a3-968e-a3260852a1ec tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:36.792583 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-749e277e-291d-42a3-968e-a3260852a1ec tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:36.793019 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-749e277e-291d-42a3-968e-a3260852a1ec tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:36.924930 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-749e277e-291d-42a3-968e-a3260852a1ec tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:50:36.932340 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-749e277e-291d-42a3-968e-a3260852a1ec tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1266 microversion: 2.1 time: 0.152209 Nov 02 23:50:36.932899 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2748/3323] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:50:36 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:50:37.948472 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-1d37d5bb-d953-492a-9c4c-8716855c16b7 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:50:37.949030 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-1d37d5bb-d953-492a-9c4c-8716855c16b7 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:50:37.955188 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d37d5bb-d953-492a-9c4c-8716855c16b7 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:37.955629 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d37d5bb-d953-492a-9c4c-8716855c16b7 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:37.956379 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d37d5bb-d953-492a-9c4c-8716855c16b7 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:37.956808 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-1d37d5bb-d953-492a-9c4c-8716855c16b7 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:38.090966 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-1d37d5bb-d953-492a-9c4c-8716855c16b7 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:50:38.098140 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-1d37d5bb-d953-492a-9c4c-8716855c16b7 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1266 microversion: 2.1 time: 0.153316 Nov 02 23:50:38.098706 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2749/3324] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:50:37 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:50:39.115270 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-28a3b44e-8604-4572-87f3-fa594c2b4497 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:50:39.115915 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-28a3b44e-8604-4572-87f3-fa594c2b4497 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:50:39.122521 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-28a3b44e-8604-4572-87f3-fa594c2b4497 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:39.122985 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-28a3b44e-8604-4572-87f3-fa594c2b4497 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:39.123741 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-28a3b44e-8604-4572-87f3-fa594c2b4497 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:39.124165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-28a3b44e-8604-4572-87f3-fa594c2b4497 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:39.251745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-28a3b44e-8604-4572-87f3-fa594c2b4497 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:50:39.258950 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-28a3b44e-8604-4572-87f3-fa594c2b4497 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1266 microversion: 2.1 time: 0.147303 Nov 02 23:50:39.259519 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2750/3325] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:50:39 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:50:40.274634 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-e9b28b3d-50a6-47a9-aba4-1dfa23b61efe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:50:40.275269 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-e9b28b3d-50a6-47a9-aba4-1dfa23b61efe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:50:40.281363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9b28b3d-50a6-47a9-aba4-1dfa23b61efe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:40.281801 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9b28b3d-50a6-47a9-aba4-1dfa23b61efe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:40.282555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9b28b3d-50a6-47a9-aba4-1dfa23b61efe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:40.283017 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-e9b28b3d-50a6-47a9-aba4-1dfa23b61efe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:40.419583 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-e9b28b3d-50a6-47a9-aba4-1dfa23b61efe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:50:40.426927 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-e9b28b3d-50a6-47a9-aba4-1dfa23b61efe tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1266 microversion: 2.1 time: 0.155951 Nov 02 23:50:40.427520 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2751/3326] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:50:40 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:50:41.443855 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-67bc5379-cf20-404a-b98e-8269dc28ba50 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:50:41.444471 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-67bc5379-cf20-404a-b98e-8269dc28ba50 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:50:41.451162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67bc5379-cf20-404a-b98e-8269dc28ba50 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:41.451605 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67bc5379-cf20-404a-b98e-8269dc28ba50 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:41.452365 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67bc5379-cf20-404a-b98e-8269dc28ba50 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:41.452791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-67bc5379-cf20-404a-b98e-8269dc28ba50 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:41.582525 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-67bc5379-cf20-404a-b98e-8269dc28ba50 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:50:41.589649 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-67bc5379-cf20-404a-b98e-8269dc28ba50 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1266 microversion: 2.1 time: 0.149494 Nov 02 23:50:41.590212 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2752/3327] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:50:41 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:50:42.606391 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-7646b3c9-be27-4117-8bf7-5a2d16952845 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:50:42.607045 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-7646b3c9-be27-4117-8bf7-5a2d16952845 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:50:42.613210 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7646b3c9-be27-4117-8bf7-5a2d16952845 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:42.613655 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7646b3c9-be27-4117-8bf7-5a2d16952845 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:42.614413 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7646b3c9-be27-4117-8bf7-5a2d16952845 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:42.614851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-7646b3c9-be27-4117-8bf7-5a2d16952845 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:42.741991 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-7646b3c9-be27-4117-8bf7-5a2d16952845 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:50:42.749186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-7646b3c9-be27-4117-8bf7-5a2d16952845 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1266 microversion: 2.1 time: 0.147032 Nov 02 23:50:42.749751 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2753/3328] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:50:42 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:50:43.765905 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-3019d66e-6ad8-4213-9e56-b1f1b01c4975 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:50:43.766558 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-3019d66e-6ad8-4213-9e56-b1f1b01c4975 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:50:43.772954 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3019d66e-6ad8-4213-9e56-b1f1b01c4975 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:43.773396 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3019d66e-6ad8-4213-9e56-b1f1b01c4975 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:43.774186 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3019d66e-6ad8-4213-9e56-b1f1b01c4975 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:43.774614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-3019d66e-6ad8-4213-9e56-b1f1b01c4975 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:43.905716 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-3019d66e-6ad8-4213-9e56-b1f1b01c4975 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:50:43.912817 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-3019d66e-6ad8-4213-9e56-b1f1b01c4975 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1266 microversion: 2.1 time: 0.150586 Nov 02 23:50:43.913377 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2754/3329] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:50:43 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:50:44.930189 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-63d5f833-4379-482b-a520-ac4f581ba565 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:50:44.930839 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-63d5f833-4379-482b-a520-ac4f581ba565 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:50:44.937548 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-63d5f833-4379-482b-a520-ac4f581ba565 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:44.937992 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-63d5f833-4379-482b-a520-ac4f581ba565 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:44.938762 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-63d5f833-4379-482b-a520-ac4f581ba565 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:44.939224 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-63d5f833-4379-482b-a520-ac4f581ba565 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:45.069364 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-63d5f833-4379-482b-a520-ac4f581ba565 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:50:45.076664 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-63d5f833-4379-482b-a520-ac4f581ba565 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1266 microversion: 2.1 time: 0.150373 Nov 02 23:50:45.077166 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2755/3330] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:50:44 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:50:46.093458 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0e8b85ab-f050-4903-82fd-a8c007f5b40f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:50:46.094080 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0e8b85ab-f050-4903-82fd-a8c007f5b40f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:50:46.100157 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e8b85ab-f050-4903-82fd-a8c007f5b40f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:46.100598 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e8b85ab-f050-4903-82fd-a8c007f5b40f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:46.101349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e8b85ab-f050-4903-82fd-a8c007f5b40f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:46.101774 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0e8b85ab-f050-4903-82fd-a8c007f5b40f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:46.234006 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-0e8b85ab-f050-4903-82fd-a8c007f5b40f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:50:46.241556 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0e8b85ab-f050-4903-82fd-a8c007f5b40f tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1266 microversion: 2.1 time: 0.151775 Nov 02 23:50:46.242117 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2756/3331] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:50:46 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:50:46.486239 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-10379d80-19b5-4efa-a931-f8494e5b6d41 req-d66ff7c8-a1b8-4a12-b57e-3e177a157f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "696386c3-73b5-42d9-b14d-b303e9f44e2a", "name": "network-vif-plugged", "status": "completed", "tag": "7c4eb6fd-9745-4b8d-8be3-800a59a6dcf8"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:50:46.487822 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:50:46.487822 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:50:46.495102 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-10379d80-19b5-4efa-a931-f8494e5b6d41 req-d66ff7c8-a1b8-4a12-b57e-3e177a157f48 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:46.495542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-10379d80-19b5-4efa-a931-f8494e5b6d41 req-d66ff7c8-a1b8-4a12-b57e-3e177a157f48 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:46.505628 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-10379d80-19b5-4efa-a931-f8494e5b6d41 req-d66ff7c8-a1b8-4a12-b57e-3e177a157f48 service nova] Creating event network-vif-plugged:7c4eb6fd-9745-4b8d-8be3-800a59a6dcf8 for instance 696386c3-73b5-42d9-b14d-b303e9f44e2a on hv-cinder-81584 Nov 02 23:50:46.510593 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-10379d80-19b5-4efa-a931-f8494e5b6d41 req-d66ff7c8-a1b8-4a12-b57e-3e177a157f48 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152939 Nov 02 23:50:46.511195 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2757/3332] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:50:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:50:47.261116 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-ab3738e9-9a43-465a-8721-762ddee49b2c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:50:47.261803 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-ab3738e9-9a43-465a-8721-762ddee49b2c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:50:47.267829 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ab3738e9-9a43-465a-8721-762ddee49b2c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:47.268269 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ab3738e9-9a43-465a-8721-762ddee49b2c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:47.269019 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ab3738e9-9a43-465a-8721-762ddee49b2c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:47.269444 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-ab3738e9-9a43-465a-8721-762ddee49b2c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:47.399671 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-ab3738e9-9a43-465a-8721-762ddee49b2c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:50:47.407375 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-ab3738e9-9a43-465a-8721-762ddee49b2c tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1266 microversion: 2.1 time: 0.151208 Nov 02 23:50:47.407943 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2758/3333] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:50:47 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:50:48.423791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5b2464c1-245b-4952-a963-bf7913565338 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:50:48.424452 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5b2464c1-245b-4952-a963-bf7913565338 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:50:48.431459 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b2464c1-245b-4952-a963-bf7913565338 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:48.432005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b2464c1-245b-4952-a963-bf7913565338 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:48.432778 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b2464c1-245b-4952-a963-bf7913565338 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:48.433216 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5b2464c1-245b-4952-a963-bf7913565338 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:48.562531 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-5b2464c1-245b-4952-a963-bf7913565338 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:50:48.569681 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5b2464c1-245b-4952-a963-bf7913565338 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1266 microversion: 2.1 time: 0.149613 Nov 02 23:50:48.570238 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2759/3334] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:50:48 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:50:49.585640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-c8cf6618-2083-484f-8fcf-66cfa9631ab1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:50:49.586310 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-c8cf6618-2083-484f-8fcf-66cfa9631ab1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:50:49.593036 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8cf6618-2083-484f-8fcf-66cfa9631ab1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:49.593481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8cf6618-2083-484f-8fcf-66cfa9631ab1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:49.594239 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8cf6618-2083-484f-8fcf-66cfa9631ab1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:49.594669 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-c8cf6618-2083-484f-8fcf-66cfa9631ab1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:49.725227 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-c8cf6618-2083-484f-8fcf-66cfa9631ab1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:50:49.732440 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-c8cf6618-2083-484f-8fcf-66cfa9631ab1 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1453 microversion: 2.1 time: 0.150464 Nov 02 23:50:49.733005 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2760/3335] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:50:49 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:50:49.747976 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-048bcd79-3bc1-4368-968c-4e0ce8d6f5fb tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:50:49.748565 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-048bcd79-3bc1-4368-968c-4e0ce8d6f5fb tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:50:49.753899 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-048bcd79-3bc1-4368-968c-4e0ce8d6f5fb tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:49.754339 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-048bcd79-3bc1-4368-968c-4e0ce8d6f5fb tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:49.755127 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-048bcd79-3bc1-4368-968c-4e0ce8d6f5fb tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:49.755555 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-048bcd79-3bc1-4368-968c-4e0ce8d6f5fb tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:49.882782 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-048bcd79-3bc1-4368-968c-4e0ce8d6f5fb tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:50:49.890477 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-048bcd79-3bc1-4368-968c-4e0ce8d6f5fb tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1453 microversion: 2.1 time: 0.145734 Nov 02 23:50:49.891059 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2761/3336] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:50:49 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1453 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:50:51.533489 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-48c54b89-ab68-42f3-a71f-21704a4ab85a req-101e2581-0cca-42ca-aa4f-6443cf480bde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "696386c3-73b5-42d9-b14d-b303e9f44e2a", "tag": "7c4eb6fd-9745-4b8d-8be3-800a59a6dcf8"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:50:51.535062 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:50:51.535062 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:50:51.542734 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-48c54b89-ab68-42f3-a71f-21704a4ab85a req-101e2581-0cca-42ca-aa4f-6443cf480bde service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:50:51.543203 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-48c54b89-ab68-42f3-a71f-21704a4ab85a req-101e2581-0cca-42ca-aa4f-6443cf480bde service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:50:51.554478 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-48c54b89-ab68-42f3-a71f-21704a4ab85a req-101e2581-0cca-42ca-aa4f-6443cf480bde service nova] Creating event network-changed:7c4eb6fd-9745-4b8d-8be3-800a59a6dcf8 for instance 696386c3-73b5-42d9-b14d-b303e9f44e2a on hv-cinder-81584 Nov 02 23:50:51.559561 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-48c54b89-ab68-42f3-a71f-21704a4ab85a req-101e2581-0cca-42ca-aa4f-6443cf480bde service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029932 Nov 02 23:50:51.560221 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2762/3337] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:50:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:52:17.765512 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:52:17.766172 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:52:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 23:52:41.750846 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-faff2e43-de8e-46d7-9278-cd973fd7cdaf tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:52:41.751541 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-faff2e43-de8e-46d7-9278-cd973fd7cdaf tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:52:41.757729 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-faff2e43-de8e-46d7-9278-cd973fd7cdaf tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:41.758181 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-faff2e43-de8e-46d7-9278-cd973fd7cdaf tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:41.758968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-faff2e43-de8e-46d7-9278-cd973fd7cdaf tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:41.759428 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-faff2e43-de8e-46d7-9278-cd973fd7cdaf tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:41.783169 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-faff2e43-de8e-46d7-9278-cd973fd7cdaf tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Going to try to terminate instance {{(pid=115800) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 23:52:41.858371 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-faff2e43-de8e-46d7-9278-cd973fd7cdaf tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "DELETE /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 204 len: 0 microversion: 2.1 time: 0.113341 Nov 02 23:52:41.859040 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2763/3338] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:52:41 2021] DELETE /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 23:52:41.864840 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-83acb830-09f2-47e8-b889-327d487fceee req-2a542435-0311-4c7b-86b3-99370ef32281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "696386c3-73b5-42d9-b14d-b303e9f44e2a", "tag": "7c4eb6fd-9745-4b8d-8be3-800a59a6dcf8"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:52:41.866583 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:52:41.866583 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:52:41.873743 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-83acb830-09f2-47e8-b889-327d487fceee req-2a542435-0311-4c7b-86b3-99370ef32281 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:41.874173 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-83acb830-09f2-47e8-b889-327d487fceee req-2a542435-0311-4c7b-86b3-99370ef32281 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:41.884937 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-83acb830-09f2-47e8-b889-327d487fceee req-2a542435-0311-4c7b-86b3-99370ef32281 service nova] Creating event network-changed:7c4eb6fd-9745-4b8d-8be3-800a59a6dcf8 for instance 696386c3-73b5-42d9-b14d-b303e9f44e2a on hv-cinder-81584 Nov 02 23:52:41.889791 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-83acb830-09f2-47e8-b889-327d487fceee req-2a542435-0311-4c7b-86b3-99370ef32281 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029464 Nov 02 23:52:41.890363 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2764/3339] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:52:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:52:41.895074 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-da5b69d9-45f0-48c8-8c0a-a6b0bff6aad0 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:52:41.895752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-da5b69d9-45f0-48c8-8c0a-a6b0bff6aad0 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:52:41.901494 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-da5b69d9-45f0-48c8-8c0a-a6b0bff6aad0 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:41.901932 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-da5b69d9-45f0-48c8-8c0a-a6b0bff6aad0 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:41.902709 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-da5b69d9-45f0-48c8-8c0a-a6b0bff6aad0 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:41.903162 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-da5b69d9-45f0-48c8-8c0a-a6b0bff6aad0 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:42.038075 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-da5b69d9-45f0-48c8-8c0a-a6b0bff6aad0 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:52:42.047288 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-da5b69d9-45f0-48c8-8c0a-a6b0bff6aad0 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1578 microversion: 2.1 time: 0.155745 Nov 02 23:52:42.048165 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2765/3340] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:52:41 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:52:43.065576 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-25fe4f5d-a8ba-470f-86d2-a6ad761178db tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:52:43.066193 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-25fe4f5d-a8ba-470f-86d2-a6ad761178db tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:52:43.072429 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25fe4f5d-a8ba-470f-86d2-a6ad761178db tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:43.072875 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25fe4f5d-a8ba-470f-86d2-a6ad761178db tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:43.073633 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25fe4f5d-a8ba-470f-86d2-a6ad761178db tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:43.074062 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-25fe4f5d-a8ba-470f-86d2-a6ad761178db tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:43.206401 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-25fe4f5d-a8ba-470f-86d2-a6ad761178db tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:52:43.213580 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-25fe4f5d-a8ba-470f-86d2-a6ad761178db tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1459 microversion: 2.1 time: 0.151688 Nov 02 23:52:43.214137 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2766/3341] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:52:43 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1459 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:52:44.231022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-dadc1598-d67b-45fc-a672-bf8c105098cf tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:52:44.231022 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-dadc1598-d67b-45fc-a672-bf8c105098cf tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:52:44.236264 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dadc1598-d67b-45fc-a672-bf8c105098cf tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:44.236722 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dadc1598-d67b-45fc-a672-bf8c105098cf tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:44.237481 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dadc1598-d67b-45fc-a672-bf8c105098cf tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:44.237909 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-dadc1598-d67b-45fc-a672-bf8c105098cf tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:44.299431 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-dadc1598-d67b-45fc-a672-bf8c105098cf tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:52:44.306990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-dadc1598-d67b-45fc-a672-bf8c105098cf tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 200 len: 1391 microversion: 2.1 time: 0.081199 Nov 02 23:52:44.307770 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2767/3342] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:52:44 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 1391 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:52:44.330851 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-1828c1f9-1e26-4a35-bd59-e36fc7dc7793 req-073881b1-f4cd-4092-b352-45ebc770fb9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "696386c3-73b5-42d9-b14d-b303e9f44e2a", "name": "network-vif-deleted", "tag": "7c4eb6fd-9745-4b8d-8be3-800a59a6dcf8"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:52:44.332452 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:52:44.332452 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:52:44.339378 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-1828c1f9-1e26-4a35-bd59-e36fc7dc7793 req-073881b1-f4cd-4092-b352-45ebc770fb9f service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:44.339836 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-1828c1f9-1e26-4a35-bd59-e36fc7dc7793 req-073881b1-f4cd-4092-b352-45ebc770fb9f service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:44.352975 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-1828c1f9-1e26-4a35-bd59-e36fc7dc7793 req-073881b1-f4cd-4092-b352-45ebc770fb9f service nova] Creating event network-vif-deleted:7c4eb6fd-9745-4b8d-8be3-800a59a6dcf8 for instance 696386c3-73b5-42d9-b14d-b303e9f44e2a on hv-cinder-81584 Nov 02 23:52:44.357968 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-1828c1f9-1e26-4a35-bd59-e36fc7dc7793 req-073881b1-f4cd-4092-b352-45ebc770fb9f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030657 Nov 02 23:52:44.358576 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2768/3343] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:52:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:52:45.324831 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-05262549-698d-4b65-9ecf-8908098324b4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:52:45.325542 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-05262549-698d-4b65-9ecf-8908098324b4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 696386c3-73b5-42d9-b14d-b303e9f44e2a] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:52:45.331486 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05262549-698d-4b65-9ecf-8908098324b4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:45.331935 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05262549-698d-4b65-9ecf-8908098324b4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:45.332696 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05262549-698d-4b65-9ecf-8908098324b4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:45.333130 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-05262549-698d-4b65-9ecf-8908098324b4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:45.346255 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-05262549-698d-4b65-9ecf-8908098324b4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] HTTP exception thrown: Instance 696386c3-73b5-42d9-b14d-b303e9f44e2a could not be found. Nov 02 23:52:45.346835 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-05262549-698d-4b65-9ecf-8908098324b4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Returning 404 to user: Instance 696386c3-73b5-42d9-b14d-b303e9f44e2a could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:52:45.347674 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-05262549-698d-4b65-9ecf-8908098324b4 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a" status: 404 len: 111 microversion: 2.1 time: 0.027381 Nov 02 23:52:45.348185 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2769/3344] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:52:45 2021] GET /compute/v2.1/servers/696386c3-73b5-42d9-b14d-b303e9f44e2a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 23:52:48.366538 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-768aa8c5-aeed-4075-b5eb-21439ab78b82 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:52:48.367202 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-768aa8c5-aeed-4075-b5eb-21439ab78b82 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:52:48.373727 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-768aa8c5-aeed-4075-b5eb-21439ab78b82 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:48.374170 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-768aa8c5-aeed-4075-b5eb-21439ab78b82 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:48.374935 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-768aa8c5-aeed-4075-b5eb-21439ab78b82 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:48.375362 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-768aa8c5-aeed-4075-b5eb-21439ab78b82 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:48.399599 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-768aa8c5-aeed-4075-b5eb-21439ab78b82 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] Going to try to terminate instance {{(pid=115800) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 23:52:48.473882 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-768aa8c5-aeed-4075-b5eb-21439ab78b82 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "DELETE /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7" status: 204 len: 0 microversion: 2.1 time: 0.110818 Nov 02 23:52:48.474554 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2770/3345] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:52:48 2021] DELETE /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 23:52:48.480206 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-e2d7dcb6-1d85-41b4-ab30-753a568a0519 req-b6737e42-b98b-4aef-ab33-1fc0886f76a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "805c9985-e8e5-4414-a1ec-068fcedefdf7", "tag": "c6be597a-fea4-470d-ad99-e5f17135b398"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:52:48.481880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:52:48.481880 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:52:48.488625 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-e2d7dcb6-1d85-41b4-ab30-753a568a0519 req-b6737e42-b98b-4aef-ab33-1fc0886f76a8 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:48.489070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-e2d7dcb6-1d85-41b4-ab30-753a568a0519 req-b6737e42-b98b-4aef-ab33-1fc0886f76a8 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:48.500744 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-e2d7dcb6-1d85-41b4-ab30-753a568a0519 req-b6737e42-b98b-4aef-ab33-1fc0886f76a8 service nova] Creating event network-changed:c6be597a-fea4-470d-ad99-e5f17135b398 for instance 805c9985-e8e5-4414-a1ec-068fcedefdf7 on hv-cinder-81584 Nov 02 23:52:48.505485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-e2d7dcb6-1d85-41b4-ab30-753a568a0519 req-b6737e42-b98b-4aef-ab33-1fc0886f76a8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029506 Nov 02 23:52:48.506070 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2771/3346] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:52:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:52:48.510849 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-4e3f2d7b-9478-43bb-9a57-0688e62edbdc tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:52:48.511577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-4e3f2d7b-9478-43bb-9a57-0688e62edbdc tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:52:48.518069 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e3f2d7b-9478-43bb-9a57-0688e62edbdc tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:48.518529 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e3f2d7b-9478-43bb-9a57-0688e62edbdc tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:48.519330 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e3f2d7b-9478-43bb-9a57-0688e62edbdc tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:48.519765 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-4e3f2d7b-9478-43bb-9a57-0688e62edbdc tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:48.663648 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-4e3f2d7b-9478-43bb-9a57-0688e62edbdc tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:52:48.672614 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-4e3f2d7b-9478-43bb-9a57-0688e62edbdc tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7" status: 200 len: 1577 microversion: 2.1 time: 0.165298 Nov 02 23:52:48.673450 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2772/3347] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:52:48 2021] GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:52:49.690273 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-15581d2a-1fd3-48a1-ad25-49367a1778b5 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:52:49.690857 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-15581d2a-1fd3-48a1-ad25-49367a1778b5 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:52:49.697132 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15581d2a-1fd3-48a1-ad25-49367a1778b5 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:49.697568 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15581d2a-1fd3-48a1-ad25-49367a1778b5 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:49.698319 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15581d2a-1fd3-48a1-ad25-49367a1778b5 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:49.698745 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-15581d2a-1fd3-48a1-ad25-49367a1778b5 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:49.826814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-15581d2a-1fd3-48a1-ad25-49367a1778b5 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:52:49.833948 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-15581d2a-1fd3-48a1-ad25-49367a1778b5 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7" status: 200 len: 1458 microversion: 2.1 time: 0.147402 Nov 02 23:52:49.834513 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2773/3348] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:52:49 2021] GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7 => generated 1458 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:52:50.850543 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-b65bd080-f5af-4505-8689-8c9e9c42617a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:52:50.851291 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-b65bd080-f5af-4505-8689-8c9e9c42617a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:52:50.857537 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b65bd080-f5af-4505-8689-8c9e9c42617a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:50.857990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b65bd080-f5af-4505-8689-8c9e9c42617a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:50.858752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b65bd080-f5af-4505-8689-8c9e9c42617a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:50.859213 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-b65bd080-f5af-4505-8689-8c9e9c42617a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:50.922604 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.policy [None req-b65bd080-f5af-4505-8689-8c9e9c42617a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be44ffed515408bafef59166c9d0175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb44064bb93455f8407c8eec29a03f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115800) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:52:50.930434 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-b65bd080-f5af-4505-8689-8c9e9c42617a tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7" status: 200 len: 1390 microversion: 2.1 time: 0.083626 Nov 02 23:52:50.931025 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2774/3349] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:52:50 2021] GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:52:50.935429 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [req-8c1206bd-f8b6-4e63-aa03-5ed274cdabd6 req-c00ca084-570b-4de9-987f-61c583fdde49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "805c9985-e8e5-4414-a1ec-068fcedefdf7", "name": "network-vif-deleted", "tag": "c6be597a-fea4-470d-ad99-e5f17135b398"}]} {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:52:50.937147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 23:52:50.937147 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: warnings.warn(msg) Nov 02 23:52:50.943915 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-8c1206bd-f8b6-4e63-aa03-5ed274cdabd6 req-c00ca084-570b-4de9-987f-61c583fdde49 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:50.944349 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [req-8c1206bd-f8b6-4e63-aa03-5ed274cdabd6 req-c00ca084-570b-4de9-987f-61c583fdde49 service nova] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:50.955389 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.compute.server_external_events [req-8c1206bd-f8b6-4e63-aa03-5ed274cdabd6 req-c00ca084-570b-4de9-987f-61c583fdde49 service nova] Creating event network-vif-deleted:c6be597a-fea4-470d-ad99-e5f17135b398 for instance 805c9985-e8e5-4414-a1ec-068fcedefdf7 on hv-cinder-81584 Nov 02 23:52:50.960044 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [req-8c1206bd-f8b6-4e63-aa03-5ed274cdabd6 req-c00ca084-570b-4de9-987f-61c583fdde49 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027953 Nov 02 23:52:50.960608 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2775/3350] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 2 23:52:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:52:51.947231 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0983fb53-d150-4370-9b4c-16b6be2c630b tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:52:51.947925 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-0983fb53-d150-4370-9b4c-16b6be2c630b tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: 805c9985-e8e5-4414-a1ec-068fcedefdf7] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:52:51.954009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0983fb53-d150-4370-9b4c-16b6be2c630b tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:51.954451 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0983fb53-d150-4370-9b4c-16b6be2c630b tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:51.955234 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0983fb53-d150-4370-9b4c-16b6be2c630b tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:51.955663 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-0983fb53-d150-4370-9b4c-16b6be2c630b tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:51.968698 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-0983fb53-d150-4370-9b4c-16b6be2c630b tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] HTTP exception thrown: Instance 805c9985-e8e5-4414-a1ec-068fcedefdf7 could not be found. Nov 02 23:52:51.969270 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-0983fb53-d150-4370-9b4c-16b6be2c630b tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Returning 404 to user: Instance 805c9985-e8e5-4414-a1ec-068fcedefdf7 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:52:51.970096 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-0983fb53-d150-4370-9b4c-16b6be2c630b tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7" status: 404 len: 111 microversion: 2.1 time: 0.027402 Nov 02 23:52:51.970606 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2776/3351] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:52:51 2021] GET /compute/v2.1/servers/805c9985-e8e5-4414-a1ec-068fcedefdf7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 23:52:52.405990 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-966b8a53-57f4-40c0-9fdf-6bd7312c7521 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:52:52.406485 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-966b8a53-57f4-40c0-9fdf-6bd7312c7521 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:52:52.412368 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-966b8a53-57f4-40c0-9fdf-6bd7312c7521 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:52.412814 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-966b8a53-57f4-40c0-9fdf-6bd7312c7521 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:52.413577 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-966b8a53-57f4-40c0-9fdf-6bd7312c7521 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:52.414009 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-966b8a53-57f4-40c0-9fdf-6bd7312c7521 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:52.427119 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-966b8a53-57f4-40c0-9fdf-6bd7312c7521 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] HTTP exception thrown: Instance cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 could not be found. Nov 02 23:52:52.427640 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-966b8a53-57f4-40c0-9fdf-6bd7312c7521 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Returning 404 to user: Instance cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:52:52.428464 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-966b8a53-57f4-40c0-9fdf-6bd7312c7521 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "DELETE /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 404 len: 111 microversion: 2.1 time: 0.026869 Nov 02 23:52:52.428977 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2777/3352] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 2 23:52:52 2021] DELETE /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 23:52:52.436160 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5da6ab9d-b076-412e-a719-29d05c0e7cc9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:52:52.436754 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.compute.api [None req-5da6ab9d-b076-412e-a719-29d05c0e7cc9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] [instance: cbde8758-7f43-4f8d-adef-8bbd2dfab2e8] Fetching instance by UUID {{(pid=115800) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 23:52:52.442018 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5da6ab9d-b076-412e-a719-29d05c0e7cc9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:52.442462 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5da6ab9d-b076-412e-a719-29d05c0e7cc9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:52.443249 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5da6ab9d-b076-412e-a719-29d05c0e7cc9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 23:52:52.443686 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG oslo_concurrency.lockutils [None req-5da6ab9d-b076-412e-a719-29d05c0e7cc9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Lock "8cf0116f-06d0-4573-b34b-f5af4d2eb5ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 23:52:52.457792 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.wsgi [None req-5da6ab9d-b076-412e-a719-29d05c0e7cc9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] HTTP exception thrown: Instance cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 could not be found. Nov 02 23:52:52.458356 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-5da6ab9d-b076-412e-a719-29d05c0e7cc9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Returning 404 to user: Instance cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 could not be found. {{(pid=115800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 23:52:52.459179 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-5da6ab9d-b076-412e-a719-29d05c0e7cc9 tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8" status: 404 len: 111 microversion: 2.1 time: 0.026232 Nov 02 23:52:52.459685 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2778/3353] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 2 23:52:52 2021] GET /compute/v2.1/servers/cbde8758-7f43-4f8d-adef-8bbd2dfab2e8 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 23:52:53.727752 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: DEBUG nova.api.openstack.wsgi [None req-426c750d-08a1-4369-b6f2-c1eaaecdafce tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] Calling method '.version_select at 0x7fd8584b3550>' {{(pid=115800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:52:53.754506 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO nova.api.openstack.requestlog [None req-426c750d-08a1-4369-b6f2-c1eaaecdafce tempest-TestVolumeBootPattern-782893188 tempest-TestVolumeBootPattern-782893188-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-426019499" status: 202 len: 0 microversion: 2.1 time: 0.030324 Nov 02 23:52:53.755101 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: [pid: 115800|app: 0|req: 2779/3354] 10.222.0.41 () {58 vars in 1259 bytes} [Tue Nov 2 23:52:53 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-426019499 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 23:55:36.874514 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:55:36.875208 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:55:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 23:55:37.782885 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:55:37.783063 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:55:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 23:56:06.079325 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:56:06.079967 dv-cinder-815848-3-iscsi devstack@n-api.service[115800]: Tue Nov 2 23:56:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!